"Tokens, context windows and why your AI forgets things"
Why does an AI assistant forget the order number a customer gave it five minutes ago? It is not a bug — it is a limit built into how these models work. Here is what tokens and context windows actually are, and what they mean for your product idea and your bill.
Here is a question I get asked a lot: "why does the chatbot forget what we told it five minutes ago?" A founder shows me their AI-powered support tool, the conversation runs long, and suddenly the assistant has no idea the customer already gave their order number. It looks like a bug. It is usually not a bug. It is a limit built into how these models work, and understanding it will save you money and disappointment.
Have an AI feature stuck between demo and production?
The gap — reliability, evals, cost control, the plumbing that keeps it running unattended — is exactly the work I do. If that sounds familiar, a short conversation is usually enough to point you the right way.
Book a free consultation