From Dev.to
A token is not a word, and your chat box is not the bill
When a tool says a request used "1,000 tokens", it's tempting to read that as 1,000 words. It isn't. A token is the unit a model's tokenizer cuts text into. Sometimes that's a whole word, sometimes a...