Token
A small piece of text, often part of a word, which is the unit a model reads and charges for. "4000 tokens" is not 4000 words, and the split is why long words cost more.
- See also: LLM
- See also: Context window
- Used in: LLMs
A small piece of text, often part of a word, which is the unit a model reads and charges for. "4000 tokens" is not 4000 words, and the split is why long words cost more.