Token

The basic unit of text processed by an LLM. A token is typically a word or part of a word. In English, roughly 1 token ≈ 4 characters. Models have a maximum context measured in tokens: GPT-4 supports 128K tokens, while Llama 3 supports 128K. More tokens = more context but more resources needed.