Visualize how many tokens are in different text lengths by adjusting the sliders below.
Input Tokens
1,000 tokens
512
4K
8K
16K
32K
128K
1M
Output Tokens
1,000 tokens
512
4K
8K
16K
32K
128K
1M
The text below represents approximately how much content fits in the selected token counts. Colors indicate different token milestones.
word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word
About LLM Tokens
Tokens are the basic units that LLMs process. In English, a token is approximately 4 characters or 0.75 words. Different models have different context window sizes (maximum tokens they can process):
- GPT-3.5 Turbo: 4K or 16K tokens
- GPT-4: 8K or 32K tokens
- Claude 2: 100K tokens
- Claude Opus: 200K tokens
- Anthropic Claude 3 Sonnet: 200K tokens
- GPT-4o: 128K tokens
- Claude 3 Opus: 200K tokens
Color Legend
- ■Up to 512 tokens
- ■Up to 4,000 tokens
- ■Up to 8,000 tokens
- ■Up to 16,000 tokens
- ■Up to 32,000 tokens
- ■Up to 128,000 tokens
- ■1M+ tokens