See how a Llama 3 tokenizer splits plain text, inspect token IDs, and keep your text in the browser.
Your text stays in this browser. Nothing you paste is uploaded.
Plain text is encoded locally with the Llama 3 tokenizer. Chat templates and system instructions are not added.
This page runs the pinned Llama 3 tokenizer locally in a browser Worker and returns token pieces and IDs.
Only plain text is encoded. Llama chat templates, roles, system instructions, tools, and model-specific request formatting are not added.
For request-volume and output-token calculations, see the monthly LLM API cost guide. Using OpenAI? Check the current OpenAI API token prices.
To compare the same English, Chinese, JSON, and code samples, open the reproducible tokenizer comparison.
Llama 3 tokenizer sourceHigh confidenceChecked 2026-07-19
StackLens pins the Llama 3 tokenizer asset maintained by Hugging Face staff and ships the required Meta Llama notice. Chat templates are not added.
The current page uses a pinned Llama 3 tokenizer asset. It does not claim to reproduce every later Llama-family tokenizer.
Yes. The tokenizer runs in a browser Worker, and StackLens does not upload the text you enter.
Yes. The page exposes the token pieces and numeric IDs returned by the pinned tokenizer.
No. It encodes plain text only, without roles, special messages, tools, or a chat template.