Token LabSearch

Tokenizer & Payload inspector

No API key · Your input stays in this browser

Loading tokenizer…

Tokenizer

Paste a prompt, code, or multilingual text. Counts update as you type.

01Choose an encoding and an example

Try an example

02Enter your text

—UTF-8 · Up to 100,000 UTF-16 code units

03Inspect the token sequence

Each color marks a token. Select one to see its ID and decoded fragment.

Spaces → · Newlines → ↵
Total tokens—Encoded text only
Characters / token—Unicode code points, not visual glyphs
UTF-8 bytes—Bytes and tokens measure different things
Selected tokenSelect a token ↗Explore the mapping between text and token IDs

A token may contain only part of a UTF-8 character and display � on its own. Decoding the complete sequence restores the text. The view shows up to 2,000 tokens; counts and exports include all tokens.

04Compare or export

Ready · Text tokens only; API message overhead is excluded.