DEVELOPER GUIDE
Understand it. Then build with it.
Four practical guides, with examples you can run in the tools.
01
DEVELOPER GUIDE
02Tokens and tokenizers: from text to model input
Learn what a token represents, inspect a real encoding, and verify a lossless round trip.
Read the tutorial →DEVELOPER GUIDE
03Why languages, emoji, and JSON change token counts
Compare encodings with multilingual text and learn why characters, bytes, and tokens are different measurements.
Read the tutorial →DEVELOPER GUIDE
04Debug a context overflow: a practical RAG budget
Break a request into sections, reserve generation space, and prioritize the largest source of context growth.
Read the tutorial →DEVELOPER GUIDE
Inspect an AI payload: JSON, Base64, images, and audio
Trace a multimodal request from nested fields to decoded bytes and safe local media previews.
Read the tutorial →