What we are building
Tokenizers decide how a model sees your text. The same prompt can produce very different token counts, and therefore cost and latency, across model families. This tool will run your text through several tokenizers in the browser and show the splits aligned column by column, with a token count and a cost projection per provider.
Status
Coming soon. Not yet available. Until then, the external tools on the playground page cover tokenization well.