The Tokenizer Playground: likes over time

Xenova/the-tokenizer-playground is a static Space on the Hugging Face Hub. It has 710 likes, 2 in the last 7 days and 12 in the last 30, and ranks #212 among Spaces by likes.

Experiment with and compare different tokenizers

What it uses

• Xenova/t5-small (model)
• xai-org/grok-1 (model)
• Xenova/bert-base-cased (model)
• Xenova/gemma-tokenizer (model)
• Xenova/c4ai-command-r-v01-tokenizer (model)
• Xenova/gpt-4 (model)
• Xenova/claude-tokenizer (model)
• Xenova/mistral-tokenizer (model)
• Xenova/gpt-3 (model)
• Xenova/grok-1-tokenizer (model)
• Xenova/text-davinci-003 (model)
• Xenova/llama-tokenizer (model)

Open Xenova/the-tokenizer-playground on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.