Tokenizer Playground: likes over time
afeng/tokenizers is a gradio Space on the Hugging Face Hub. It has 1 likes, 0 in the last 7 days and 0 in the last 30, and ranks #34,828 among Spaces by likes.
Interactive tokenizer tool for NLP researchers
What it uses
- Qwen/Qwen3-0.6B (model)
- openai-community/gpt2 (model)
- Qwen/Qwen2.5-7B (model)
- meta-llama/Llama-3.1-8B (model)
- mistralai/Mistral-7B-v0.1 (model)
- google/gemma-7b (model)