Multilingual LLM Tokenizers: likes over time
aiqtech/LLM-Token-Visual is a docker Space on the Hugging Face Hub. It has 24 likes, 0 in the last 7 days and 0 in the last 30, and ranks #4,809 among Spaces by likes.
you to experience how Multilingual tokenizers work.
What it uses
- Qwen/Qwen3-0.6B (model)
- Qwen/Qwen3-8B (model)
- Qwen/Qwen3-4B (model)
- Qwen/Qwen3-32B (model)
- Qwen/Qwen3-14B (model)
- Qwen/Qwen3-30B-A3B (model)
- Qwen/Qwen3-235B-A22B (model)