inference-optimization on Hugging Face: downloads and rankings
inference-optimization has 491 tracked models, downloaded 91,147 times in the last 30 days and 695,112 times in total; 31 datasets, downloaded 4,083 times in the last 30 days. inference-optimization Wrapped: the last 12 months.
Models by downloads in the last 30 days
- inference-optimization/Qwen3-1.6B-A0.9B 15.4K downloads, text generation
- inference-optimization/GLM-5.3-Flash-0.1B-A0.1B 8.3K downloads, image text to text
- inference-optimization/Qwen3-VL-1.0B-A0.4B-Instruct 7.1K downloads, image text to text
- inference-optimization/Llama-3.2-0.5B-Instruct 5.7K downloads, text generation
- inference-optimization/Qwen3.8-1.0B-A0.6B 5K downloads, text generation
- inference-optimization/DeepSeek-V3-debug-empty 1.8K downloads, model
- inference-optimization/Phi-3.5-MoE-0.8B-A0.2B 1.7K downloads, text generation
- inference-optimization/Llama-4-Scout-1.7B-0.4B-Instruct 1.5K downloads, image text to text
- inference-optimization/GLM-5.2-0.8B-A0.8B 1.4K downloads, text generation
- inference-optimization/NemotronH-0.3B-A0.3B 1.4K downloads, text generation
- inference-optimization/DSV4-tiny-empty 1.4K downloads, model
- inference-optimization/DeepSeek-V3-debug-empty-NVFP4A16 1.3K downloads, model
- inference-optimization/Kimi-K3-0.40B 1.2K downloads, feature extraction
- inference-optimization/Qwen3-0.6B-W4A16-G128 1.2K downloads, model
- inference-optimization/gemma-4-1B-0.8B-tiny 1.2K downloads, model
- inference-optimization/GLM-5.3-0.6B-A0.4B 1.1K downloads, text generation
- inference-optimization/DeepSeek-V4-Pro-0.5B-A0.37B 1K downloads, text generation
- inference-optimization/Inkling-0.6B-A0.6B 1K downloads, image text to text
- inference-optimization/DeepSeek-V3-debug-empty-FP8_DYNAMIC 990 downloads, model
- inference-optimization/Qwen3.8-Flash-Next-0.2B-A0.2B 987 downloads, image text to text
- inference-optimization/gpt-oss-2.5B-A1.3B 968 downloads, model
- inference-optimization/gemma-4-unified-0.8B-tiny 967 downloads, model
- inference-optimization/Qwen3-VL-Reranker-0.1B-tiny 956 downloads, model
- inference-optimization/granite-vision-4.1-0.2B-tiny 940 downloads, model
- inference-optimization/Qwen3.6-8B-A1.6B 907 downloads, image text to text
- inference-optimization/Qwen3.6-1.3B-A1.3B-small 715 downloads, image text to text
- inference-optimization/Llama-3.2-1B-Instruct-FP8-Block 700 downloads, model
- inference-optimization/Qwen3-8B-from-Qwen3-8B_regen-speculators.eagle3-qwen3arch-ckpt1 554 downloads, model
- inference-optimization/Qwen3-8B-speculators.peagle-qwen3arch-ckpt4 496 downloads, model
- inference-optimization/Qwen3-30B-A3B-RAZOR20 397 downloads, text generation
- inference-optimization/Qwen3-0.6B-FP8_BLOCK 359 downloads, model
- inference-optimization/Qwen3-Coder-Next.w4a16 300 downloads, text generation
- inference-optimization/Qwen3-0.9B-A0.8B-small 229 downloads, text generation
- inference-optimization/TinyQwen3-KV-Cache-Only 210 downloads, text generation
- inference-optimization/Qwen3.8-Flash-Next-1.9B-A1.8B-small 176 downloads, image text to text
- inference-optimization/Qwen3.8-27B-DSpark-PerfectBlend-NVFP4-W4A4 150 downloads, text generation
- inference-optimization/Qwen3.8-27B-DSpark-Gauss-NVFP4-W4A4 145 downloads, text generation
- inference-optimization/Qwen3.8-27B-DSpark-GPTQ-PerfectBlend-NVFP4-W4A4 143 downloads, text generation
- inference-optimization/Qwen3.8-Flash-Next-MEP50 142 downloads, model
- inference-optimization/Qwen3.8-27B-DSpark-GPTQ-IMatrix-PerfectBlend-NVFP4-W4A4 141 downloads, text generation
- inference-optimization/DeepSeek-V4-Flash-DSpark-2.1B-A1.9B-small 138 downloads, text generation
- inference-optimization/Qwen3.8-27B-DSpark-GPTQ-IMatrix-Gauss-NVFP4-W4A4 137 downloads, text generation
- inference-optimization/GLM-5.3-Flash-2.6B-A2.3B-small 137 downloads, image text to text
- inference-optimization/Qwen3.8-27B-DSpark-GPTQ-Gauss-NVFP4-W4A4 134 downloads, text generation
- inference-optimization/Kimi-K3-0.40B-MXFP4 133 downloads, model
- inference-optimization/Qwen3.8-27B-DSpark-FP8-DYNAMIC 124 downloads, text generation
- inference-optimization/qwen3.8-27B-speculator.dflash2.comparisonrecipe.v2.epoch1_end 119 downloads, model
- inference-optimization/Kimi-K3-4.6B-A4.5B-small 114 downloads, feature extraction
- inference-optimization/Qwen3.8-27B-DSpark-FP8-BLOCK 112 downloads, text generation
- inference-optimization/Qwen3-8B-DFlash-PerfectBlend-NVFP4-W4A4 108 downloads, text generation
- inference-optimization/DeepSeek-V3-3.4B-A3.0B-small 108 downloads, text generation
- inference-optimization/dflash-DeepSeek-V4-Flash-all-swa-muon-speculators-50k 107 downloads, model
- inference-optimization/Qwen3-8B-DFlash-Gauss-NVFP4-W4A4 107 downloads, text generation
- inference-optimization/GLM-5.2-3.5B-A3.3B-small 103 downloads, text generation
- inference-optimization/Qwen3-8B-speculator.dspark.swa.dpace.fullvocab.muon.2048anc.combdatav4-q235b-instr-v1-ckpt2 103 downloads, model
- inference-optimization/Qwen3.8-27B-DSpark-Gauss-FP8-W8A8 96 downloads, text generation
- inference-optimization/Qwen3.8-27B-DSpark-PerfectBlend-FP8-W8A8 95 downloads, text generation
- inference-optimization/DeepSeek-V4-Pro-3.7B-A3.4B-small 94 downloads, text generation
- inference-optimization/GLM-5.3-3.5B-A3.3B-small 92 downloads, text generation
- inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v9-ckpt19 90 downloads, model
- inference-optimization/dflash-DeepSeek-V4-Flash-speculators-50k 88 downloads, model
- inference-optimization/Phi-3.5-MoE-1.0B-A0.7B-small 88 downloads, text generation
- inference-optimization/Llama-3.2-0.5B-Instruct-small 86 downloads, text generation
- inference-optimization/Qwen3-8B-DFlash-GPTQ-PerfectBlend-NVFP4-W4A4 83 downloads, text generation
- inference-optimization/Qwen3-8B-DFlash-GPTQ-IMatrix-Gauss-NVFP4-W4A4 82 downloads, text generation
- inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v9-ckpt16 81 downloads, model
- inference-optimization/Qwen3-8B-DFlash-GPTQ-Gauss-NVFP4-W4A4 80 downloads, text generation
- inference-optimization/ctest-Qwen3-8B-speculator.dspark-fp8ablation-fp8 80 downloads, model
- inference-optimization/ctest-Qwen3-8B-speculator.dspark-fp8ablation-bf16 79 downloads, model
- inference-optimization/Qwen3.8-6.2B-A6.0B-small 79 downloads, text generation
- inference-optimization/Qwen3-8B-DFlash-GPTQ-IMatrix-PerfectBlend-NVFP4-W4A4 78 downloads, text generation
- inference-optimization/Qwen3-8B-DFlash-Gauss-FP8-W8A8 78 downloads, text generation
- inference-optimization/Qwen3-8B-DFlash-PerfectBlend-FP8-W8A8 77 downloads, text generation
- inference-optimization/Qwen3-8B-DFlash-FP8-DYNAMIC 76 downloads, text generation
- inference-optimization/GLM-5-2.9B-A2.8B-small 75 downloads, text generation
- inference-optimization/Qwen3-8B-DFlash-FP8-BLOCK 74 downloads, text generation
- inference-optimization/Qwen3-30B-A3B-INT3xFP8 73 downloads, text generation
- inference-optimization/granite-vision-4.1-0.6B-small 72 downloads, image text to text
- inference-optimization/ctest-Qwen3-8B-speculator.eagle3-fp8ablation-fp8 71 downloads, model
- inference-optimization/Inkling-4.5B-A4.2B-small 71 downloads, image text to text
- inference-optimization/ctest-Qwen3-8B-speculator.dflash-fp8ablation-fp8 70 downloads, model
- inference-optimization/gemma-4-26B-A4B-it-NVFP4-REAP-50 70 downloads, model
- inference-optimization/GLM-4.7-Flash-1.0B-A0.9B-small 70 downloads, text generation
- inference-optimization/ctest-Qwen3-8B-speculator.dflash-fp8ablation-bf16 69 downloads, model
- inference-optimization/ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 68 downloads, model
- inference-optimization/gemma-4-26B-A4B-it-NVFP4-REAP-25 67 downloads, model
- inference-optimization/Qwen3-8B-from-Qwen3-8B_regen-speculators.eagle31-qwen3arch-ckpt1 67 downloads, model
- inference-optimization/NemotronH-3.4B-A3.4B-small 67 downloads, text generation
- inference-optimization/qwen3.8-27B-speculator.dflash2.comparisonrecipe.epoch1_step93171 66 downloads, model
- inference-optimization/gemma-4-unified-1.5B-small 65 downloads, image text to text
- inference-optimization/gemma-4-31B-it-speculator.dflash.latestrecipe.ckp2 65 downloads, model
- inference-optimization/gemma-4-31B-it-speculator.dflash.latestrecipe.ckp4 65 downloads, model
- inference-optimization/gemma-4-31B-it-speculator.dflash.latestrecipe.bs8.ckp0 64 downloads, model
- inference-optimization/Qwen3-8B-speculator.dflash2.v1.fullvocab.muon.dpace-preresume-epoch2 63 downloads, model
- inference-optimization/DeepSeek-V4-Pro-0.5B-A0.37B-NVFP4-FP8 63 downloads, model
- inference-optimization/Qwen3-30B-A3B-FP8 63 downloads, model
- inference-optimization/gemma-4-31B-it-speculator.dflash.latestrecipe.ckp1 63 downloads, model
- inference-optimization/gpt-oss-1.5B-A1.4B-small 63 downloads, text generation
- inference-optimization/GLM-5.3-Flash-NVFP4-RAZOR20 62 downloads, image text to text
- inference-optimization/Qwen3-30B-A3B-MXFP4xFP8 62 downloads, text generation
Datasets by downloads in the last 30 days
- inference-optimization/speculators-ci-datasets 1K downloads
- inference-optimization/Qwen3-8B-Regenerated-Collection 763 downloads
- inference-optimization/Qwen3-8b-sharegpt-5k 382 downloads
- inference-optimization/RazorCal 279 downloads
- inference-optimization/dflash-code-multilingual-teacher-responses-qwen235b 274 downloads
- inference-optimization/SWE-bench_Multilingual 159 downloads
- inference-optimization/Qwen3-32B-responses 118 downloads
- inference-optimization/Qwen3.5-4B-responses 118 downloads
- inference-optimization/Qwen3.5-0.8B-responses 117 downloads
- inference-optimization/speculators_benchmarks_tool_call 114 downloads
- inference-optimization/gpt-oss-120b-responses 79 downloads
- inference-optimization/Gemma4-Responses-Nemotron 74 downloads
- inference-optimization/speculators-qwen3-30b-a3b-instruct-2507 56 downloads
- inference-optimization/every-eval-ever-demo 47 downloads
- inference-optimization/dflash-qwen3-8b-qwen235b-instruct-bs16-prepared-data 46 downloads
- inference-optimization/laguna-xs-ultrachat-responses 46 downloads
- inference-optimization/Qwen3-30B-A3B-responses 44 downloads
- inference-optimization/Longbench_Samples_Specdec 42 downloads
- inference-optimization/DeepSeek-V4-Flash-responses 41 downloads
- inference-optimization/ctest-Qwen3.6-27B-speculator-dataset 41 downloads
- inference-optimization/Qwen3.5-9B-responses 32 downloads
- inference-optimization/Dataset-Qwen3-235B-Instruct 29 downloads
- inference-optimization/ctest-subset-Qwen3.5-397B-A17B-FP8-dynamic-speculator-dataset 26 downloads
- inference-optimization/laguna-xs-magpie-300k-conversations 23 downloads
- inference-optimization/updated-ctest-Qwen3-8B-speculator-dataset 22 downloads
- inference-optimization/final-ctest-Qwen3-8B-speculator-dataset 20 downloads
- inference-optimization/SWE-bench_Lite 20 downloads
- inference-optimization/laguna-xs-ultrachat-conversations 17 downloads
- inference-optimization/laguna-xs-magpie-300k-responses 14 downloads
- inference-optimization/SWE-bench_Verified 14 downloads
- inference-optimization/qwen3-test-model 7 downloads
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.