inference-optimization on Hugging Face: downloads and rankings

inference-optimization has 491 tracked models, downloaded 91,147 times in the last 30 days and 695,112 times in total; 31 datasets, downloaded 4,083 times in the last 30 days. inference-optimization Wrapped: the last 12 months.

Models by downloads in the last 30 days

  1. inference-optimization/Qwen3-1.6B-A0.9B 15.4K downloads, text generation
  2. inference-optimization/GLM-5.3-Flash-0.1B-A0.1B 8.3K downloads, image text to text
  3. inference-optimization/Qwen3-VL-1.0B-A0.4B-Instruct 7.1K downloads, image text to text
  4. inference-optimization/Llama-3.2-0.5B-Instruct 5.7K downloads, text generation
  5. inference-optimization/Qwen3.8-1.0B-A0.6B 5K downloads, text generation
  6. inference-optimization/DeepSeek-V3-debug-empty 1.8K downloads, model
  7. inference-optimization/Phi-3.5-MoE-0.8B-A0.2B 1.7K downloads, text generation
  8. inference-optimization/Llama-4-Scout-1.7B-0.4B-Instruct 1.5K downloads, image text to text
  9. inference-optimization/GLM-5.2-0.8B-A0.8B 1.4K downloads, text generation
  10. inference-optimization/NemotronH-0.3B-A0.3B 1.4K downloads, text generation
  11. inference-optimization/DSV4-tiny-empty 1.4K downloads, model
  12. inference-optimization/DeepSeek-V3-debug-empty-NVFP4A16 1.3K downloads, model
  13. inference-optimization/Kimi-K3-0.40B 1.2K downloads, feature extraction
  14. inference-optimization/Qwen3-0.6B-W4A16-G128 1.2K downloads, model
  15. inference-optimization/gemma-4-1B-0.8B-tiny 1.2K downloads, model
  16. inference-optimization/GLM-5.3-0.6B-A0.4B 1.1K downloads, text generation
  17. inference-optimization/DeepSeek-V4-Pro-0.5B-A0.37B 1K downloads, text generation
  18. inference-optimization/Inkling-0.6B-A0.6B 1K downloads, image text to text
  19. inference-optimization/DeepSeek-V3-debug-empty-FP8_DYNAMIC 990 downloads, model
  20. inference-optimization/Qwen3.8-Flash-Next-0.2B-A0.2B 987 downloads, image text to text
  21. inference-optimization/gpt-oss-2.5B-A1.3B 968 downloads, model
  22. inference-optimization/gemma-4-unified-0.8B-tiny 967 downloads, model
  23. inference-optimization/Qwen3-VL-Reranker-0.1B-tiny 956 downloads, model
  24. inference-optimization/granite-vision-4.1-0.2B-tiny 940 downloads, model
  25. inference-optimization/Qwen3.6-8B-A1.6B 907 downloads, image text to text
  26. inference-optimization/Qwen3.6-1.3B-A1.3B-small 715 downloads, image text to text
  27. inference-optimization/Llama-3.2-1B-Instruct-FP8-Block 700 downloads, model
  28. inference-optimization/Qwen3-8B-from-Qwen3-8B_regen-speculators.eagle3-qwen3arch-ckpt1 554 downloads, model
  29. inference-optimization/Qwen3-8B-speculators.peagle-qwen3arch-ckpt4 496 downloads, model
  30. inference-optimization/Qwen3-30B-A3B-RAZOR20 397 downloads, text generation
  31. inference-optimization/Qwen3-0.6B-FP8_BLOCK 359 downloads, model
  32. inference-optimization/Qwen3-Coder-Next.w4a16 300 downloads, text generation
  33. inference-optimization/Qwen3-0.9B-A0.8B-small 229 downloads, text generation
  34. inference-optimization/TinyQwen3-KV-Cache-Only 210 downloads, text generation
  35. inference-optimization/Qwen3.8-Flash-Next-1.9B-A1.8B-small 176 downloads, image text to text
  36. inference-optimization/Qwen3.8-27B-DSpark-PerfectBlend-NVFP4-W4A4 150 downloads, text generation
  37. inference-optimization/Qwen3.8-27B-DSpark-Gauss-NVFP4-W4A4 145 downloads, text generation
  38. inference-optimization/Qwen3.8-27B-DSpark-GPTQ-PerfectBlend-NVFP4-W4A4 143 downloads, text generation
  39. inference-optimization/Qwen3.8-Flash-Next-MEP50 142 downloads, model
  40. inference-optimization/Qwen3.8-27B-DSpark-GPTQ-IMatrix-PerfectBlend-NVFP4-W4A4 141 downloads, text generation
  41. inference-optimization/DeepSeek-V4-Flash-DSpark-2.1B-A1.9B-small 138 downloads, text generation
  42. inference-optimization/Qwen3.8-27B-DSpark-GPTQ-IMatrix-Gauss-NVFP4-W4A4 137 downloads, text generation
  43. inference-optimization/GLM-5.3-Flash-2.6B-A2.3B-small 137 downloads, image text to text
  44. inference-optimization/Qwen3.8-27B-DSpark-GPTQ-Gauss-NVFP4-W4A4 134 downloads, text generation
  45. inference-optimization/Kimi-K3-0.40B-MXFP4 133 downloads, model
  46. inference-optimization/Qwen3.8-27B-DSpark-FP8-DYNAMIC 124 downloads, text generation
  47. inference-optimization/qwen3.8-27B-speculator.dflash2.comparisonrecipe.v2.epoch1_end 119 downloads, model
  48. inference-optimization/Kimi-K3-4.6B-A4.5B-small 114 downloads, feature extraction
  49. inference-optimization/Qwen3.8-27B-DSpark-FP8-BLOCK 112 downloads, text generation
  50. inference-optimization/Qwen3-8B-DFlash-PerfectBlend-NVFP4-W4A4 108 downloads, text generation
  51. inference-optimization/DeepSeek-V3-3.4B-A3.0B-small 108 downloads, text generation
  52. inference-optimization/dflash-DeepSeek-V4-Flash-all-swa-muon-speculators-50k 107 downloads, model
  53. inference-optimization/Qwen3-8B-DFlash-Gauss-NVFP4-W4A4 107 downloads, text generation
  54. inference-optimization/GLM-5.2-3.5B-A3.3B-small 103 downloads, text generation
  55. inference-optimization/Qwen3-8B-speculator.dspark.swa.dpace.fullvocab.muon.2048anc.combdatav4-q235b-instr-v1-ckpt2 103 downloads, model
  56. inference-optimization/Qwen3.8-27B-DSpark-Gauss-FP8-W8A8 96 downloads, text generation
  57. inference-optimization/Qwen3.8-27B-DSpark-PerfectBlend-FP8-W8A8 95 downloads, text generation
  58. inference-optimization/DeepSeek-V4-Pro-3.7B-A3.4B-small 94 downloads, text generation
  59. inference-optimization/GLM-5.3-3.5B-A3.3B-small 92 downloads, text generation
  60. inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v9-ckpt19 90 downloads, model
  61. inference-optimization/dflash-DeepSeek-V4-Flash-speculators-50k 88 downloads, model
  62. inference-optimization/Phi-3.5-MoE-1.0B-A0.7B-small 88 downloads, text generation
  63. inference-optimization/Llama-3.2-0.5B-Instruct-small 86 downloads, text generation
  64. inference-optimization/Qwen3-8B-DFlash-GPTQ-PerfectBlend-NVFP4-W4A4 83 downloads, text generation
  65. inference-optimization/Qwen3-8B-DFlash-GPTQ-IMatrix-Gauss-NVFP4-W4A4 82 downloads, text generation
  66. inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v9-ckpt16 81 downloads, model
  67. inference-optimization/Qwen3-8B-DFlash-GPTQ-Gauss-NVFP4-W4A4 80 downloads, text generation
  68. inference-optimization/ctest-Qwen3-8B-speculator.dspark-fp8ablation-fp8 80 downloads, model
  69. inference-optimization/ctest-Qwen3-8B-speculator.dspark-fp8ablation-bf16 79 downloads, model
  70. inference-optimization/Qwen3.8-6.2B-A6.0B-small 79 downloads, text generation
  71. inference-optimization/Qwen3-8B-DFlash-GPTQ-IMatrix-PerfectBlend-NVFP4-W4A4 78 downloads, text generation
  72. inference-optimization/Qwen3-8B-DFlash-Gauss-FP8-W8A8 78 downloads, text generation
  73. inference-optimization/Qwen3-8B-DFlash-PerfectBlend-FP8-W8A8 77 downloads, text generation
  74. inference-optimization/Qwen3-8B-DFlash-FP8-DYNAMIC 76 downloads, text generation
  75. inference-optimization/GLM-5-2.9B-A2.8B-small 75 downloads, text generation
  76. inference-optimization/Qwen3-8B-DFlash-FP8-BLOCK 74 downloads, text generation
  77. inference-optimization/Qwen3-30B-A3B-INT3xFP8 73 downloads, text generation
  78. inference-optimization/granite-vision-4.1-0.6B-small 72 downloads, image text to text
  79. inference-optimization/ctest-Qwen3-8B-speculator.eagle3-fp8ablation-fp8 71 downloads, model
  80. inference-optimization/Inkling-4.5B-A4.2B-small 71 downloads, image text to text
  81. inference-optimization/ctest-Qwen3-8B-speculator.dflash-fp8ablation-fp8 70 downloads, model
  82. inference-optimization/gemma-4-26B-A4B-it-NVFP4-REAP-50 70 downloads, model
  83. inference-optimization/GLM-4.7-Flash-1.0B-A0.9B-small 70 downloads, text generation
  84. inference-optimization/ctest-Qwen3-8B-speculator.dflash-fp8ablation-bf16 69 downloads, model
  85. inference-optimization/ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 68 downloads, model
  86. inference-optimization/gemma-4-26B-A4B-it-NVFP4-REAP-25 67 downloads, model
  87. inference-optimization/Qwen3-8B-from-Qwen3-8B_regen-speculators.eagle31-qwen3arch-ckpt1 67 downloads, model
  88. inference-optimization/NemotronH-3.4B-A3.4B-small 67 downloads, text generation
  89. inference-optimization/qwen3.8-27B-speculator.dflash2.comparisonrecipe.epoch1_step93171 66 downloads, model
  90. inference-optimization/gemma-4-unified-1.5B-small 65 downloads, image text to text
  91. inference-optimization/gemma-4-31B-it-speculator.dflash.latestrecipe.ckp2 65 downloads, model
  92. inference-optimization/gemma-4-31B-it-speculator.dflash.latestrecipe.ckp4 65 downloads, model
  93. inference-optimization/gemma-4-31B-it-speculator.dflash.latestrecipe.bs8.ckp0 64 downloads, model
  94. inference-optimization/Qwen3-8B-speculator.dflash2.v1.fullvocab.muon.dpace-preresume-epoch2 63 downloads, model
  95. inference-optimization/DeepSeek-V4-Pro-0.5B-A0.37B-NVFP4-FP8 63 downloads, model
  96. inference-optimization/Qwen3-30B-A3B-FP8 63 downloads, model
  97. inference-optimization/gemma-4-31B-it-speculator.dflash.latestrecipe.ckp1 63 downloads, model
  98. inference-optimization/gpt-oss-1.5B-A1.4B-small 63 downloads, text generation
  99. inference-optimization/GLM-5.3-Flash-NVFP4-RAZOR20 62 downloads, image text to text
  100. inference-optimization/Qwen3-30B-A3B-MXFP4xFP8 62 downloads, text generation

Datasets by downloads in the last 30 days

  1. inference-optimization/speculators-ci-datasets 1K downloads
  2. inference-optimization/Qwen3-8B-Regenerated-Collection 763 downloads
  3. inference-optimization/Qwen3-8b-sharegpt-5k 382 downloads
  4. inference-optimization/RazorCal 279 downloads
  5. inference-optimization/dflash-code-multilingual-teacher-responses-qwen235b 274 downloads
  6. inference-optimization/SWE-bench_Multilingual 159 downloads
  7. inference-optimization/Qwen3-32B-responses 118 downloads
  8. inference-optimization/Qwen3.5-4B-responses 118 downloads
  9. inference-optimization/Qwen3.5-0.8B-responses 117 downloads
  10. inference-optimization/speculators_benchmarks_tool_call 114 downloads
  11. inference-optimization/gpt-oss-120b-responses 79 downloads
  12. inference-optimization/Gemma4-Responses-Nemotron 74 downloads
  13. inference-optimization/speculators-qwen3-30b-a3b-instruct-2507 56 downloads
  14. inference-optimization/every-eval-ever-demo 47 downloads
  15. inference-optimization/dflash-qwen3-8b-qwen235b-instruct-bs16-prepared-data 46 downloads
  16. inference-optimization/laguna-xs-ultrachat-responses 46 downloads
  17. inference-optimization/Qwen3-30B-A3B-responses 44 downloads
  18. inference-optimization/Longbench_Samples_Specdec 42 downloads
  19. inference-optimization/DeepSeek-V4-Flash-responses 41 downloads
  20. inference-optimization/ctest-Qwen3.6-27B-speculator-dataset 41 downloads
  21. inference-optimization/Qwen3.5-9B-responses 32 downloads
  22. inference-optimization/Dataset-Qwen3-235B-Instruct 29 downloads
  23. inference-optimization/ctest-subset-Qwen3.5-397B-A17B-FP8-dynamic-speculator-dataset 26 downloads
  24. inference-optimization/laguna-xs-magpie-300k-conversations 23 downloads
  25. inference-optimization/updated-ctest-Qwen3-8B-speculator-dataset 22 downloads
  26. inference-optimization/final-ctest-Qwen3-8B-speculator-dataset 20 downloads
  27. inference-optimization/SWE-bench_Lite 20 downloads
  28. inference-optimization/laguna-xs-ultrachat-conversations 17 downloads
  29. inference-optimization/laguna-xs-magpie-300k-responses 14 downloads
  30. inference-optimization/SWE-bench_Verified 14 downloads
  31. inference-optimization/qwen3-test-model 7 downloads

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.