hugging-quants on Hugging Face: model downloads

hugging-quants has 21 tracked models, downloaded 537,495 times in the last 30 days and 25,833,132 times in total. hugging-quants Wrapped: the last 12 months.

Models by downloads in the last 30 days

1. hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 178.6K downloads, text generation
2. hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4 167K downloads, text generation
3. hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF 63.5K downloads, text generation
4. hugging-quants/gemma-2-9b-it-AWQ-INT4 61.2K downloads, text generation
5. hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF 39.3K downloads, text generation
6. hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4 8.6K downloads, text generation
7. hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF 8.1K downloads, text generation
8. hugging-quants/Mixtral-8x7B-Instruct-v0.1-AWQ-INT4 6.4K downloads, text generation
9. hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF 2K downloads, text generation
10. hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4 1.1K downloads, text generation
11. hugging-quants/Meta-Llama-3.1-8B-Instruct-BNB-NF4 715 downloads, text generation
12. hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4 360 downloads, text generation
13. hugging-quants/Meta-Llama-3.1-405B-Instruct-GPTQ-INT4 347 downloads, text generation
14. hugging-quants/Meta-Llama-3.1-405B-BNB-NF4 155 downloads, text generation
15. hugging-quants/Meta-Llama-3.1-405B-BNB-NF4-BF16 68 downloads, text generation
16. hugging-quants/Meta-Llama-3.1-405B-Instruct-BNB-NF4 37 downloads, text generation
17. hugging-quants/Meta-Llama-3.1-8B-BNB-NF4 28 downloads, text generation
18. hugging-quants/Llama-4-Scout-17B-16E-Instruct-fbgemm 26 downloads, image text to text
19. hugging-quants/Meta-Llama-3.1-8B-BNB-NF4-BF16 17 downloads, text generation
20. hugging-quants/Meta-Llama-3.1-70B-BNB-NF4-BF16 17 downloads, text generation
21. hugging-quants/Llama-4-Scout-17B-16E-Instruct-fbgemm-unfused 13 downloads, image text to text