christopherthompson81/quant_exploration download history
christopherthompson81/quant_exploration is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 195 times (57 in the last 7 days), and 3,276 times in total. It ranks #68,932 among datasets by monthly downloads.
Examining LLM Quantization Impact This document is a comparative analysis of qualitative performance degradation across Llama.cpp quantization within a single 2x7B model. My hope is that it will help people unfamiliar with quant impacts get a sense of how quantization will affect output.
Models trained on quant_exploration
1 models list it as training data.
- kvn420/Tenro_V4.1 0 downloads in 30 days
Open christopherthompson81/quant_exploration on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.