jaytonde05/kv-cache-quantization-commands download history
jaytonde05/kv-cache-quantization-commands is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 13 times (13 in the last 7 days), and 13 times in total. It ranks #599,490 among datasets by monthly downloads.
KV cache quantization: run commands These are the scripts and commands for the post "KV Cache Quantization, Measured: What FP8 and NVFP4 Really Cost". This repo holds commands only. It does not hold model weights, benchmark data, or model responses. Setup Item Val
Open jaytonde05/kv-cache-quantization-commands on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.