jaytonde05/prefixbench download history
jaytonde05/prefixbench is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 28 times (12 in the last 7 days), and 375 times in total. It ranks #399,493 among datasets by monthly downloads.
PrefixBench JSONL Datasets These datasets generate deterministic prompts for testing KV prefix caching behavior in LLM inference servers such as vLLM and SGLang. The prompts use controlled shared prefixes plus small unique suffixes so benchmark clients can compare cache reuse, latency
Open jaytonde05/prefixbench on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.