TurboQuant on Consumer GPUs — 100K Context on RTX 3090, 64K on RTX 4070: likes over time

ai-engineering-at/llama-cpp-turboquant-guide is a static Space on the Hugging Face Hub. It has 15 likes, 0 in the last 7 days and 0 in the last 30, and ranks #6,608 among Spaces by likes.

Open ai-engineering-at/llama-cpp-turboquant-guide on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.