maknee/ggml-vicuna-v0-quantized download history

maknee/ggml-vicuna-v0-quantized is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 58 times (7 in the last 7 days), and 4,678 times in total. It ranks #166,890 among datasets by monthly downloads.

These are quantized ggml binary files for vicuna 7B and 13B models. The version of vicuna for these models are v0. These files can be used in conjunction with minigpt4 ggml models 7B and 13B in minigpt4.cpp Recommended are the Q5_K and Q6_K implementations. If there are any issues, use Q4_1 or Q4_0.

Open maknee/ggml-vicuna-v0-quantized on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.