lorinma/Slim-Moss003sft-zh download history

lorinma/Slim-Moss003sft-zh is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 19 times (5 in the last 7 days), and 585 times in total. It ranks #388,347 among datasets by monthly downloads.

因为原生的Moss003数量太大，所以进行了简单的去重。 去重方法大致为，只选择中文的对话，使用bert-base-chinese将第一个问题转换为embedding，使用类knn的方法抽取了1万条。并转换成了sharegpt格式。

Open lorinma/Slim-Moss003sft-zh on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.