0xDing/wikipedia-cn-20230720-filtered download history
0xDing/wikipedia-cn-20230720-filtered is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 2,828 times (916 in the last 7 days), and 39,345 times in total. It ranks #8,758 among datasets by monthly downloads.
本数据集基于中文维基2023年7月20日的dump存档。作为一项以数据为中心的工作,本数据集仅保留了 254,547条 质量较高的词条内容。具体而言: 过滤了Template, Category, Wikipedia, File, Topic, Portal, MediaWiki, Draft, Help等特殊类型的词条 使用启发式的方法和自有的NLU模型过滤了一部分质量较低的词条 过滤了一部分内容较为敏感或存在争议性的词条。 进行了简繁转换和习惯用词转换,确保符合中国大陆地区的习惯用词。 This dataset is based on the Chinese Wikipedia dum
Models trained on wikipedia-cn-20230720-filtered
2 models list it as training data.
- Q1ngMang/LFM2.5-350M-PT-zh_CN 58 downloads in 30 days
- Q1ngMang/LFM2.5-230M-PT-zh_CN 13 downloads in 30 days
Open 0xDing/wikipedia-cn-20230720-filtered on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.