0xDing/wikipedia-cn-20230720-filtered download history

0xDing/wikipedia-cn-20230720-filtered is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 2,828 times (916 in the last 7 days), and 39,345 times in total. It ranks #8,758 among datasets by monthly downloads.

本数据集基于中文维基2023年7月20日的dump存档。作为一项以数据为中心的工作,本数据集仅保留了 254,547条 质量较高的词条内容。具体而言: 过滤了Template, Category, Wikipedia, File, Topic, Portal, MediaWiki, Draft, Help等特殊类型的词条 使用启发式的方法和自有的NLU模型过滤了一部分质量较低的词条 过滤了一部分内容较为敏感或存在争议性的词条。 进行了简繁转换和习惯用词转换,确保符合中国大陆地区的习惯用词。 This dataset is based on the Chinese Wikipedia dum

Models trained on wikipedia-cn-20230720-filtered

2 models list it as training data.

Open 0xDing/wikipedia-cn-20230720-filtered on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.