lenML/oaast_rm_full_jieba download history

lenML/oaast_rm_full_jieba is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 66 times (17 in the last 7 days), and 1,023 times in total. It ranks #209,436 among datasets by monthly downloads.

尝试解决"llm repetition problem",使用分词模型对oaast语料进行“结巴化”数据增强,提供更强的重复内容拒绝效果。 Attempts to solve the "llm repetition problem" by using a segmentation model to enhance the oaast corpus with "stuttering" data to provide stronger rejection of duplicate content. 其次,还过滤掉了所有自我认知的微调样本。 Second, it also filters out a

Open lenML/oaast_rm_full_jieba on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.