nwdxlgzs/sentence-pt-enzh-tr download history

nwdxlgzs/sentence-pt-enzh-tr is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 825 times (69 in the last 7 days), and 3,192 times in total. It ranks #22,416 among datasets by monthly downloads.

原数据集:https://huggingface.co/datasets/TigerResearch/pretrain_en、https://huggingface.co/datasets/TigerResearch/pretrain_zh 这个数据集就是把数据切断成句了,没想到行数居然接近1:1哦 中文数据总行数: 434818374 英文数据总行数: 450173542 中文比例: 0.4913, 英文比例: 0.5087 merge是中英混合后的版本(每个文件都有中英文且尽可能保持一样的比例后内部打乱,混训的直接按量节选即可),处理程序遗漏了最后几批数据,导致只有210个4M条的文件

Open nwdxlgzs/sentence-pt-enzh-tr on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.