ptrdvn/opus_lid_filtered download history

ptrdvn/opus_lid_filtered is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 704 times (422 in the last 7 days), and 2,645 times in total. It ranks #36,100 among datasets by monthly downloads.

What this dataset is This dataset is a filtered version of the MaLA-LM/mala-opus-dedup-2410 dataset after having all texts with incorrect language codes filtered out of it. To do this, we use the cis-lmu/glotlid language ID model, predict the top probability language for both texts (s

Open ptrdvn/opus_lid_filtered on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.