leeaandrob/mirror-eduagarcia__CrawlPT_dedup download history

leeaandrob/mirror-eduagarcia__CrawlPT_dedup is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 1,686 times (186 in the last 7 days), and 3,082 times in total. It ranks #12,986 among datasets by monthly downloads.

CrawlPT (deduplicated) CrawlPT is a generic Portuguese corpus extracted from various web pages. This version is deduplicated using MinHash algorithm and Locality Sensitive Hashing, following the approach of Lee et al. (2022). The raw version is also available here. Dataset

Open leeaandrob/mirror-eduagarcia__CrawlPT_dedup on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.