eduagarcia/CrawlPT_dedup download history
eduagarcia/CrawlPT_dedup is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 2,963 times (826 in the last 7 days), and 62,122 times in total. It ranks #8,438 among datasets by monthly downloads.
CrawlPT (deduplicated) CrawlPT is a generic Portuguese corpus extracted from various web pages. This version is deduplicated using MinHash algorithm and Locality Sensitive Hashing, following the approach of Lee et al. (2022). The raw version is also available here. Dataset Details
Models trained on CrawlPT_dedup
4 models list it as training data.
- eduagarcia/RoBERTaLexPT-base 514 downloads in 30 days
- Felladrin/Minueza-2-96M 190 downloads in 30 days
- eduagarcia/RoBERTaCrawlPT-base 105 downloads in 30 days
- tensorblock/Felladrin_Minueza-2-96M-GGUF 30 downloads in 30 days