commoncrawl/llms.txt download history
commoncrawl/llms.txt is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 285 times (64 in the last 7 days), and 393 times in total. It ranks #51,149 among datasets by monthly downloads.
llms.txt files extracted from the Common Crawl corpus This dataset contains llms.txt files extracted from the Common Crawl corpus. Specifically, we extracted response records matching */llms.txt and */llms-full.txt with status 200 and MIME-type text/plain or text/markdown. What is ll