emozilla/pg_books-tokenized-bos-eos-chunked-65536 download history

emozilla/pg_books-tokenized-bos-eos-chunked-65536 is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 1,378 times (241 in the last 7 days), and 39,833 times in total. It ranks #15,179 among datasets by monthly downloads.

Dataset Card for "pg_books-tokenized-bos-eos-chunked-65536" The pg19 dataset tokenized under LLaMA into 64k chunks, bookended with BOS and EOS

Open emozilla/pg_books-tokenized-bos-eos-chunked-65536 on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.