Beetle-Data/tl-2B-pretok download history
Beetle-Data/tl-2B-pretok is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 1,286 times (49 in the last 7 days), and 4,001 times in total. It ranks #16,028 among datasets by monthly downloads.
Beetle-Data/tl-2B-pretok Pretokenized chunks (input_ids = 513-token packed sequences, no cross-document bleeding). Sharded incrementally; the marker data/_finalized.json is committed once all parts are uploaded.
Open Beetle-Data/tl-2B-pretok on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.