Beetle-Data/en-for-ja-2B-pretok download history
Beetle-Data/en-for-ja-2B-pretok is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 257 times (42 in the last 7 days), and 670 times in total. It ranks #55,350 among datasets by monthly downloads.
Beetle-Data/en-for-ja-2B-pretok Pretokenized chunks (input_ids = 513-token packed sequences, no cross-document bleeding). Sharded incrementally; the marker data/_finalized.json is committed once all parts are uploaded.
Open Beetle-Data/en-for-ja-2B-pretok on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.