Phase-Technologies/forge-3b-pretrain-data download history

Phase-Technologies/forge-3b-pretrain-data is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 2,441 times (790 in the last 7 days), and 8,103 times in total. It ranks #9,719 among datasets by monthly downloads.

FORGE-3B Pretraining Data Tokenized and packed pretraining data for the FORGE-3B language model. Stats Total tokens: 51.4070B Domains: 10/10 Sequence length: 2048 tokens Format: .npy shards of shape (N, 2048) with dtype uint32 Tokenizer: CRAYON (xerv-crayon, standard p

Open Phase-Technologies/forge-3b-pretrain-data on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.