ZhuofengLi/fineweb-edu-pretokenized-llama3-100b download history

ZhuofengLi/fineweb-edu-pretokenized-llama3-100b is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 212 times (124 in the last 7 days), and 1,393 times in total. It ranks #64,835 among datasets by monthly downloads.

FineWeb-Edu Pretokenized with Llama 3.1 (100B) This repository contains the sample/100BT subset of FineWeb-Edu, pretokenized for Megatron-LM-style training with meta-llama/Meta-Llama-3.1-8B. It is a derived, pretokenized version of the upstream data, not an official Hugging Face FineW

Open ZhuofengLi/fineweb-edu-pretokenized-llama3-100b on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.