pengxiang/nap-parallel-packing-demo download history
pengxiang/nap-parallel-packing-demo is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 20 times (5 in the last 7 days), and 186 times in total. It ranks #374,093 among datasets by monthly downloads.
NAP Parallel Packing Demo Parallel-packed pretraining data built from FineWeb sample-10BT. Core idea: blocks within each sample are semantically related but not duplicates; block order is shuffled to break privileged sequential ordering. Format Each line in train.jsonl