chainyo/natural-instructions-tokenized download history

chainyo/natural-instructions-tokenized is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 1,332 times (298 in the last 7 days), and 12,401 times in total. It ranks #15,593 among datasets by monthly downloads.

Dataset Card for "natural-instructions-tokenized" Here is the script used to tokenize the dataset: import multiprocessing from typing import Union from datasets import DatasetDict, load_dataset from transformers import LlamaTokenizer # Find your available cores num_cores = multiprocess

Open chainyo/natural-instructions-tokenized on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.