LeroyDyer/conversations download history
LeroyDyer/conversations is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 79 times (4 in the last 7 days), and 9,040 times in total. It ranks #181,244 among datasets by monthly downloads.
from datasets import load_dataset dataset = load_dataset("LeroyDyer/conversations", split = "train[:5000]") EOS_TOKEN = tokenizer.eos_token def formatting_func(example,max_length = 2048): max_seq_length = max_length text = example["Text"] chunks = [text[i:i+max_seq_length] for i in rang
Open LeroyDyer/conversations on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.