lightblue/rag_multilingual_training_negatives download history

lightblue/rag_multilingual_training_negatives is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 1,598 times (155 in the last 7 days), and 16,048 times in total. It ranks #13,487 among datasets by monthly downloads.

How this dataset was made We trained on chunks sourced from the documents in MADLAD-400 dataset that had been evaluated to contain a higher amount of educational information according to a state-of-the-art LLM. We took chunks of size 250 tokens, 500 tokens, and 1000 tokens randomly for ea

Open lightblue/rag_multilingual_training_negatives on Hugging Face