crumb/flan-t5-small-embed-refinedweb download history
crumb/flan-t5-small-embed-refinedweb is a feature extraction dataset on the Hugging Face Hub. In the last 30 days it was downloaded 191 times (7 in the last 7 days), and 4,384 times in total. It ranks #70,088 among datasets by monthly downloads.
All of the data together is around 41GB. It's the last hidden states of 131,072 samples from refinedweb padded/truncated to 512 tokens on the left, fed through google/flan-t5-small. Structure: { "encoding": List, shaped (512, 512) aka (tokens, d_model), "text": String, the original text that was