crumb/flan-t5-large-embed-refinedweb download history
crumb/flan-t5-large-embed-refinedweb is a feature extraction dataset on the Hugging Face Hub. In the last 30 days it was downloaded 617 times (53 in the last 7 days), and 6,291 times in total. It ranks #27,973 among datasets by monthly downloads.
All of the data together is around 81.3GB. It's the last hidden states of 131,072 samples from refinedweb padded/truncated to 512 tokens on the left, fed through google/flan-t5-base. Structure: { "encoding": List, shaped (512, 1024) aka (tokens, d_model), "text": String, the original text that w