crumb/flan-t5-base-embed-refinedweb download history
crumb/flan-t5-base-embed-refinedweb is a feature extraction dataset on the Hugging Face Hub. In the last 30 days it was downloaded 288 times (11 in the last 7 days), and 2,629 times in total. It ranks #50,727 among datasets by monthly downloads.
All of the data together is around 61GB. It's the last hidden states of 131,072 samples from refinedweb padded/truncated to 512 tokens on the left, fed through google/flan-t5-base. Structure: { "encoding": List, shaped (512, 768) aka (tokens, d_model), "text": String, the original text that was
Open crumb/flan-t5-base-embed-refinedweb on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.