marin-community/token-counts download history
marin-community/token-counts is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 1,050 times (228 in the last 7 days), and 2,650 times in total. It ranks #18,650 among datasets by monthly downloads.
Marin Token Counts Token counts for all datasets used in Marin pretraining runs. Schema Column Type Description dataset string Dataset identifier marin_tokens int Number of tokens after tokenization category string Content domain (web, code, math, academi