floleuerer/strawberry-bench download history

floleuerer/strawberry-bench is a question answering dataset on the Hugging Face Hub. In the last 30 days it was downloaded 15 times (6 in the last 7 days), and 290 times in total. It ranks #450,867 among datasets by monthly downloads.

StrawberryBench Dataset Dataset Description StrawberryBench is a benchmark dataset for evaluating the ability of Large Language Models to count letter occurrences in words and phrases. The task appears trivial but exposes a fundamental limitation: LLMs operate on sub-word token

Open floleuerer/strawberry-bench on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.