if001/oasst1_ja_ppl download history
if001/oasst1_ja_ppl is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 21 times (0 in the last 7 days), and 746 times in total. It ranks #466,207 among datasets by monthly downloads.
** 以下のrepositoryのforkです。 ** https://huggingface.co/datasets/kunishou/oasst1-89k-ja instructionとinput、outputにまとめ、kenllmでperplexityのスコアが付与してあります。 perplexityの計算に用いたtokenizerはこちら https://huggingface.co/if001/sentencepiece_ja instruction_ppl: instructionのみのperplexity output_ppl: outputのみのperplexity ful
Open if001/oasst1_ja_ppl on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.