if001/oasst1_ja_ppl download history
if001/oasst1_ja_ppl is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 27 times (9 in the last 7 days), and 709 times in total. It ranks #297,781 among datasets by monthly downloads.
** 以下のrepositoryのforkです。 ** https://huggingface.co/datasets/kunishou/oasst1-89k-ja instructionとinput、outputにまとめ、kenllmでperplexityのスコアが付与してあります。 perplexityの計算に用いたtokenizerはこちら https://huggingface.co/if001/sentencepiece_ja instruction_ppl: instructionのみのperplexity output_ppl: outputのみのperplexity ful