kaiokendev/SuperCOT-dataset download history

kaiokendev/SuperCOT-dataset is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 67 times (28 in the last 7 days), and 1,719 times in total. It ranks #151,092 among datasets by monthly downloads.

epochs: 3 learning rate: 3e-4 lora rank: 8 lora alpha: 16 lora dropout: 0.05 for cutoff 1024 13B, otherwise no dropout due to gradient checkpointing masking: none mbatch size: 4 (1 for 30B) batch size: 8 (2 for 30B) val set size: 0.2 sdp implementation: xformers optimizer: AdamW eval strategy: none

Models trained on SuperCOT-dataset

10 models list it as training data.

Open kaiokendev/SuperCOT-dataset on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.