Zyphra/Zyda-2
Preview • Updated • 83.7k • 99
Interesting Pre-Training Datasets
Note Look at the preprocessing code: https://github.com/Zyphra/Zyda_processing
-
HuggingFaceTB/dclm-edu
Viewer • Updated • 1B • 22.1k • 42 -
HuggingFaceFW/fineweb-edu
Viewer • Updated • 3.5B • 391k • 1.27k -
HuggingFaceTB/stack-edu
Viewer • Updated • 167M • 5.14k • 78 -
HuggingFaceTB/finemath
Viewer • Updated • 48.3M • 33.2k • 378 -
bigcode/the-stack
Viewer • Updated • 471M • 22.3k • 1.06k -
bigcode/the-stack-v2
Updated • 5.75k • 624 -
HuggingFaceTB/smollm-corpus
Viewer • Updated • 237M • 50.3k • 482 -
mlfoundations/dclm-baseline-1.0
Viewer • Updated • 3.02B • 322k • 306 -
HuggingFaceFW/fineweb-2
Viewer • Updated • 4.48B • 92.1k • 862