The Smol Training Playbook
📚
3.22k
The secrets to building world-class LLMs
alkinun
AtAndDev
AI & ML interests
LLMs, Alignment, Merging, Unsloth, DPO, SFT, ORPO, SPIN..
Recent Activity
liked a Space about 5 hours ago
HuggingFaceTB/smol-training-playbook liked a dataset about 10 hours ago
allenai/peS2o liked a dataset about 10 hours ago
OpenCoder-LLM/opc-fineweb-code-corpusOrganizations
liked a
Space about 5 hours ago
liked 13
datasets about 10 hours ago
allenai/peS2o
Updated • 11.8k • 197
OpenCoder-LLM/opc-fineweb-code-corpus
Viewer • Updated • 101M • 3.74k • 54
mlfoundations/dclm-baseline-1.0-parquet
Viewer • Updated • 2.73B • 27.2k • 53
HuggingFaceTB/stack-edu
Viewer • Updated • 167M • 3.63k • 75
OpenCoder-LLM/opc-annealing-corpus
Viewer • Updated • 15.6M • 1.22k • 44
HuggingFaceTB/smollm-corpus
Viewer • Updated • 237M • 32.3k • 468
HuggingFaceFW/finephrase
Viewer • Updated • 1.02B • 419k • 130
incredible45/Gutenberg-BookCorpus-Cleaned-Data-English
Viewer • Updated • 51.4k • 365 • 15
HuggingFaceFW/finepdfs-edu
Viewer • Updated • 49.5M • 10.3k • 91
mlfoundations/dclm-baseline-1.0
Preview • Updated • 502k • 290
HuggingFaceTB/finemath
Viewer • Updated • 48.3M • 22.8k • 368
bigcode/starcoder2data-extras
Viewer • Updated • 51.6M • 3.08k • 13
openbmb/Ultra-FineWeb-L3
Viewer • Updated • 1.06B • 85.9k • 304
liked 2
datasets about 11 hours ago
liked a
dataset about 12 hours ago
liked a
model about 19 hours ago
updated a
model about 19 hours ago
published a
model about 19 hours ago