The Synthetic Data Playbook: Generating Trillions of the Finest Tokens
📝
194
Explore synthetic data experiments as an interactive bookshelf
AI & ML interests
We release large pre-training datasets to accelerate open LLM development. Part of the Hugging Face Science team (hf.co/science)
Recent Activity
View all activity
Papers
FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language
The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale
joelniklaus
updated a
Space about 12 hours ago
joelniklaus
updated a
dataset 4 days ago
clefourrier
authored a
paper 6 days ago
error
2
#1 opened 11 days ago
by 
georgebassemfouad
joelniklaus
published a
Space 12 days ago
joelniklaus
updated 14
datasets 17 days ago
HuggingFaceFW/finepdfs_edu_50BT-dclm_30BT-fineweb_edu_20BT-shuffled
Viewer • Updated • 56.1M • 894
HuggingFaceFW/finepdfs_edu_50BT-dclm_30BT-fineweb_edu_20BT
Viewer • Updated • 56.1M • 51.5k
HuggingFaceFW/finepdfs_50BT-dclm_30BT-fineweb_edu_20BT-shuffled
Viewer • Updated • 62.1M • 947 • 3
HuggingFaceFW/finepdfs_50BT-dclm_30BT-fineweb_edu_20BT
Viewer • Updated • 62.1M • 37.2k • 1
HuggingFaceFW/finepdfs_edu_100BT-shuffled
Viewer • Updated • 17.8M • 990
HuggingFaceFW/finepdfs_edu_100BT
Viewer • Updated • 17.8M • 5.42k
HuggingFaceFW/finepdfs_100BT-shuffled
Viewer • Updated • 14.6M • 791
HuggingFaceFW/finepdfs_100BT
Viewer • Updated • 29.9M • 7.25k
HuggingFaceFW/fineweb_edu_100BT-shuffled
Viewer • Updated • 102M • 699
HuggingFaceFW/fineweb_edu_100BT
Preview • Updated • 339
HuggingFaceFW/fineweb_100BT-shuffled
Viewer • Updated • 161M • 434
HuggingFaceFW/fineweb_100BT
Viewer • Updated • 161M • 910
HuggingFaceFW/dclm_100BT-shuffled
Viewer • Updated • 89.3M • 854 • 1
HuggingFaceFW/dclm_100BT
Viewer • Updated • 89.3M • 608
joelniklaus
updated a
collection about 1 month ago