HuggingFaceFW/finephrase-rephrased
6.94 TB
AI & ML interests
We release large pre-training datasets to accelerate open LLM development. Part of the Hugging Face Science team (hf.co/science)
Recent Activity
Papers
FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language
The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale
Intrinsic quality evaluation of 3000 examples using LLM-as-judge
👍 1
5
#5 opened 26 days ago
by 
ratishsp
joelniklaus
published a
bucket 1 day ago
joelniklaus
updated a
bucket 5 days ago
joelniklaus
updated a
Space 7 days ago
thomwolf
updated a
dataset 11 days ago
joelniklaus
updated a
dataset 14 days ago
clefourrier
authored a
paper about 1 month ago
error
2
#1 opened about 1 month ago
by 
georgebassemfouad
joelniklaus
published a
Space about 1 month ago
joelniklaus
updated 11
datasets about 1 month ago
HuggingFaceFW/finepdfs_edu_50BT-dclm_30BT-fineweb_edu_20BT-shuffled
Viewer • Updated • 56.1M • 4.12k
HuggingFaceFW/finepdfs_edu_50BT-dclm_30BT-fineweb_edu_20BT
Viewer • Updated • 56.1M • 4.33k
HuggingFaceFW/finepdfs_50BT-dclm_30BT-fineweb_edu_20BT-shuffled
Viewer • Updated • 62.1M • 2.3k • 3
HuggingFaceFW/finepdfs_50BT-dclm_30BT-fineweb_edu_20BT
Viewer • Updated • 62.1M • 5.48k • 1
HuggingFaceFW/finepdfs_edu_100BT-shuffled
Viewer • Updated • 17.8M • 1.55k
HuggingFaceFW/finepdfs_edu_100BT
Viewer • Updated • 17.8M • 2.13k
HuggingFaceFW/finepdfs_100BT-shuffled
Viewer • Updated • 14.6M • 437
HuggingFaceFW/finepdfs_100BT
Viewer • Updated • 29.9M • 1.28k
HuggingFaceFW/fineweb_edu_100BT-shuffled
Viewer • Updated • 102M • 482
HuggingFaceFW/fineweb_edu_100BT
Preview • Updated • 4.21k
HuggingFaceFW/fineweb_100BT-shuffled
Viewer • Updated • 161M • 303