Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

Common Crawl Foundation

Team
non-profit
Verified
https://commoncrawl.org
commoncrawl
commoncrawl
Activity Feed

AI & ML interests

Crawled data and metadata

Recent Activity

malteos  updated a bucket 5 days ago
commoncrawl/commoncrawl
catherinearnett  authored a paper 7 days ago
CommonLID: Re-evaluating State-of-the-Art Language Identification Performance on Web Data
catherinearnett  authored a paper 7 days ago
Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMs
View all activity

Thom Vaughan's profile picturePedro Ortiz Suarez's profile picturePaul Lazar's profile pictureGreg Lindahl's profile pictureFord H's profile pictureJen English's profile pictureSebastian Nagel's profile pictureLaurie Burchell's profile pictureHande Celikkanat's profile picturemalteos's profile pictureThijs Dalhuijsen's profile pictureLuca's profile pictureCatherine Arnett's profile picture

commoncrawl 's datasets 8

commoncrawl/commonlid-results

Preview • Updated 13 days ago • 533

commoncrawl/statistics

Viewer • Updated 22 days ago • 626k • 536 • 26

commoncrawl/citations

Viewer • Updated Apr 2 • 9.18k • 66 • 2

commoncrawl/CommonLID

Viewer • Updated Feb 10 • 373k • 236 • 52

commoncrawl/gneissweb-annotation-host-testing-v1

Viewer • Updated Dec 11, 2025 • 617M • 85

commoncrawl/gneissweb-annotation-url-testing-v1

Viewer • Updated Dec 10, 2025 • 11.5B • 5.13k

commoncrawl/host-index-testing-v2

Preview • Updated Nov 10, 2025 • 28.4k

commoncrawl/eot2024_hostlevel_logs

Viewer • Updated Oct 9, 2024 • 271k • 8 • 1
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs