Skip to main content
Scour
Discover
Docs
Login
Sign Up
Discover
About
Docs
Changelog
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Common Crawl
commoncrawl.org
The latest news and announcements from Common Crawl
Common Crawl
·
5d
5 days ago
CommonLID Update: New Tools, Growing Impact
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for CommonLID Update: New Tools, Growing Impact
Common Crawl
·
1w
1 week ago
Common Crawl Foundation at IIPC-WAC 2026
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Common Crawl Foundation at IIPC-WAC 2026
Common Crawl
·
2w
2 weeks ago
Blog - The Columnar Index Is Now the URL Index
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Blog - The Columnar Index Is Now the URL Index
Common Crawl
·
2w
2 weeks ago
Blog - Introducing the AI Visibility Audit
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Blog - Introducing the AI Visibility Audit
Common Crawl
·
3w
3 weeks ago
Blog - Host- and Domain-Level Web Graphs March, April, and May 2026
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Blog - Host- and Domain-Level Web Graphs March, April, and May 2026
Common Crawl
·
3w
3 weeks ago
Blog - May 2026 Crawl Archive Now Available
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Blog - May 2026 Crawl Archive Now Available
Common Crawl
·
4w
4 weeks ago
Blog - April 2026 Crawl Archive Now Available in a Hugging Face Storage Bucket
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Blog - April 2026 Crawl Archive Now Available in a Hugging Face Storage Bucket
Common Crawl
·
6w
6 weeks ago
You can now build directly on Common Crawl from the browser
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for You can now build directly on Common Crawl from the browser
Common Crawl
·
7w
7 weeks ago
Blog - Host- and Domain-Level Web Graphs February, March, and April 2026
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Blog - Host- and Domain-Level Web Graphs February, March, and April 2026
Common Crawl
·
7w
7 weeks ago
Blog - April 2026 Crawl Archive Now Available
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Blog - April 2026 Crawl Archive Now Available
Common Crawl
·
10w
10 weeks ago
April 2026 Common Crawl Newsletter
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for April 2026 Common Crawl Newsletter
Common Crawl
·
11w
11 weeks ago
Announcing a Change to Common Crawl Dataset Size Reporting
Discussed on
Hacker News
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Announcing a Change to Common Crawl Dataset Size Reporting
Common Crawl
·
12w
12 weeks ago
Blog - Host- and Domain-Level Web Graphs January, February, and March 2026
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Blog - Host- and Domain-Level Web Graphs January, February, and March 2026
Common Crawl
·
13w
13 weeks ago
Blog - March 2026 Crawl Archive Now Available
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Blog - March 2026 Crawl Archive Now Available
Common Crawl
·
13w
13 weeks ago
Blog - IPv6 Adoption Across the Top 100K Web Hosts
Discussed on
Hacker News
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Blog - IPv6 Adoption Across the Top 100K Web Hosts
Common Crawl
·
15w
15 weeks ago
Blog - Web Graph Statistics Gets a Proper Upgrade
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Blog - Web Graph Statistics Gets a Proper Upgrade
Common Crawl
·
15w
15 weeks ago
Blog - Measuring Web Accessibility from Crawl Archives
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Blog - Measuring Web Accessibility from Crawl Archives
Common Crawl
·
16w
16 weeks ago
Announcing the Whirlwind Tour of Common Crawl's Datasets Using Java
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Announcing the Whirlwind Tour of Common Crawl's Datasets Using Java
Common Crawl
·
16w
16 weeks ago
Blog - Host- and Domain-Level Web Graphs December 2025 and January/February 2026
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Blog - Host- and Domain-Level Web Graphs December 2025 and January/February 2026
Common Crawl
·
16w
16 weeks ago
Blog - Introducing the New Examples & Resources Browser
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Blog - Introducing the New Examples & Resources Browser
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous post
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Discover
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help
Like
Save
Not for me
Report