Skip to main content
Scour
Discover
Docs
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Web search agent or crawler
🕷 Web search agent or crawler
Specific
Filter Results
Timeframe
Choose a timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
137
posts in
18.0
ms
🔓
tools not foss but free and unique
Zyte Blog Posts
·
6d
6 days ago
How to build your first
Scrapy
extension
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for How to build your first Scrapy extension
🎬
Tools launched with VIDEO demo on Twitter
PPC Land
·
1d
1 day ago
Microsoft Clarity now flags
robots.txt
violations inside
Bot
Analytics
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Microsoft Clarity now flags robots.txt violations inside Bot Analytics
🎬
Tools launched with VIDEO demo on Twitter
Search Engine Journal
·
4h
4 hours ago
Microsoft Clarity Now Flags Bots That Ignore
Robots.txt
via @sejournal, @MattGSouthern
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Microsoft Clarity Now Flags Bots That Ignore Robots.txt via @sejournal, @MattGSouthern
🔓
tools not foss but free and unique
Artificial truth
·
1d
1 day ago
Trivial
anti-crawler
with Caddy
Covers
2 stories
See all stories this covers
including
Caddy – The Ultimate Server with Automatic HTTPS
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Trivial anti-crawler with Caddy
🔓
tools not foss but free and unique
GitHub
·
5d
5 days ago
Show HN: I built a production-ready
web
crawler
in Rust with TTL and anti-dupe
Discussed on
Hacker News
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Show HN: I built a production-ready web crawler in Rust with TTL and anti-dupe
🔓
tools not foss but free and unique
Machine Learning Mastery
·
2d
2 days ago
Building
Browser-Using
AI
Agents
in Python
Covers
3 stories
See all stories this covers
including
Sample Post Title
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Building Browser-Using AI Agents in Python
Less-relevant results
🦄
unique, strange job hiring and vacancy posting
Press Gazette
·
15h
15 hours ago
UK news industry backs law to stop deceptive AI
scraping
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for UK news industry backs law to stop deceptive AI scraping
🔧
tools that don't fit under any heirarchy or classification
toxsec.com
·
3d
3 days ago
Deploy an AI Tar Pit With Nepenthes or AI Labyrinth
Discussed on
DEV
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Deploy an AI Tar Pit With Nepenthes or AI Labyrinth
🦄
unique, strange job hiring and vacancy posting
potatometer.com
·
1d
1 day ago
Show HN: I scanned every YC Spring 2026 startup for what AI
crawlers
see
Discussed on
Hacker News
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Show HN: I scanned every YC Spring 2026 startup for what AI crawlers see
🎬
Tools launched with VIDEO demo on Twitter
A Media Operator
·
1d
1 day ago
Newsletters Get Greater Control Over AI
Crawling
at beehiiv
Covers
Writers are fleeing the Substack Tax
Covered by
Mediagazer
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Newsletters Get Greater Control Over AI Crawling at beehiiv
🔓
tools not foss but free and unique
medium.com
·
3d
3 days ago
How I Detect AI
Bot
Traffic Without Trusting
User-Agent
Strings
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for How I Detect AI Bot Traffic Without Trusting User-Agent Strings
🦄
unique, strange job hiring and vacancy posting
Fortune
·
13h
13 hours ago
Exclusive: Seltz, a startup rebuilding
web
search
for AI
agents
, raises $12.5 million in seed funding
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Exclusive: Seltz, a startup rebuilding web search for AI agents, raises $12.5 million in seed funding
🦄
unique, strange job hiring and vacancy posting
Hacker News
·
6d
6 days ago
Ask HN: Am I being advertised an ARG via
user
agent
logs?
Discussed on
Hacker News
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Ask HN: Am I being advertised an ARG via user agent logs?
🦊
foss tools not on github, but recommended by people
PyCoder’s Weekly
·
1d
1 day ago
PyCoder’s Weekly: Issue #740: Pluggy, ABCs,
Scrapy
Extensions, and More (2026-06-23)
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for PyCoder’s Weekly: Issue #740: Pluggy, ABCs, Scrapy Extensions, and More (2026-06-23)
🔓
tools not foss but free and unique
arXiv
·
1d
1 day ago
Whose
Agent
Are You? Multi-Layer Fingerprinting and Attribution of Autonomous
Web
Agents
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Whose Agent Are You? Multi-Layer Fingerprinting and Attribution of Autonomous Web Agents
🎬
Tools launched with VIDEO demo on Twitter
The Guardian
·
11h
11 hours ago
Venus & Adonis review – Simon Russell Beale narrates cheeky tale of
puppet
passion
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Venus & Adonis review – Simon Russell Beale narrates cheeky tale of puppet passion
🎬
Tools launched with VIDEO demo on Twitter
papermill.io
·
10h
10 hours ago
a document generation engine for AI workflows
Discussed on
Hacker News
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for a document generation engine for AI workflows
🦄
unique, strange job hiring and vacancy posting
Datadog Security Labs
·
3d
3 days ago
Detecting the Klue supply chain attack in Salesforce instances
Covers
2 stories
See all stories this covers
including
An Update on the Recent Klue Security Incident
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Detecting the Klue supply chain attack in Salesforce instances
📢
announcement that led drastic price change in many domains
jguillaumesio.com
·
2d
2 days ago
Cloudflare under the hood: how it works and how attackers try to get around it
Discussed on
DEV
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Cloudflare under the hood: how it works and how attackers try to get around it
🦄
unique, strange job hiring and vacancy posting
hawksley.dev
·
4d
4 days ago
JSON-LD Explained for Personal Websites
Covers
Schema.org
Covered by
tldr.tech
Discussed on
Hacker News
Love
Like
Not for me
Save
See related topics
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for JSON-LD Explained for Personal Websites
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous post
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Discover
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help
Like
Save
Not for me
Report