Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Web Crawling Politeness
🤖 Web Crawling Politeness
Specific
robots.txt, Rate Limiting, Crawl Delay, User Agents
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
300
posts in
46.3
ms
Rate
Limits
& Anti-Bots in
Agentic
Scraping
🌐
Web Standards
alterlab.io
·
2d
2 days ago
·
DEV
Actions for Rate Limits & Anti-Bots in Agentic Scraping
Lars Ingebrigtsen:
Web
scraping
is getting harder all the time
🌐
HTML Parsing
lars.ingebrigtsen.no
·
1d
1 day ago
Actions for Lars Ingebrigtsen: Web scraping is getting harder all the time
refactor: replace
playwright
with patchright (#21976) · DIYgod/RSSHub@cfcdc34
🔐
Hardware Security
Content type:
Code
github.com
·
6d
6 days ago
Actions for refactor: replace playwright with patchright (#21976) · DIYgod/RSSHub@cfcdc34
Gilgamesh: Fragments of a Megalithic
Puppet
Opera
🌐
HTML Parsing
futurespace.studio
·
5d
5 days ago
Actions for Gilgamesh: Fragments of a Megalithic Puppet Opera
How to Build a Telegram Bot with Python and AI (2026)
⏳
Async/Await
kalyna.pro
·
2d
2 days ago
·
DEV
Actions for How to Build a Telegram Bot with Python and AI (2026)
‘Operation Big Bird’: How CEO saved lives of ‘Sesame Street’ team in Afghanistan after Taliban seized control of wartorn nation
🌐
HTML Parsing
Content type:
News
pagesix.com
·
3h
3 hours ago
Actions for ‘Operation Big Bird’: How CEO saved lives of ‘Sesame Street’ team in Afghanistan after Taliban seized control of wartorn nation
Female anarchy across 15 rooms: 80
playwrights
unite to stage rageful theatrical piece about Jeffrey Epstein files
🏛️
Politics
Content type:
News
the-independent.com
·
1d
1 day ago
Actions for Female anarchy across 15 rooms: 80 playwrights unite to stage rageful theatrical piece about Jeffrey Epstein files
Linux Netfilter iptables —
Re
: Question on
rate
limiting
on nftables
🛡️
DDoS Mitigation
spinics.net
·
4d
4 days ago
Actions for Linux Netfilter iptables — Re: Question on rate limiting on nftables
The AI Lobby’s Dirty Tricks (Robert Wright & Tyler Johnston)
🛡️
AI Safety
Content type:
News
nonzero.org
·
1d
1 day ago
Actions for The AI Lobby’s Dirty Tricks (Robert Wright & Tyler Johnston)
acunningham-ship-it/veilbrowser: Stealth browser for AI
agents
— real Chrome over raw CDP, no
Playwright/Puppeteer
. TypeScript + MCP-native. Passes sannysoft 57/57, bypasses Cloudflare.
📋
MCP
Content type:
Code
github.com
·
3d
3 days ago
·
Hacker News
Actions for acunningham-ship-it/veilbrowser: Stealth browser for AI agents — real Chrome over raw CDP, no Playwright/Puppeteer. TypeScript + MCP-native. Passes sannysoft 57/57, bypasses Cloudflare.
Expanding the digital garden
🕸️
Hinternet
gomakethings.com
·
1d
1 day ago
Actions for Expanding the digital garden
cross-platform desktop automation via accessibility trees
🔗
Interoperability
xa11y.dev
·
4d
4 days ago
·
Hacker News
·
Cited by 1 article
Actions for cross-platform desktop automation via accessibility trees
Reflect vs.
Playwright
: Choosing the right test automation approach
🎮
Deterministic Simulation
Content type:
Blog
medium.com
·
1d
1 day ago
Actions for Reflect vs. Playwright: Choosing the right test automation approach
How bot detection works (and why your automation gets blocked)
🌐
Web Standards
Content type:
Blog
intunedhq.com
·
3d
3 days ago
·
Hacker News
Actions for How bot detection works (and why your automation gets blocked)
AMA crafting CV for UK job market : Is possible to have a CV that's peak for both ATS and a human?
🎨
Design Tokens
ministryoftesting.com
·
5d
5 days ago
Actions for AMA crafting CV for UK job market : Is possible to have a CV that's peak for both ATS and a human?
New comment by denizcakiroglu in "Ask HN: Who wants to be hired? (June 2026)"
📋
MCP
Content type:
Code
github.com
·
1d
1 day ago
·
Hacker News
Actions for New comment by denizcakiroglu in "Ask HN: Who wants to be hired? (June 2026)"
Zero-Stall AI: Building a
Self-Managing
TDD Pipeline with Autonomous
Agents
🔀
JJ
images.unsplash.com
·
4d
4 days ago
·
DEV
Actions for Zero-Stall AI: Building a Self-Managing TDD Pipeline with Autonomous Agents
Orlando Senna, Co-Director of Milestone Brazilian Feature ‘Iracema,’ Dies at 86
🎆
Year End
Content type:
News
variety.com
·
1d
1 day ago
Actions for Orlando Senna, Co-Director of Milestone Brazilian Feature ‘Iracema,’ Dies at 86
Half of all
web
traffic is bots, and a growing share are "vibe-coded" scanners written by a chatbot prompt. Here's the layered webserver defense that stops them...
🛡️
DDoS Mitigation
deb.myguard.nl
·
6d
6 days ago
·
r/linuxadmin
Actions for Half of all web traffic is bots, and a growing share are "vibe-coded" scanners written by a chatbot prompt. Here's the layered webserver defense that stops them...
Broadway revivals and 'Liberation' win big at the Tony Awards
🎆
Year End
ny1.com
·
5d
5 days ago
Actions for Broadway revivals and 'Liberation' win big at the Tony Awards
« Page 1
·
Page 3 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help