Web Crawling Politeness

Feeds to Scour
SubscribedAll
Scoured 300 posts in 46.3 ms

Rate Limits & Anti-Bots in Agentic Scraping

 🌐Web Standards
alterlab.io··DEV

Lars Ingebrigtsen: Web scraping is getting harder all the time

 🌐HTML Parsing

refactor: replace playwright with patchright (#21976) · DIYgod/RSSHub@cfcdc34

 🔐Hardware Security  Content type: Code
github.com·

Gilgamesh: Fragments of a Megalithic Puppet Opera

 🌐HTML Parsing
futurespace.studio·

How to Build a Telegram Bot with Python and AI (2026)

 Async/Await
kalyna.pro··DEV

‘Operation Big Bird’: How CEO saved lives of ‘Sesame Street’ team in Afghanistan after Taliban seized control of wartorn nation

 🌐HTML Parsing  Content type: News
pagesix.com·

Female anarchy across 15 rooms: 80 playwrights unite to stage rageful theatrical piece about Jeffrey Epstein files

 🏛️Politics  Content type: News
the-independent.com·

Linux Netfilter iptables — Re: Question on rate limiting on nftables

 🛡️DDoS Mitigation
spinics.net·

The AI Lobby’s Dirty Tricks (Robert Wright & Tyler Johnston)

 🛡️AI Safety  Content type: News
nonzero.org
·

acunningham-ship-it/veilbrowser: Stealth browser for AI agents — real Chrome over raw CDP, no Playwright/Puppeteer. TypeScript + MCP-native. Passes sannysoft 57/57, bypasses Cloudflare.

 📋MCP  Content type: Code
github.com··Hacker News

Expanding the digital garden

 🕸️Hinternet
gomakethings.com·

cross-platform desktop automation via accessibility trees

 🔗Interoperability

Reflect vs. Playwright: Choosing the right test automation approach

 🎮Deterministic Simulation  Content type: Blog
medium.com
·

How bot detection works (and why your automation gets blocked)

 🌐Web Standards  Content type: Blog
intunedhq.com··Hacker News

AMA crafting CV for UK job market : Is possible to have a CV that's peak for both ATS and a human?

 🎨Design Tokens
ministryoftesting.com·

New comment by denizcakiroglu in "Ask HN: Who wants to be hired? (June 2026)"

 📋MCP  Content type: Code
github.com
··Hacker News

Zero-Stall AI: Building a Self-Managing TDD Pipeline with Autonomous Agents

 🔀JJ
images.unsplash.com··DEV

Orlando Senna, Co-Director of Milestone Brazilian Feature ‘Iracema,’ Dies at 86

 🎆Year End  Content type: News
variety.com·

Half of all web traffic is bots, and a growing share are "vibe-coded" scanners written by a chatbot prompt. Here's the layered webserver defense that stops them...

 🛡️DDoS Mitigation

Broadway revivals and 'Liberation' win big at the Tony Awards

 🎆Year End
ny1.com·

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help