Web Crawling Politeness

Feeds to Scour
SubscribedAll
Scoured 302 posts in 27.6 ms

feat(utils/playwright): add PLAYWRIGHT_CDP_ENDPOINT support (#22212)

 📄File Formats  Content type: Code
github.com
·

I automated my Gumroad product screenshots with Playwright

 🖥️Server-Side Rendering
remix410.gumroad.com··DEV

I used Codex to test my SaaS like a real user, and it caught issues I'd been ignoring for weeks

 💻Coding Agents
xda-developers.com·

Agentics: Using Coding Agents for Browser Automation

 💻Coding Agents  Content type: News

I reworked our robots.txt parsing to be much better. In the process, I looked at a bunch of website’s robots.txt files… Blah. No wonder the Inte...

 🏛️Internet Archive
manton.org·

How to Scrape E-Commerce Sites for AI Agents Using Playwright and LLMs

 Async/Await
shop.example.com··DEV

Defect Tolerance in Trigonal Selenium Photovoltaics

 💎EUV Lithography  Content type: Academic
arxiv.org·
Less-relevant results

"Gorgons" at Yellow Tree Theatre

 🔍Paradedb
cherryandspoon.com·

Playwright For Full-Stack Testing: Auth, Fixtures, Mocking, Snapshots, And Parallel Runs Without The Flake

 💾Databases  Content type: Tutorial
nazarboyko.com··DEV

How Microsoft Foundry Runs Your Open Source Agents Without a Rewrite

 🔗Interoperability  Content type: Blog
blog.devops.dev
·

FREE LIVE DEMO SESSION — Selenium with Java

 🎯Cursor IDE  Content type: Blog
medium.com
·

AMA about Crafting CVs for the UK Job Market : still using the old trick of including a black sheet with keywords using a white font colour?

 👨‍💻Software development practices
ministryoftesting.com·

The robots have come for our Muppets.

 🌐HTML Parsing  Content type: News
theverge.com
·

New comment by denizcakiroglu in "Ask HN: Who wants to be hired? (June 2026)"

 📋MCP  Content type: Code
github.com
··Hacker News

Female anarchy across 15 rooms: 80 playwrights unite to stage rageful theatrical piece about Jeffrey Epstein files

 🏛️Politics  Content type: News
the-independent.com·

Discovery of IPv6 Router Addresses Using Subnet-Router Anycast

 🔐Tailscale
labs.ripe.net·

Clarifying the interplay between host and gut microbiota in selenium metabolism

 🔬Maillard Reaction
medicalxpress.com·

We Had a World review – a playwright torn between his warring mother and grandmother

 🎛️Tokio Internals  Content type: News
theguardian.com·

How I Use Claude + Playwright to Automate CAPTCHA-Heavy Signups (Real Code)

 💾Databases
payhip.com··DEV

‘Anger burns off every bit of it’: the furious guerrilla-art response to the Epstein files

 🔤Type Design  Content type: News
theguardian.com·

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help