Web Crawling Politeness

Feeds to Scour
SubscribedAll
Scoured 298 posts in 32.9 ms

feat(utils/playwright): add PLAYWRIGHT_CDP_ENDPOINT support (#22212)

 📄File Formats  Content type: Code
github.com
·

I automated my Gumroad product screenshots with Playwright

 🖥️Server-Side Rendering
remix410.gumroad.com··DEV

I reworked our robots.txt parsing to be much better. In the process, I looked at a bunch of website’s robots.txt files… Blah. No wonder the Inte...

 🏛️Internet Archive
manton.org·

Agentics: Using Coding Agents for Browser Automation

 💻Coding Agents  Content type: News

How to Scrape E-Commerce Sites for AI Agents Using Playwright and LLMs

 Async/Await
shop.example.com··DEV

Defect Tolerance in Trigonal Selenium Photovoltaics

 💎EUV Lithography  Content type: Academic
arxiv.org·
Less-relevant results

Generate OG / social-preview images on the fly (screenshots-as-a-service)

 🚀Astral
rapidapi.com··DEV

"Gorgons" at Yellow Tree Theatre

 🔍Paradedb
cherryandspoon.com·

Playwright For Full-Stack Testing: Auth, Fixtures, Mocking, Snapshots, And Parallel Runs Without The Flake

 💾Databases  Content type: Tutorial
nazarboyko.com··DEV

I used Codex to test my SaaS like a real user, and it caught issues I'd been ignoring for weeks

 💻Coding Agents
xda-developers.com·

How Microsoft Foundry Runs Your Open Source Agents Without a Rewrite

 🔗Interoperability  Content type: Blog
blog.devops.dev
·

AMA about Crafting CVs for the UK Job Market : still using the old trick of including a black sheet with keywords using a white font colour?

 👨‍💻Software development practices
ministryoftesting.com·

FREE LIVE DEMO SESSION — Selenium with Java

 🎯Cursor IDE  Content type: Blog
medium.com
·

Run Vitest and Playwright scenarios from qa suite (#92606) · openclaw/openclaw@561b293

 🧠Obsidian  Content type: Code  Content type: Release
github.com·

The robots have come for our Muppets.

 🌐HTML Parsing  Content type: News
theverge.com
·

Clarifying the interplay between host and gut microbiota in selenium metabolism

 🔬Maillard Reaction
medicalxpress.com·

Discovery of IPv6 Router Addresses Using Subnet-Router Anycast

 🔐Tailscale
labs.ripe.net·

How I Use Claude + Playwright to Automate CAPTCHA-Heavy Signups (Real Code)

 💾Databases
payhip.com··DEV

We Had a World review – a playwright torn between his warring mother and grandmother

 🎛️Tokio Internals  Content type: News
theguardian.com·

Linux Netfilter iptables — Question on rate limiting on nftables

 🛡️Privacy
spinics.net·

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help