🤖 Web Crawling Politeness - emschwartz · Scour

Efficient Crawling for Scalable Web Data Acquisition (Extended Version)

arxiv.org·15h

🕷️Web Crawling

Introducing Markdown for Agents

blog.cloudflare.com·1d·

Discuss: Hacker News, Hacker News, Hacker News

🕷️Web Crawling

Hot bots: AI agents create surprise dating accounts for humans

techxplore.com·12h

💳Content Monetization

Terms of Service

felix.dognebula.com·1d·

Discuss: Hacker News

🕷️Web Crawling

The Small Web is Tricky to Find

matduggan.com·7h

🕷️Web Crawling

Google releases preview of WebMCP – how AI agents interact with websites

searchengineland.com·2d

💳Content Monetization

Factional Drift: We cluster into factions online

idiallo.com·8h

🛡️Content Moderation

Stop talking to AI, let them talk to each other: The A2A protocol

europedigital.cloud·1d

A Conceptual Framework for Exploration Hacking

lesswrong.com·1d

🕳LLM Vulnerabilities

The Two-slice Team

kill-the-newsletter.com·4h

s3cur3/browsey_http: A browser-imitating HTTP client for scraping websites that resist bot traffic

github.com·1d

🕷️Web Crawling

LASER: An Efficient Target-Aware Segmented Attention Framework for End-to-End Long Sequence Modeling

arxiv.org·15h

📄Semantic Chunking

The Agentic Pivot: Architectural Transformation of App-to-App Communications in the Fintech Tech…

pub.towardsai.net·4h

💰Web Monetization API

Humanizing vs. Human

blog.gorewood.games·8h

Search Engine Tooling

joshbeckman.org·2d

📊Search Ranking

Skip the Tips 2026-02-13 18:44:05.197291+01

flutterby.com·2h

🔗 Keeping feature creep at bay

yellowduck.be·6h

📇Indexing Strategies

My Pleasure: More than a Catchphrase

hugyourcactus.com·21h

🔤Tokenization

Index Compression, Query Execution Improvements

marginalia.nu·20h

📇Index Selection

Links 13/02/2026: SUSE Uses Microsoft Internally, MElon's Company Helps Turn Epstein Files Into Child Abuse (After the Pornography Scandals)

techrights.org·10h

🪄Prompt Engineering

Loading more...