🌐 WARC Mining

Web Archive Analysis, Internet Archaeology, Crawl Data, Historical Web

Effective Web Scraping with Python: Building a Robust Data Pipeline for Price Monitoring
dev.to·14h·
Discuss: DEV
🕵️Feed Discovery
Offensive OSINT s05e10 - Interactive investigative stories part 1
offensiveosint.io·2d
🌐WARC Forensics
Efficient and accurate search in petabase-scale sequence repositories
nature.com·2d·
Discuss: Hacker News
🔄Burrows-Wheeler
Archaeologists Found a 2,500-Year-Old Tomb Filled with Treasure—and Completely Untouched
popularmechanics.com·9h
🗝️Paleocryptography
Dark Web Monitoring Against Invisible Cyber Threats
securityscorecard.com·7h
🎯Threat Hunting
Homomorphism Problems in Graph Databases and Automatic Structures
arxiv.org·19h
🔗Graph Isomorphism
Welcome to LIL’s Data.gov Archive Search
lil.law.harvard.edu·3h
💾Data Preservation
How the Growth of AI May Drive a Fundamental Step-Change in the Domain Name Landscape
circleid.com·1d
📡DNS Archaeology
2025-10-10: An Internship Experience With the Internet Archive as a Google Summer of Code Contributor
ws-dl.blogspot.com·1h·
Discuss: ws-dl.blogspot.com
🔓Open Source Software
IREN: A 10x Growth Story Following A Textbook Pivot From Bitcoin Mining To AI Cloud
seekingalpha.com·13h
📡Feed Archaeology
It takes a Kraken to scan billions of source files
softwareheritage.org·2d
🏠Homelab Archaeology
Complex networks-based anomaly detection for financial transactions in anti-money laundering
sciencedirect.com·2d
🧬PostgreSQL Forensics
An enough week
blog.mitrichev.ch·1d·
Discuss: blog.mitrichev.ch
📈Linear programming
YouTube gets ~5% CTR lift on Shorts by replacing embedding tables with Semantic IDs
shaped.ai·23h
📊Feed Optimization
How I found an unauthenticated goldmine of PII
infosecwriteups.com·12h
🔓Hacking
Step Into the Dutch Web of the Past: Discover “Websites van Nederland” at the KB Until “Night at the Museum” on 11 October
internetarchive.eu·1d
🏺Media Archaeology
I built a translator for spatial thinking (because I can't interview in Python)
graemefawcett.ca·4h·
Discuss: Hacker News
🔗Concatenative Programming
New Articles: Journal of Contemporary Archival Studies
archivespublishing.com·1d
⚖️Archive Ethics
Show HN: Rebuilt Bible search app to run 100% client-side with Transformers.js
biblos.app·2h·
Discuss: Hacker News
📜Binary Philology
10 Data + AI Observations for Fall 2025
towardsdatascience.com·9h
🌊Stream Processing