Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Data Pipelines
🔄 Data Pipelines
Specific
Apache Kafka, Airflow, dbt, streaming data
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
53
posts in
5.5
ms
Run an
Apache
Airflow
DAG with Docker Compose and PostgreSQL
📊
data engineering
pyimagesearch.com
·
2d
2 days ago
Actions for Run an Apache Airflow DAG with Docker Compose and PostgreSQL
Franz
🐘
PostgreSQL
flathub.org
·
13h
13 hours ago
Actions for Franz
New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"
🐍
Python
Content type:
PDF
markokolarek.com
·
4d
4 days ago
·
Hacker News
Actions for New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"
Exclusive: MotherDuck adds agentic
data
ingestion
to its cloud analytics service
📊
data engineering
siliconangle.com
·
14h
14 hours ago
Actions for Exclusive: MotherDuck adds agentic data ingestion to its cloud analytics service
Introducing Streamling: Performant and Extensible
Data
Streaming
Framework
📊
data engineering
Content type:
News
streamingdata.tech
·
1d
1 day ago
Actions for Introducing Streamling: Performant and Extensible Data Streaming Framework
Snowflake
Datastream
:
Kafka-native
streaming
in Snowflake
💻
programming
snowflake.com
·
6d
6 days ago
·
Hacker News
Actions for Snowflake Datastream: Kafka-native streaming in Snowflake
Less-relevant results
Introducing Flights: Agent-Native
Ingest
in MotherDuck
📊
data engineering
Content type:
Blog
motherduck.com
·
1d
1 day ago
Actions for Introducing Flights: Agent-Native Ingest in MotherDuck
Choosing the right workflow orchestration service for your use case: Amazon MWAA and AWS Step Functions
📊
data engineering
Content type:
Blog
aws.amazon.com
·
11h
11 hours ago
Actions for Choosing the right workflow orchestration service for your use case: Amazon MWAA and AWS Step Functions
The Hidden Tax Killing Your ML Team’s Velocity – And the Architecture Decision That Fixes It
📊
data engineering
Content type:
Blog
medium.com
·
5d
5 days ago
Actions for The Hidden Tax Killing Your ML Team’s Velocity – And the Architecture Decision That Fixes It
Spring security advisory (AV26-574)
🔐
Cybersecurity
cyber.gc.ca
·
12h
12 hours ago
Actions for Spring security advisory (AV26-574)
benseverndev-oss/goldenmatch: Zero-config entity resolution that scales from a CSV to 100M+ rows on a Ray cluster (verified: 100M deduped in 213s, 0.30 GB driver). Fuzzy + exact + probabilistic dedupe, identity graph, PPRL, LLM boost. Python + full TypeScript port; SQL-native in PostgreSQL & DuckDB; MCP/REST servers,
dbt
+
Airflow
recipes.
🔌
MCP
Content type:
Code
github.com
·
6d
6 days ago
·
Hacker News
Actions for benseverndev-oss/goldenmatch: Zero-config entity resolution that scales from a CSV to 100M+ rows on a Ray cluster (verified: 100M deduped in 213s, 0.30 GB driver). Fuzzy + exact + probabilistic dedupe, identity graph, PPRL, LLM boost. Python + full TypeScript port; SQL-native in PostgreSQL & DuckDB; MCP/REST servers, dbt + Airflow recipes.
Kafka
Share Groups and Parallelizing Consumption - Part 3: Client-local parallelism
🏗
System Design Patterns
Content type:
Blog
jack-vanlightly.com
·
1d
1 day ago
Actions for Kafka Share Groups and Parallelizing Consumption - Part 3: Client-local parallelism
Gene dependency-informed inference of response to targeted cancer therapies
📊
data engineering
Content type:
Academic
nature.com
·
3d
3 days ago
Actions for Gene dependency-informed inference of response to targeted cancer therapies
Presentation: Beyond Prompting: Context Engineering and Memory Management for
AI
Systems at Scale
⚙️
AI Applications
Content type:
News
infoq.com
·
15h
15 hours ago
Actions for Presentation: Beyond Prompting: Context Engineering and Memory Management for AI Systems at Scale
LogNEO: A GPT-Neo Reinforcement Learning Framework for Accurate Real-Time Log Anomaly Detection
🤖
AI
Content type:
Academic
arxiv.org
·
1d
1 day ago
Actions for LogNEO: A GPT-Neo Reinforcement Learning Framework for Accurate Real-Time Log Anomaly Detection
AI
Agents and the Fight for Customer
Data
📊
data engineering
a16z.simplecast.com
·
5d
5 days ago
Actions for AI Agents and the Fight for Customer Data
New comment by thaaff in "Ask HN: Who wants to be hired? (June 2026)"
🤖
Claude Code
Content type:
Discussion
news.ycombinator.com
·
6d
6 days ago
·
Hacker News
Actions for New comment by thaaff in "Ask HN: Who wants to be hired? (June 2026)"
Get reliable answers to business questions with Bits
Data
Analysis
🏗️
Data Platforms
Content type:
Blog
datadoghq.com
·
2d
2 days ago
Actions for Get reliable answers to business questions with Bits Data Analysis
Exploring Smart
Data
opportunities in the transport sector
📊
data engineering
gov.uk
·
5d
5 days ago
Actions for Exploring Smart Data opportunities in the transport sector
Building Scalable Multi-Agent Systems for Enterprises
🏗
System Design Patterns
Content type:
Blog
insights.aethonautomation.com
·
2d
2 days ago
·
DEV
Actions for Building Scalable Multi-Agent Systems for Enterprises
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help