Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Data Engineering
🛠️ Data Engineering
data pipelines, ETL, data lakes, Apache Spark
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
293
posts in
15.3
ms
Choosing the right workflow orchestration service for your use case: Amazon MWAA and AWS Step Functions
☁️
Cloud Computing
Content type:
Blog
aws.amazon.com
·
8h
8 hours ago
Actions for Choosing the right workflow orchestration service for your use case: Amazon MWAA and AWS Step Functions
Deploy ADX Business on DigitalOcean
☁️
Cloud Computing
digitalocean.com
·
1d
1 day ago
Actions for Deploy ADX Business on DigitalOcean
Navigating the
Dataflow
Runner Dilemma: Why Java and
Kafka
Often Favor Runner V1
🧠
AI Engineering
Content type:
Blog
medium.com
·
6d
6 days ago
Actions for Navigating the Dataflow Runner Dilemma: Why Java and Kafka Often Favor Runner V1
Announcing general availability of
Apache
Spark
4.0 on Amazon EMR
⚡
Apache Spark
Content type:
Blog
aws.amazon.com
·
1d
1 day ago
Actions for Announcing general availability of Apache Spark 4.0 on Amazon EMR
apvcode/pocketsentry: The 18MB drop-in Sentry alternative for self-hosters.
⚙️
Backend Engineering
Content type:
Code
github.com
·
10h
10 hours ago
·
Hacker News
Actions for apvcode/pocketsentry: The 18MB drop-in Sentry alternative for self-hosters.
Metamorphosis by Franz
Kafka
🧊
Apache Iceberg
Content type:
Reference
gutenberg.org
·
1d
1 day ago
Actions for Metamorphosis by Franz Kafka
Building HawkEye:
Kafka
for Real-Time Threat Detection
📨
Kafka
Content type:
Blog
medium.com
·
3h
3 hours ago
Actions for Building HawkEye: Kafka for Real-Time Threat Detection
Our first customers were the exception
⚡
Apache Flink
Content type:
Blog
apurvamehta.com
·
6d
6 days ago
·
Hacker News
Actions for Our first customers were the exception
Introducing Flights: Agent-Native Ingest in MotherDuck
🗄️
Databases
Content type:
Blog
motherduck.com
·
1d
1 day ago
Actions for Introducing Flights: Agent-Native Ingest in MotherDuck
CSU Student of Distinction: Anthony Arthur
📊
Data Analytics
Content type:
Academic
csuohio.edu
·
13h
13 hours ago
Actions for CSU Student of Distinction: Anthony Arthur
Calculating speed estimates with
Apache
Spark
⚡
Apache Spark
Content type:
Blog
mapbox.com
·
2d
2 days ago
Actions for Calculating speed estimates with Apache Spark
New comment by aldoakhanov in "Ask HN: Who wants to be hired? (June 2026)"
🗄️
Databases
castlefootyai.com
·
5d
5 days ago
·
Hacker News
Actions for New comment by aldoakhanov in "Ask HN: Who wants to be hired? (June 2026)"
Claude Code for Research: Preventing Hallucinations
⚙️
Query Engines
Content type:
News
Content type:
Blog
homeeconomics.substack.com
·
2d
2 days ago
·
Substack
Actions for Claude Code for Research: Preventing Hallucinations
Starting Work at Jane Street
💬
LLMs
Content type:
Blog
hazelduvall.dev
·
12h
12 hours ago
Actions for Starting Work at Jane Street
Databricks
wants to kill the “email me a file” problem for
AI
agent skills
🧊
Apache Iceberg
thenewstack.io
·
10h
10 hours ago
Actions for Databricks wants to kill the “email me a file” problem for AI agent skills
Amazon SageMaker Unified Studio Notebooks now support EMR Serverless
⚡
Apache Spark
aws.amazon.com
·
1d
1 day ago
Actions for Amazon SageMaker Unified Studio Notebooks now support EMR Serverless
Automating Real-time
Data
Pipelines
: Deploying Pub/Sub to BigQuery with Dataflow Custom Template…
☁️
Cloud Computing
Content type:
Blog
medium.com
·
6d
6 days ago
Actions for Automating Real-time Data Pipelines: Deploying Pub/Sub to BigQuery with Dataflow Custom Template…
Spring security advisory (AV26-574)
📨
Kafka
cyber.gc.ca
·
9h
9 hours ago
Actions for Spring security advisory (AV26-574)
lorenzopompili/jbmp: High-throughput BGP Monitoring Protocol (BMP) collector platform for the JVM.
📨
Kafka
Content type:
Code
github.com
·
2d
2 days ago
·
DEV
,
Hacker News
Actions for lorenzopompili/jbmp: High-throughput BGP Monitoring Protocol (BMP) collector platform for the JVM.
Piper
: A Programmable Distributed Training System
⚡
Apache Spark
Content type:
Academic
arxiv.org
·
20h
20 hours ago
Actions for Piper: A Programmable Distributed Training System
« Page 1
·
Page 3 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help