Data Processing

Feeds to Scour
SubscribedAll
Scoured 213 posts in 5.6 ms

What is Confluent? How It's Different from Apache Kafka

 🌐Distributed Systems  Content type: Blog
confluent.io·

Exclusive: MotherDuck adds agentic data ingestion to its cloud analytics service

 🌐Distributed Systems

Work With Me

 Concurrency
jordangoodman.xyz·

Lakehouse Demystified — Part 5: Just enough about Managed Service for Apache Airflow

 🐧Operating Systems  Content type: Blog
medium.com
·

expanso-io/log-simulators: Realistic log generators for testing data pipelines at volume - web, IoT, syslog, Windows, Cisco ASA, CEF/LEEF, JSON app, cloud audit, Kubernetes, PostgreSQL. Requires only uv.

 🔀MPI  Content type: Code
github.com··Hacker News

Run an Apache Airflow DAG with Docker Compose and PostgreSQL

 🔀MPI
pyimagesearch.com·

Amazon MWAA Serverless now supports Amazon EventBridge notifications/

 🔀MPI
aws.amazon.com
·

ParaView

 🖥️HPC
flathub.org·

Designing an ETL Application: Why I Started with a Modular Monolith Before Microservices

 🌐Distributed Systems  Content type: Blog
medium.com
·

DuckDB Ecosystem Newsletter : June 2026

 🐧Operating Systems  Content type: Blog
motherduck.com·

Introducing Streamling: Performant and Extensible Data Streaming Framework

 🔀MPI  Content type: News
streamingdata.tech·

Why I Built My Own Data Pipeline Instead of Buying Clean Data

 📐SIMD  Content type: News  Content type: Blog

Transit Data Ingestion Platform Dev 101: Lyondle & Colosse

 🌐Distributed Systems  Content type: Blog

Ingesting the Milky Way: Petabyte-Scale with Zerobus Ingest

 💾Cache Coherence  Content type: Blog
databricks.com·

Deep dive: How Lightning Engine delivers 4.9x faster Apache Spark performance

 📐SIMD  Content type: Blog
cloud.google.com·

Goal Analytics, Fully Built: Data Pipeline, Six Models, and a Real Backtest

 📈Optimization  Content type: Blog
medium.com
·

Deploying Vector High-Performance Observability Data Pipeline on Ubuntu 24.04

 🔀MPI  Content type: Reference  Content type: Tutorial
docs.vultr.com··DEV

DeepQt

 📐SIMD
flathub.org·

live US grid data (LMP, curtailment, queues, demand)

 🔀MPI

Multilayer Screening of Double and Conventional Perovskite Solar Cells Using SCAPS-1D and Machine Learning: Optimization of ETL, HTL, and Absorber for High-Efficiency Architectures

 ⚙️Algorithms  Content type: Academic
arxiv.org·

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help