📊 Data Engineering - egasimov · Scour

OpenData Buffer: HA pipelines without Kafka 📨Kafka

opendata.dev·10h·Hacker News, r/programming

FAIR4prep: FAIR clinical informatics data preprocessing in artificial intelligence applications 📐API Design

AI Agent Analytics with Vercel & MotherDuck 🦆DuckDB

motherduck.com·19h

What Happens to Your Pipeline When the Source System Changes Without Warning 🏗️Platform Engineering

layline.io·2d·DEV

Inside FDP – part 1: Understanding the problems facing NHS data 💳FinTech

computerweekly.com

·21h

logrittr: A Verbose Pipe Operator for Logging dplyr Pipelines 🏎️ClickHouse

r-bloggers.com·1d

How web intelligence is powering the next wave of AI Infrastructure 💳FinTech

thenextweb.com·5d

The Data Layer Tax for Robot Learning 🌊Stream Processing

rerun.io·15h·Hacker News

Mistral AI launches Workflows, a Temporal-powered orchestration engine already running millions of daily executions 🦆DuckDB

venturebeat.com·2d

What CI/CD strategies work for embedded or IoT projects that require hardware testing? 📐System Design

semaphore.io·17h

Start With Context: Building the Retrieval Core for Agentic Apps 🏎️ClickHouse

alexbevi.com·1d

Essentials of Big Data Analytics (Morgan Kaufmann) 🗄️Databases

i-programmer.info·3d

Kafka on Kubernetes - The Hard Way ☸️Kubernetes

opensource.adobe.com·10h

Agentic Data Engineering with Genie Code and Lakeflow 🏎️ClickHouse

databricks.com·2d

OpenMetadata maker Collate launches AI Analytics for chat-driven dashboards 🦆DuckDB

siliconangle.com·16h

Data analysis tools explained: types, use cases, and how to choose the right one 🏎️ClickHouse

dataiku.com·6d

Discovering 9 DoS Vulnerabilities in Elastic Beats 🔬eBPF

muzzamilanis/psx-data-pipeline: End-to-end PSX data engineering pipeline using Python, dbt, and PostgreSQL with Medallion architecture 🏎️ClickHouse

github.com·1d·DEV

The problem: All-or-nothing batch processing in Azure Service Bus 🔗gRPC

devblogs.microsoft.com·2d

End-to-End Event Streaming With Kafka, Spring Boot and AWS SQS/SNS (Production-Ready Code Guide) 📨Kafka

feeds.dzone.com·10h

Log in to enable infinite scrolling