big data

Feeds to Scour
SubscribedAll
Scoured 227 posts in 7.2 ms

Enhancements to Managed Service for Apache Spark clusters

 ☁️Cloud Deployment  Content type: Blog
cloud.google.com·

Calculating speed estimates with Apache Spark

 🗃️databases  Content type: Blog
mapbox.com·

LakeQA: An Exploratory QA Benchmark over a Million-Scale Data Lake

 🗃️databases  Content type: Academic
arxiv.org·

Franz

 🐹Go
flathub.org·

Introducing Streamling: Performant and Extensible Data Streaming Framework

 🦀rust  Content type: News
streamingdata.tech·

New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"

 🐍python  Content type: PDF

Designing an ETL Application: Why I Started with a Modular Monolith Before Microservices

 ☁️Cloud Deployment  Content type: Blog
medium.com
·

Announcing general availability of Apache Spark 4.0 on Amazon EMR

 ☁️Cloud Deployment  Content type: Blog
aws.amazon.com·

Exclusive: MotherDuck adds agentic data ingestion to its cloud analytics service

 Zig
siliconangle.com·

Senior Data Engineer – Climate Friendly

 ☁️Cloud Deployment

Claude Code for Research: Preventing Hallucinations

 ⚙️Systems Programming  Content type: News  Content type: Blog

Introducing Flights: Agent-Native Ingest in MotherDuck

 🐍python  Content type: Blog
motherduck.com·

Automating Real-time Data Pipelines: Deploying Pub/Sub to BigQuery with Dataflow Custom Template…

 ☁️Cloud Deployment  Content type: Blog
medium.com
·

Minimizing Memory in Parallel Task Graph Scheduling: Focusing on Average Consumption

 ⚙️Systems Programming  Content type: Academic
sciencedirect.com·

DuckDB Storage Engine for MariaDB. When the Sea Lion Learns to Quack.

 🗃️databases
mariadb.org··Hacker News

Snowflake Datastream: Kafka-native streaming in Snowflake

 🐹Go
snowflake.com··Hacker News

AI Security Best Practices for Regulated Industries

 ⚙️Systems Programming
orca.security·

Deep dive: How Lightning Engine delivers 4.9x faster Apache Spark performance

 ☁️Cloud Deployment  Content type: Blog
cloud.google.com·

SDLC vs. AIDLC: Why Data Engineering is Pushing the Boundaries of Software Development

 ⚙️engineering  Content type: Blog
medium.com·

Presentation: Beyond Prompting: Context Engineering and Memory Management for AI Systems at Scale

 ⚙️Systems Programming  Content type: News
infoq.com
·

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help