Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
data engineering
🏗 data engineering
pyspark, Polars, data bricks, spark, fabric, Azure synapse
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
47
posts in
6.2
ms
Streaming and
Batch
Data
Architectures with
Microsoft
Fabric to Azure Databricks
☁️
Cloud Computing
techcommunity.microsoft.com
·
1d
1 day ago
Actions for Streaming and Batch Data Architectures with Microsoft Fabric to Azure Databricks
Do
data
quality frameworks have to be so complex?
🌟
spark
sparkdq-community.github.io
·
6d
6 days ago
·
r/Python
Actions for Do data quality frameworks have to be so complex?
aayush4vedi/drift-spark
:
Spark-native
embedding lifecycle- produce, CDC refresh, model-migrate, audit.
🌟
spark
Content type:
Code
github.com
·
14h
14 hours ago
·
Hacker News
Actions for aayush4vedi/drift-spark: Spark-native embedding lifecycle- produce, CDC refresh, model-migrate, audit.
Upgrade
PySpark
from
Spark
3.5 to
Spark
4.0 with AWS
Spark
Upgrade Agent
🌟
spark
Content type:
Blog
aws.amazon.com
·
1d
1 day ago
Actions for Upgrade PySpark from Spark 3.5 to Spark 4.0 with AWS Spark Upgrade Agent
Deep dive: How Lightning
Engine
delivers 4.9x faster
Apache
Spark
performance
🌟
spark
Content type:
Blog
cloud.google.com
·
8h
8 hours ago
Actions for Deep dive: How Lightning Engine delivers 4.9x faster Apache Spark performance
Calculating speed estimates with
Apache
Spark
🌟
spark
Content type:
Blog
mapbox.com
·
2d
2 days ago
Actions for Calculating speed estimates with Apache Spark
Replit now integrates with
Microsoft
Fabric
☁️
Cloud Computing
alternativeto.net
·
6d
6 days ago
Actions for Replit now integrates with Microsoft Fabric
Operationalizing Property-Based Testing for
Data-Intensive
Scalable Computing Systems
🌟
spark
Content type:
Academic
arxiv.org
·
22h
22 hours ago
Actions for Operationalizing Property-Based Testing for Data-Intensive Scalable Computing Systems
Optimize
Spark
and
Databricks
jobs with
Datadog
🌟
spark
Content type:
Blog
datadoghq.com
·
2d
2 days ago
Actions for Optimize Spark and Databricks jobs with Datadog
Databricks
wants to kill the “email me a file” problem for AI agent skills
🧊
Iceberg Tables
thenewstack.io
·
12h
12 hours ago
Actions for Databricks wants to kill the “email me a file” problem for AI agent skills
SDLC vs. AIDLC: Why
Data
Engineering
is Pushing the Boundaries of Software Development
🔄
ETL Pipelines
Content type:
Blog
medium.com
·
5d
5 days ago
Actions for SDLC vs. AIDLC: Why Data Engineering is Pushing the Boundaries of Software Development
Daily Reading List – June 10, 2026 (#802)
☁️
Cloud Computing
seroter.com
·
3h
3 hours ago
Actions for Daily Reading List – June 10, 2026 (#802)
Introducing Streamling: Performant and Extensible
Data
Streaming Framework
⚡
DataFusion
Content type:
News
streamingdata.tech
·
1d
1 day ago
Actions for Introducing Streamling: Performant and Extensible Data Streaming Framework
New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"
☁️
Cloud Computing
Content type:
PDF
markokolarek.com
·
4d
4 days ago
·
Hacker News
Actions for New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"
Yesterday Was a Good Day
🏠
Data Lakehouse
Content type:
Blog
kottke.org
·
1d
1 day ago
Actions for Yesterday Was a Good Day
Microsoft
launches Rayfin and HorizonDB to secure and scale autonomous AI agents
🤖
Copilot
4sysops.com
·
6d
6 days ago
Actions for Microsoft launches Rayfin and HorizonDB to secure and scale autonomous AI agents
Announcing general availability of
Apache
Spark
4.0 on Amazon EMR
🌟
spark
Content type:
Blog
aws.amazon.com
·
1d
1 day ago
Actions for Announcing general availability of Apache Spark 4.0 on Amazon EMR
IPO-bound
Databricks
reportedly eyes $175B valuation after hitting $5.4B revenue run rate — TFN
🏗️
Data Platforms
techfundingnews.com
·
1d
1 day ago
Actions for IPO-bound Databricks reportedly eyes $175B valuation after hitting $5.4B revenue run rate — TFN
Databricks
is Hiring! — Non-Phone — Remote HR Operations Associate — Up to $60/hr.
🧱
Databricks
ratracerebellion.com
·
5d
5 days ago
Actions for Databricks is Hiring! — Non-Phone — Remote HR Operations Associate — Up to $60/hr.
Transforming solar and wind maintenance reports with genie and AI agents
🧱
Databricks
Content type:
Blog
databricks.com
·
2d
2 days ago
Actions for Transforming solar and wind maintenance reports with genie and AI agents
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help