Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Apache Spark
⚡ Apache Spark
Specific
PySpark, distributed computing, big data, Spark SQL
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
99
posts in
4.3
ms
Announcing general availability of
Apache
Spark
4.0 on Amazon EMR
🧊
Apache Iceberg
Content type:
Blog
aws.amazon.com
·
1d
1 day ago
Actions for Announcing general availability of Apache Spark 4.0 on Amazon EMR
Do
data
quality frameworks have to be so complex?
🛠️
Data Engineering
sparkdq-community.github.io
·
6d
6 days ago
·
r/Python
Actions for Do data quality frameworks have to be so complex?
Deep dive: How Lightning Engine delivers 4.9x faster
Apache
Spark
performance
🛠️
Data Engineering
Content type:
Blog
cloud.google.com
·
7h
7 hours ago
Actions for Deep dive: How Lightning Engine delivers 4.9x faster Apache Spark performance
Calculating speed estimates with
Apache
Spark
🛠️
Data Engineering
Content type:
Blog
mapbox.com
·
2d
2 days ago
Actions for Calculating speed estimates with Apache Spark
aayush4vedi/drift-spark
:
Spark-native
embedding lifecycle- produce, CDC refresh, model-migrate, audit.
☁️
Cloud Computing
Content type:
Code
github.com
·
13h
13 hours ago
·
Hacker News
Actions for aayush4vedi/drift-spark: Spark-native embedding lifecycle- produce, CDC refresh, model-migrate, audit.
Optimize
Spark
and
Databricks
jobs with
Datadog
🛠️
Data Engineering
Content type:
Blog
datadoghq.com
·
2d
2 days ago
Actions for Optimize Spark and Databricks jobs with Datadog
New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"
🛠️
Data Engineering
Content type:
PDF
markokolarek.com
·
4d
4 days ago
·
Hacker News
Actions for New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"
Less-relevant results
Operationalizing Property-Based Testing for
Data-Intensive
Scalable
Computing
Systems
🛠️
Data Engineering
Content type:
Academic
arxiv.org
·
22h
22 hours ago
Actions for Operationalizing Property-Based Testing for Data-Intensive Scalable Computing Systems
Amazon SageMaker Unified Studio Notebooks now support EMR Serverless
🔁
MLOps
aws.amazon.com
·
1d
1 day ago
Actions for Amazon SageMaker Unified Studio Notebooks now support EMR Serverless
Daily Reading List – June 10, 2026 (#802)
🛠️
Data Engineering
seroter.com
·
2h
2 hours ago
Actions for Daily Reading List – June 10, 2026 (#802)
make descriptions shorter · vinta/awesome-python@9f156de
🗄️
Databases
Content type:
Code
github.com
·
4d
4 days ago
Actions for make descriptions shorter · vinta/awesome-python@9f156de
Upgrade
PySpark
from
Spark
3.5 to
Spark
4.0 with AWS
Spark
Upgrade Agent
🛠️
Data Engineering
Content type:
Blog
aws.amazon.com
·
1d
1 day ago
Actions for Upgrade PySpark from Spark 3.5 to Spark 4.0 with AWS Spark Upgrade Agent
A Neurosymbolic Prolog Skill for LLM-Driven Service Placement
💬
LLMs
Content type:
Academic
arxiv.org
·
22h
22 hours ago
Actions for A Neurosymbolic Prolog Skill for LLM-Driven Service Placement
Linux Fundamentals for
Data
Engineering
🛠️
Data Engineering
dev-to-uploads.s3.amazonaws.com
·
2d
2 days ago
·
DEV
Actions for Linux Fundamentals for Data Engineering
Databricks
is Hiring! — Non-Phone — Remote HR Operations Associate — Up to $60/hr.
🛠️
Data Engineering
ratracerebellion.com
·
5d
5 days ago
Actions for Databricks is Hiring! — Non-Phone — Remote HR Operations Associate — Up to $60/hr.
Announcing
Spark
Connect on Amazon EMR Serverless: Interactive
PySpark
development, anywhere
🛠️
Data Engineering
Content type:
Blog
aws.amazon.com
·
1d
1 day ago
Actions for Announcing Spark Connect on Amazon EMR Serverless: Interactive PySpark development, anywhere
Apache
Iceberg™ 1.11 Released: A Smarter REST Catalog, Production-Ready Encryption and the Road to v4
🧊
Apache Iceberg
Content type:
Blog
snowflake.com
·
6d
6 days ago
Actions for Apache Iceberg™ 1.11 Released: A Smarter REST Catalog, Production-Ready Encryption and the Road to v4
Run Interactive Workloads on Amazon EMR Serverless with
Spark
Connect
🔁
MLOps
aws.amazon.com
·
1d
1 day ago
Actions for Run Interactive Workloads on Amazon EMR Serverless with Spark Connect
Dynamic Software Updates using CRDTs
⚙️
Backend Engineering
Content type:
Academic
arxiv.org
·
22h
22 hours ago
Actions for Dynamic Software Updates using CRDTs
Databricks
wants to kill the “email me a file” problem for AI agent skills
🧊
Apache Iceberg
thenewstack.io
·
12h
12 hours ago
Actions for Databricks wants to kill the “email me a file” problem for AI agent skills
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help