Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Apache Spark
⚡ Apache Spark
Specific
PySpark, distributed computing, big data, Spark SQL
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
98
posts in
8.6
ms
Enhancements to Managed Service for
Apache
Spark
clusters
🛠️
Data Engineering
Content type:
Blog
cloud.google.com
·
6d
6 days ago
Actions for Enhancements to Managed Service for Apache Spark clusters
Announcing general availability of
Apache
Spark
4.0 on Amazon EMR
🧊
Apache Iceberg
Content type:
Blog
aws.amazon.com
·
1d
1 day ago
Actions for Announcing general availability of Apache Spark 4.0 on Amazon EMR
aayush4vedi/drift-spark
:
Spark-native
embedding lifecycle- produce, CDC refresh, model-migrate, audit.
☁️
Cloud Computing
Content type:
Code
github.com
·
10h
10 hours ago
·
Hacker News
Actions for aayush4vedi/drift-spark: Spark-native embedding lifecycle- produce, CDC refresh, model-migrate, audit.
Calculating speed estimates with
Apache
Spark
🛠️
Data Engineering
Content type:
Blog
mapbox.com
·
2d
2 days ago
Actions for Calculating speed estimates with Apache Spark
Do
data
quality frameworks have to be so complex?
🛠️
Data Engineering
sparkdq-community.github.io
·
6d
6 days ago
·
r/Python
Actions for Do data quality frameworks have to be so complex?
Less-relevant results
Operationalizing Property-Based Testing for
Data-Intensive
Scalable
Computing
Systems
🛠️
Data Engineering
Content type:
Academic
arxiv.org
·
19h
19 hours ago
Actions for Operationalizing Property-Based Testing for Data-Intensive Scalable Computing Systems
Amazon SageMaker Unified Studio Notebooks now support EMR Serverless
🔁
MLOps
aws.amazon.com
·
1d
1 day ago
Actions for Amazon SageMaker Unified Studio Notebooks now support EMR Serverless
New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"
🛠️
Data Engineering
Content type:
PDF
markokolarek.com
·
4d
4 days ago
·
Hacker News
Actions for New comment by mkolarek in "Ask HN: Who wants to be hired? (June 2026)"
Linux Fundamentals for
Data
Engineering
🛠️
Data Engineering
dev-to-uploads.s3.amazonaws.com
·
2d
2 days ago
·
DEV
Actions for Linux Fundamentals for Data Engineering
A Neurosymbolic Prolog Skill for LLM-Driven Service Placement
💬
LLMs
Content type:
Academic
arxiv.org
·
19h
19 hours ago
Actions for A Neurosymbolic Prolog Skill for LLM-Driven Service Placement
Upgrade
PySpark
from
Spark
3.5 to
Spark
4.0 with AWS
Spark
Upgrade Agent
🛠️
Data Engineering
Content type:
Blog
aws.amazon.com
·
1d
1 day ago
Actions for Upgrade PySpark from Spark 3.5 to Spark 4.0 with AWS Spark Upgrade Agent
make descriptions shorter · vinta/awesome-python@9f156de
🗄️
Databases
Content type:
Code
github.com
·
4d
4 days ago
Actions for make descriptions shorter · vinta/awesome-python@9f156de
Deep dive: How Lightning Engine delivers 4.9x faster
Apache
Spark
performance
🛠️
Data Engineering
Content type:
Blog
cloud.google.com
·
4h
4 hours ago
Actions for Deep dive: How Lightning Engine delivers 4.9x faster Apache Spark performance
Announcing
Spark
Connect on Amazon EMR Serverless: Interactive
PySpark
development, anywhere
🛠️
Data Engineering
Content type:
Blog
aws.amazon.com
·
1d
1 day ago
Actions for Announcing Spark Connect on Amazon EMR Serverless: Interactive PySpark development, anywhere
Databricks
is Hiring! — Non-Phone — Remote HR Operations Associate — Up to $60/hr.
🛠️
Data Engineering
ratracerebellion.com
·
5d
5 days ago
Actions for Databricks is Hiring! — Non-Phone — Remote HR Operations Associate — Up to $60/hr.
Run Interactive Workloads on Amazon EMR Serverless with
Spark
Connect
🔁
MLOps
aws.amazon.com
·
1d
1 day ago
Actions for Run Interactive Workloads on Amazon EMR Serverless with Spark Connect
Dynamic Software Updates using CRDTs
⚙️
Backend Engineering
Content type:
Academic
arxiv.org
·
19h
19 hours ago
Actions for Dynamic Software Updates using CRDTs
Apache
Iceberg™ 1.11 Released: A Smarter REST Catalog, Production-Ready Encryption and the Road to v4
🧊
Apache Iceberg
Content type:
Blog
snowflake.com
·
6d
6 days ago
Actions for Apache Iceberg™ 1.11 Released: A Smarter REST Catalog, Production-Ready Encryption and the Road to v4
Databricks
wants to kill the “email me a file” problem for AI agent skills
🧊
Apache Iceberg
thenewstack.io
·
9h
9 hours ago
Actions for Databricks wants to kill the “email me a file” problem for AI agent skills
Build stateful
streaming
applications with
Apache
Spark
4.0 on Amazon EMR Serverless
⚡
Apache Flink
Content type:
Blog
aws.amazon.com
·
1d
1 day ago
Actions for Build stateful streaming applications with Apache Spark 4.0 on Amazon EMR Serverless
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help
