Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Apache Spark
⚡ Apache Spark
Specific
PySpark, distributed computing, big data, Spark SQL
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
99
posts in
30.4
ms
Build stateful
streaming
applications with
Apache
Spark
4.0 on Amazon EMR Serverless
⚡
Apache Flink
Content type:
Blog
aws.amazon.com
·
1d
1 day ago
Actions for Build stateful streaming applications with Apache Spark 4.0 on Amazon EMR Serverless
Less-relevant results
Jupyter Enterprise Gateway - From Notebook to Kubernetes
Cluster
Admin
☁️
Cloud Computing
Content type:
Blog
elttam.com
·
17h
17 hours ago
·
r/netsec
Actions for Jupyter Enterprise Gateway - From Notebook to Kubernetes Cluster Admin
Revisiting "Cooler is Better": ITD-Aware Per-CPU Thermal Optimization for Sustainable
Data
Center Operation
🛠️
Data Engineering
Content type:
Academic
arxiv.org
·
20h
20 hours ago
Actions for Revisiting "Cooler is Better": ITD-Aware Per-CPU Thermal Optimization for Sustainable Data Center Operation
sync with upstream · vinta/awesome-python@eb86241
💻
Programming
Content type:
Code
github.com
·
4d
4 days ago
Actions for sync with upstream · vinta/awesome-python@eb86241
IPO-bound
Databricks
reportedly eyes $175B valuation after hitting $5.4B revenue run rate — TFN
🛠️
Data Engineering
techfundingnews.com
·
1d
1 day ago
Actions for IPO-bound Databricks reportedly eyes $175B valuation after hitting $5.4B revenue run rate — TFN
SDLC vs. AIDLC: Why
Data
Engineering is Pushing the Boundaries of Software Development
🛠️
Data Engineering
Content type:
Blog
medium.com
·
5d
5 days ago
Actions for SDLC vs. AIDLC: Why Data Engineering is Pushing the Boundaries of Software Development
Linearizability and State-Machine Replication: Is It a Match?
⚙️
Backend Engineering
Content type:
Academic
arxiv.org
·
8h
8 hours ago
·
Hacker News
Actions for Linearizability and State-Machine Replication: Is It a Match?
Streaming
and Batch
Data
Architectures with Microsoft Fabric to Azure Databricks
🗄️
Databases
techcommunity.microsoft.com
·
1d
1 day ago
Actions for Streaming and Batch Data Architectures with Microsoft Fabric to Azure Databricks
Piper: A Programmable
Distributed
Training System
🛠️
Data Engineering
Content type:
Academic
arxiv.org
·
20h
20 hours ago
Actions for Piper: A Programmable Distributed Training System
Beyond JSON blobs: Implementing the VARIANT
data
type in
Apache
Iceberg V3
🧊
Apache Iceberg
Content type:
Blog
aws.amazon.com
·
1d
1 day ago
Actions for Beyond JSON blobs: Implementing the VARIANT data type in Apache Iceberg V3
Introducing Streamling: Performant and Extensible
Data
Streaming
Framework
🛠️
Data Engineering
Content type:
News
streamingdata.tech
·
1d
1 day ago
Actions for Introducing Streamling: Performant and Extensible Data Streaming Framework
RATrain: A Resource-Aware Training Runtime for Large Language Models on Bandwidth-Constrained Heterogeneous Supercomputing Platforms
💬
LLMs
Content type:
Academic
arxiv.org
·
20h
20 hours ago
Actions for RATrain: A Resource-Aware Training Runtime for Large Language Models on Bandwidth-Constrained Heterogeneous Supercomputing Platforms
DataAgents
: How we turned 9 months of analysis into 10 days
☁️
Cloud Computing
Content type:
Blog
medium.com
·
1d
1 day ago
Actions for DataAgents: How we turned 9 months of analysis into 10 days
ASTRA-sim 3.0: Next-Level
Distributed
Machine Learning Simulations via High-Fidelity GPU and Infrastructure Modeling
🧠
AI Engineering
Content type:
Academic
arxiv.org
·
20h
20 hours ago
Actions for ASTRA-sim 3.0: Next-Level Distributed Machine Learning Simulations via High-Fidelity GPU and Infrastructure Modeling
IN2P3
Computing
Center 2024 Workload
Dataset
📨
Kafka
Content type:
Academic
arxiv.org
·
5d
5 days ago
Actions for IN2P3 Computing Center 2024 Workload Dataset
Achieving Cloud-Grade SLOs for Local Mixture-of-Experts Inference through CPU-GPU Hybrid Design
🔁
MLOps
Content type:
Academic
arxiv.org
·
20h
20 hours ago
Actions for Achieving Cloud-Grade SLOs for Local Mixture-of-Experts Inference through CPU-GPU Hybrid Design
Demystifying NVSHMEM: A System-Level Analysis on Symmetric Memory and Device-Initiated Operations in GPU Communication
🤖
Machine Learning
Content type:
Academic
arxiv.org
·
5d
5 days ago
Actions for Demystifying NVSHMEM: A System-Level Analysis on Symmetric Memory and Device-Initiated Operations in GPU Communication
FlashCP: Load-Balanced Communication-Efficient Context Parallelism for LLM Training
💬
LLMs
Content type:
Academic
arxiv.org
·
1d
1 day ago
Actions for FlashCP: Load-Balanced Communication-Efficient Context Parallelism for LLM Training
FairWave : A Fairness-Aware Asynchronous DAG-BFT Consensus
🔗
gRPC
Content type:
Academic
arxiv.org
·
20h
20 hours ago
Actions for FairWave : A Fairness-Aware Asynchronous DAG-BFT Consensus
Terastal: Layer-Variant-based Scheduling for Real-Time Multi-DNN Workloads on Heterogeneous Accelerators
🔁
MLOps
Content type:
Academic
arxiv.org
·
2d
2 days ago
Actions for Terastal: Layer-Variant-based Scheduling for Real-Time Multi-DNN Workloads on Heterogeneous Accelerators
« Page 1
·
Page 3 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help