Logo
Agent Skills Guide

spark-optimization

published 2026/01/20

Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.

📦 Install Skill

Command line install

Install directly with the `skills` CLI.

npx skills add wshobson/agents/plugins/data-engineering/skills/spark-optimization

Local download

Download only this skill directory.

Download spark-optimization only
File Explorer
0 files
No file selected
readonly

Select a file to view its content