spark-optimization

26414
•published 2026/01/20
Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.
📦 Install Skill
Command line install
Install directly with the `skills` CLI.
npx skills add wshobson/agents/plugins/data-engineering/skills/spark-optimizationFile Explorer
No file selected
Select a file to view its content
