Apache Spark Agents

Apache Spark commands for distributed data processing, SQL queries, streaming, and large-scale analytics.

2 agents

Spark Cluster Operations Manager

AI agent for Spark cluster management — YARN/Kubernetes deployment, resource allocation, dynamic allocation, Adaptive Query Execution, History Server, log aggregation, and production troubleshooting for OOM, skew, and shuffle failures.

Claude CodeCursorCopilotCodexWindsurf+1

cluster-management, yarn, kubernetes

View Agent

Apache Spark Data Engineering Expert

Intermediate

Expert AI agent for Apache Spark — spark-submit, spark-shell, DataFrames, SQL queries, partitioning, caching strategies, and building efficient data processing pipelines with spark-submit.

Claude CodeCursorCopilotCodexWindsurf+1

spark, spark-submit, dataframes

View Agent