Etiqueta: spark

Data engineering plugin from the wshobson/agents marketplace: a data engineer subagent, a data pipeline command, and skills for Airflow DAGs, dbt transformations, Spark tuning and data quality, to help build ETL and data warehouses.

Official Databricks skills guiding agents to build Lakeflow pipelines and jobs, Apps, Lakebase, Vector Search, Model Serving and AI/BI dashboards on the lakehouse. Needs the Databricks CLI.

Official Databricks plugin with skills for the CLI and auth, Genie data queries, Apps, Lakebase, Lakeflow jobs and pipelines, Model Serving and DABs deployment, plus hooks for prompt routing, session context and auth failure hints. Needs a Databricks account.

Official Spark mail skills: agents read mail, calendar, contacts and teams, with flows for morning briefs, inbox zero, meeting prep, follow-ups and weekly reports. Needs Spark desktop on macOS or Windows with the CLI enabled; set read-only, organize or send access per account.