Ferramentas

Alibaba's open-source offline data sync tool: JSON job configs batch-sync between heterogeneous sources like MySQL, Oracle, PostgreSQL, Hive, HDFS and MaxCompute, run with python datax.py. Needs JDK 1.8+ and Python; download and unpack the official toolkit.

Framework for writing data transformation models in SQL or Python, with a Terraform-like plan/apply flow, virtual data environments, unit tests and table diffs, and transpilation across 10+ SQL dialects. A Linux Foundation project and an alternative to dbt.

Astronomer's official data engineering plugin: write Airflow DAGs to best practices, debug pipeline failures, trace data lineage, profile warehouse tables and migrate from Airflow 2 to 3, with a built-in Airflow MCP server and session hooks.

Official Databricks skills guiding agents to build Lakeflow pipelines and jobs, Apps, Lakebase, Vector Search, Model Serving and AI/BI dashboards on the lakehouse. Needs the Databricks CLI.

Official Databricks plugin with skills for the CLI and auth, Genie data queries, Apps, Lakebase, Lakeflow jobs and pipelines, Model Serving and DABs deployment, plus hooks for prompt routing, session context and auth failure hints. Needs a Databricks account.

Snowflake's official plugin: detects Snowflake-related requests and hands them to the Cortex Code CLI, whose 55+ built-in skills handle SQL, dynamic tables, data governance and more. Needs the cortex CLI installed and a Snowflake connection configured.