Tools

High-throughput LLM inference and serving engine: vllm serve starts an OpenAI- and Anthropic-compatible server in one command. Supports 200+ model architectures from Hugging Face, quantization and distributed inference. Aimed mainly at NVIDIA, AMD and other GPUs.

MLOps plugin from the wshobson/agents marketplace: data scientist, ML engineer and MLOps engineer subagents and a /ml-pipeline command that runs the pipeline in phases from data analysis and training to deployment and monitoring, plus ML pipeline and recommender system skills.

Google's official skill library and plugin marketplace: nearly 150 skills focused on Google Cloud (GKE, BigQuery, Cloud Run, IAM and more), plus 17 product plugins pairing skills with MCP for Cloud SQL, Spanner, AlloyDB, BigQuery, GCS and others.

Google's official skills for building ADK agents: dev workflow, scaffolding, the ADK Python API, evaluation with LLM judges and adaptive rubrics, deployment to Agent Runtime, Cloud Run or GKE, publishing and observability. Works with agents-cli; local dev needs only an AI Studio key.

AWS's generally available agent toolkit and plugin marketplace: plugins such as aws-core, aws-agents and aws-data-analytics bundle the AWS MCP Server with evaluated skills for IaC, serverless, containers and billing. Calling AWS APIs requires configured credentials.