ツール

ModelScope's official training framework for LLMs and multimodal models: the swift command covers pretraining, fine-tuning, RL, inference, evaluation, quantization and deployment for 600+ text and 400+ multimodal models, with Megatron parallelism and a web UI. Usually needs a GPU.

Plugin marketplace for AI research with nearly 100 skills in 23 categories, from ideation, fine-tuning and post-training to distributed training, inference serving, evaluation and paper writing, coordinated end to end by the autoresearch skill.

Nearly 100 skills spanning the AI research workflow: ideation and literature review, fine-tuning and post-training, distributed training, inference serving, evaluation, interpretability and paper writing, tied together by an autoresearch orchestration skill.

Hugging Face's official skills: manage Hub models and datasets with the hf CLI, fine-tune language and vision models, run model evaluations, and build Gradio apps deployed to Spaces. Needs an HF account; cloud training on HF Jobs requires a paid plan.

Lets agents work with the Hugging Face Hub through the hf CLI: search and download models and datasets, manage repos and Spaces, and run training and evaluation jobs on cloud GPUs, with more workflow skills installable as needed. Maintained by Hugging Face.

NVIDIA's open-source LLM vulnerability scanner that probes for prompt injection, jailbreaks, data leakage, hallucination and harmful content, supporting OpenAI, Hugging Face, Bedrock and most REST-accessible models. Scanning cloud models needs their API keys.

Open-source LLM evaluation platform: one opencompass command picks the model and datasets and runs the evaluation across hundreds of benchmarks. Works with local Hugging Face models and API models, with vLLM and LMDeploy for faster inference.

LangChain's official skill collection: framework selection, quickstarts, middleware, persistence, human-in-the-loop approval, RAG and eval design across LangChain, LangGraph and Deep Agents, in Python and TypeScript. Also installable as a Claude Code plugin. Still in early development.

Comet's official Opik MCP: query traces and spans of LLM apps in chat, log scores and comments, and manage datasets, experiments and prompt versions. Works with Opik Cloud (API key or browser sign-in) and self-hosted open-source Opik.

Microsoft Translator's translation quality tool: GPT scores each sentence using MQM error categories or a direct score; --list_mqm_errors shows error types and severity. Needs line-aligned source and target files, Python and an OpenAI or Azure OpenAI key (paid); a translator should still review.

MLflow's official skills plugin: lets coding agents add MLflow Tracing to LLM apps, analyze failed traces, build evaluation datasets and scorers, and query token and latency metrics, closing the instrument, evaluate, iterate loop. Needs MLflow 3.8+.