Tools

High-throughput LLM inference and serving engine: vllm serve starts an OpenAI- and Anthropic-compatible server in one command. Supports 200+ model architectures from Hugging Face, quantization and distributed inference. Aimed mainly at NVIDIA, AMD and other GPUs.

Hugging Face's official skills: manage Hub models and datasets with the hf CLI, fine-tune language and vision models, run model evaluations, and build Gradio apps deployed to Spaces. Needs an HF account; cloud training on HF Jobs requires a paid plan.

Hugging Face's official hf CLI: search, download and upload models and datasets, manage repos and storage buckets, and run jobs on Hugging Face's cloud. Output adapts automatically for agents, and hf skills add installs companion skills. Uploads and similar actions need a login.