Tools

High-throughput LLM inference and serving engine: vllm serve starts an OpenAI- and Anthropic-compatible server in one command. Supports 200+ model architectures from Hugging Face, quantization and distributed inference. Aimed mainly at NVIDIA, AMD and other GPUs.

NVIDIA's official, verified catalog of hundreds of skills covering CUDA-X libraries, NeMo training, NIM and Dynamo inference, RAG blueprints, Jetson, Omniverse and robotics simulation. The install adds only nvidia-skill-finder, which recommends other skills and installs them once you confirm.