Tools
Every Skill, MCP server, CLI and plugin in the directory. Filter by type, profession or tag, or search by keyword.
Profession: DevOps / SRE +2
Pick one or more: resources that suit any of them are listed.
2 items
vLLM
CLIHigh-throughput LLM inference and serving engine: vllm serve starts an OpenAI- and Anthropic-compatible server in one command. Supports 200+ model architectures from Hugging Face, quantization and distributed inference. Aimed mainly at NVIDIA, AMD and other GPUs.
vllm-project/vllm94.1k
LLM
CLISimon Willison's LLM CLI and Python library: call OpenAI, Claude, Gemini and local models from the terminal, with conversations logged to SQLite automatically, plus embeddings, structured extraction, tool calling and a plugin system.
simonw/llm12.6k