Tools

All-in-one LLM fine-tuning framework: llamafactory-cli handles pretraining, SFT, PPO/DPO alignment and LoRA/QLoRA training, plus chat inference, weight merging and export, and OpenAI-style API serving for 100+ open models. Has a Web UI; training usually needs a GPU.

ModelScope's official training framework for LLMs and multimodal models: the swift command covers pretraining, fine-tuning, RL, inference, evaluation, quantization and deployment for 600+ text and 400+ multimodal models, with Megatron parallelism and a web UI. Usually needs a GPU.