Libraries & frameworks
loongforge
baidu-baige/loongforge
A high-performance training framework from Baidu for LLMs, VLMs, diffusion, and embodied models, supporting pretraining, SFT, LoRA, and distributed training on GPUs and Kunlun XPUs.
Topics
Related projects
ms-swift16.1kA full-pipeline framework for fine-tuning, aligning, evaluating, and deploying hundreds of LLMs and multimodal models.
peft21.9kA Python library for parameter-efficient fine-tuning like LoRA, adapting large pretrained models by training only small adapters.
Soup10.5kA one-config CLI framework for fine-tuning and post-training LLMs with QLoRA, evals, and export.
AngelSlim1.8kTencent Hunyuan's model compression toolkit for large models. It bundles quantization, speculative decoding, sparse attention, and distillation to make LLM deployment cheaper and faster.
airllm42.3kA Python inference engine that streams huge language models layer by layer to run 70B to 671B models on small GPUs.
sglang38.7kA fast open-source inference framework for serving large language and multimodal models at scale.