替代方案
llm-compressor
vllm-project/llm-compressor
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
标签
同类项目
yt-dlp191.2k一个功能丰富的命令行音视频下载器，支持数千个网站。
Microsoft-Activation-Scripts190.6kOpen-source Windows and Office activator featuring HWID, Ohook, TSforge, and Online KMS activation methods, along with advanced troubleshooting.
ohmyzsh189.7k🙃 A delightful community-driven (with 2,500+ contributors) framework for managing your zsh configuration. Includes 300+ optional plugins (rails, git, macOS, hub, docker, homebrew, node, php, python, etc), 140+ themes to spice up your morning, and an auto-update tool that makes it easy to keep up with the latest updates from the community.
gitignore175.8kA collection of useful .gitignore templates