Libraries & frameworks
nncf
openvinotoolkit/nncf
A Python framework for compressing neural networks with quantization, pruning, and sparsity for faster OpenVINO inference.
Topics
Related projects
aimet2.7kA toolkit for quantizing and compressing trained neural networks for faster efficient edge deployment.
PaddleSlim1.6kAn open-source Paddle toolkit for model compression via quantization, pruning, distillation, sparsity, and neural architecture search.
llm-compressor4kA library for quantizing and compressing large language models for fast production inference with vLLM.
deep-learning-for-image-processing26.5kA video course collection teaching image classification, detection and segmentation with PyTorch and TensorFlow.
ultralytics63.3kA Python library for YOLO object detection, segmentation, pose, and tracking with training and deployment tools.
faster-whisper26.7kA fast Whisper transcription library built on CTranslate2, with quantization, batching, VAD filtering, and word timestamps.