Libraries & frameworks
BentoML
bentoml/BentoML
A Python framework for turning any ML model into production inference APIs with batching, containers, and scalable deployment.
Topics
Related projects
openvino11.1kAn open-source toolkit for optimizing and deploying deep learning inference across CPUs, GPUs, and AI accelerators.
plano7.1kAn AI-native proxy and data plane for agentic apps offering LLM routing, agent orchestration, guardrails, and observability.
litgpt13.8kA developer framework with from-scratch implementations of 20+ LLMs plus proven recipes to pretrain, finetune, evaluate, and deploy them.
FedML4.1kA unified, scalable ML library for large-scale distributed training, model serving, federated learning, and cross-cloud scheduling.
synthetic-data-generator2.4kSDG is a Python framework for generating high-quality synthetic tabular data. It bundles GAN and LLM models, privacy enhancements and a plug-in system for developers to build on.
Prompt-Engineering-Guide79.9kA learning guide and curated resource collection for prompt engineering techniques.