Agent infrastructure
plano
katanemo/plano
An AI-native proxy and data plane for agentic apps offering LLM routing, agent orchestration, guardrails, and observability.
Topics
Related projects
gateway13.3kAn open-source AI gateway that routes requests across 1600+ LLMs with retries, guardrails, caching, observability, and MCP server management.
BentoML8.9kA Python framework for turning any ML model into production inference APIs with batching, containers, and scalable deployment.
phoenix12.3kAn open-source AI observability platform for tracing, evaluating, and debugging LLM and agent applications.
llm-action25.3kA curated Chinese knowledge base sharing LLM training, fine-tuning, inference, and deployment tutorials with hands-on code.
agents-towards-production21.9kA hands-on tutorial collection that teaches how to take GenAI agents from prototype to secure, observable production deployment.
outlines16kA development library for guaranteed structured outputs from large language models, letting the same code enforce type-valid generation across multiple model backends.