A Python framework for developers to build LLM apps with chat, function calling, structured output, RAG, and agent chains across llama.cpp, TGI, and vLLM backends.
664agents,llamacpp,llmA Python framework for developers to build LLM apps with chat, function calling, structured output, RAG, and agent chains across llama.cpp, TGI, and vLLM backends.