Agent infrastructure
mlc-llm
mlc-ai/mlc-llm
A universal ML-compilation engine for deploying large language models with high-performance inference across GPUs, mobile, and browsers.
Topics
Related projects
web-llm19.4kA high-performance in-browser LLM inference engine with WebGPU acceleration and OpenAI-compatible APIs for building private web AI apps.
ai27.9kVercel's provider-agnostic TypeScript toolkit for building AI apps and agents with unified models, tools, and chat UI.
DocsGPT18.4kA self-hosted AI platform to build grounded agents, workflows, and search over your docs.
skyagi775Emerging human-behavior simulation capability in LLM agents
dsh-our-free-model72.7kThis DeepSeek Harness plugin adds free, no-key access to several upstream model pools and exposes a local OpenAI/Anthropic-compatible gateway. It includes fallback routing, usage dashboards, token-saving compression and in-app updates.
dsh-our-free-model58.9kA DeepSeek Harness plugin that adds free and bring-your-own-key model providers, a local OpenAI/Anthropic-compatible gateway, routing, usage dashboards, and token compression.