Agent infrastructure
kimi-k3-in-c
fareedkhan-dev/kimi-k3-in-c
A portable C99 inference engine that runs the 2.78T-parameter Kimi K3 model on a single CPU with streaming.
Topics
Related projects
krasis525A hybrid LLM inference runtime for running very large models on consumer GPUs with limited VRAM. Uses GPU prefill, decoding, and hot-cold expert management to enable local execution for individual practitioners.
ai-engineering-from-scratch77.1kAn open-source AI engineering course with hundreds of lessons, labs, and projects built from scratch.
RWKV-LM14.8kThe RWKV family of linear-time RNN language models with weights, training code, and fast inference demos.
FedML4.1kA unified, scalable ML library for large-scale distributed training, model serving, federated learning, and cross-cloud scheduling.
onnxruntime22.3kA cross-platform high-performance inference and training accelerator for ML models with hardware acceleration and graph optimizations.
web-llm19.4kA high-performance in-browser LLM inference engine with WebGPU acceleration and OpenAI-compatible APIs for building private web AI apps.