An efficient Gemma 4 inference runtime for Apple-silicon Macs, streaming experts under low-memory budgets and bundling a demo app with evaluation tooling.
7192gemma,gpgpu,llmAn efficient Gemma 4 inference runtime for Apple-silicon Macs, streaming experts under low-memory budgets and bundling a demo app with evaluation tooling.