PinnedInTowards AIbyArtha Mukherjee·Jun 23A GPU-Poor’s Guide to Local LLM Inference in 2026MoE math. KV cache quants below q8_0. MCP-based tooling. Worked example: a 35B Mixture-of-Experts on 6 GB of VRAM.A response icon2A response icon2