Adnan Sattar·Aug 25From 140GB to 40GB: An Engineer’s Guide to LLM QuantizationWhy GGUF, GPTQ, AWQ, FP8, and SmoothQuant exist, what they actually do, and how to pick between them in production
InGoPenAIbyJatinkumar Parmar·Jul 23FP8 quantization with AMD Quark for vLLMAuthor: Charles Yang , Jatinkumar parmar Knowledge level: Intermediate
Nikulsinh Rajput·Oct 1, 2025FP8 + Structured Sparsity: Spend Less, Serve MoreCombine 8-bit floating point with 2:4 sparsity to cut GPU memory and flops — while keeping accuracy and p99s in check.
InAI Simplified in Plain EnglishbyFrank Morales Aguilera·Sep 2, 2025Precision, Power, and the Path to Superintelligence: The Impact of Floating-Point in AIFrank Morales Aguilera, BEng, MEng, SMIEEE
Rshravan·Aug 5, 2025PART 3 — MEMORY… IS THE REAL COMPUTEThis is a dramatized version of how things “may have” unfolded, intended to make core math, engineering concepts, and complicated ideas…A response icon1
