Dineshkumar Anandan·Oct 15, 2025The Quantum Leap: Making AI Models Lightning Fast with GPTQ and AWQ QuantizationThe Problem: When Your GPU Can’t Keep Up
Nikulsinh Rajput·Sep 18, 2025Quantization Without Tears: QLoRA vs AWQ vs GPTQCut VRAM, keep quality. A plain-English guide with working code and trade-offs that actually matter.
Doil Kim·May 13, 2025Speeding Up Large Language Models: A Deep Dive into GPTQ and AWQ QuantizationA Practical Guide to Reducing Model Size Without Sacrificing Performance
InByte-Sized AIbyDon Moon·Dec 5, 2024[vLLM — Quantization] AWQ: Activation-aware Weight Quantization for LLM Compression and…In this blog, we explore AWQ, a novel weight-only quantization technique integrated with vLLM. Quantization reduces the bit-width of model…
InTowards AIbyAllohvk·Oct 19, 2024LLM Quantization — From concepts to implementationGPTQ, AWQ, GGML intuitively explained
InGoPenAIbykirouane Ayoub·Aug 22, 2024Exploring Bits-and-Bytes, AWQ, GPTQ, EXL2, and GGUF Quantization Techniques with Practical Examples1. Bits-and-Bytes Quantization
Aruna Kolluru·May 14, 2024Mastering Quantization Techniques for Optimizing Large Language ModelsIn recent years, the field of artificial intelligence has seen significant advancements, particularly in natural language processing (NLP)…
![[vLLM — Quantization] AWQ: Activation-aware Weight Quantization for LLM Compression and…](https://miro.medium.com/v2/resize:fill:160:106/1*hHZsGBPcAzqk72RKFgvObg.png)
![[vLLM — Quantization] AWQ: Activation-aware Weight Quantization for LLM Compression and…](https://miro.medium.com/v2/resize:fill:320:214/1*hHZsGBPcAzqk72RKFgvObg.png)
