sivakumar·Sep 10Configuring AMD Instinct GPU SR-IOV to Virtualize GPUThis guide explains how to configure AMD GPU virtualization using SR-IOV on Cisco UCS C-Series GPU servers. The configuration creates GPU…
Jatinkumar Parmar·Aug 23Exploring Speculative Decoding in vLLM on AMD GPUsTL;DR: Speculative decoding allows vLLM to verify multiple drafted tokens in a single target-model pass. In our experiments, its effect on…
Inazhar labsbyazhar·Aug 12+4.6% Free GEMM Throughput on MI210: The Triton Gate No One RevisitedTriton ships two scheduling optimizations for AMD GPUs that quietly skip MI210. Not because the hardware can’t use them because the…
InGoPenAIbyJatinkumar Parmar·Aug 2Helion DSL for GPU kernel development and assessment on AMD GPUsAuthor: Charles Yang , jatinkumar parmar Knowledge level: Intermediate
Zecchi Zero·Jul 31Solución al error torch.cuda.is_available()Este artículo documenta cómo solucionar el error OSError: [Errno 28] No queda espacio en el dispositivo y el AttributeError: module 'torch'…
