Sudheer Singh·Feb 26, 2025Flash Attention: Making Transformers FasterThe Transformer architecture, introduced in the paper Attention Is All You Need, has revolutionized AI, enabling state-of-the-art models…
Sudheer Singh·Feb 18, 2025Tackling Latency with Request HedgingImagine you’re trying to load your favorite news website, but the page seems to take forever. Frustrated, you open a new browser tab and…