PinnedKatherine Oluwadarasimi Olowookere·Oct 3, 2025Barebone Implementation of Every Transformer ComponentThe Transformer brought about a new revolution to the field of AI in 2017. In this introductory blog post I break down each component in…A response icon7A response icon7
Katherine Oluwadarasimi Olowookere·Feb 3How I Wrote FlashAttention-2 from Scratch in Custom Triton KernelsThis is Part 3 of a my three-part blog series on writing efficient Triton kernels from scratch . In Part 1, I introduced FlashAttention…A response icon1A response icon1
Katherine Oluwadarasimi Olowookere·Dec 10, 2025Introduction to GPU Programming with TritonA little house keeping: This blog is an attempt to understand and explain the fundamentals of Triton. This was a quest that started some…A response icon2A response icon2
Katherine Oluwadarasimi Olowookere·Dec 8, 2025Why FlashAttention?On GPU Memory Bandwidth, Tiling and Fused Kernels
Katherine Oluwadarasimi Olowookere·Sep 29, 2025Finding and ablating jailbreak compliance directions in LLMsIn this experiment I investigated whether a “jailbreak compliance direction” exists within the activation space of large language models…