Jeremy Zhang·Oct 29From Understanding Diffusion to Making It WorkBuilding a diffusion model taught me that understanding the math was easier than putting the pieces together and making them work.A response icon1A response icon1
Jeremy Zhang·Oct 9Why Can’t Transformers Just Rearrange Their Matrix Multiplications?Linear attention unlocks a matrix multiplication trick that standard attention can't use, but the speedup comes at a cost.A response icon1A response icon1