Joy Bose·Mar 17What I Built in 2007, and Why It Looks a Bit Like a TransformerA retrospective on my PhD thesis on spiking neural sequence machines, and some similarities with modern LLM architectures
Robert McMenemy·Oct 9, 2024Mastering Machine Learning with Hyperdimensional Computing, Reservoir Computing and Sparse…Introduction
InProject AGIbyAbdelrahman Ahmed·Feb 28, 2019Optimization using Adam on Sparse TensorsAdaptive optimization methods, such as Adam and Adagrad, maintain some statistics over time about the variables and gradients (e.g…
