Aquib Khan·Jun 28Analog In-Memory Computing: A Dot Product Without a Multiplier.This post, and the follow-up to it, focus on analog in-memory multiply with op-amp accumulation, running the multiply inside the resistive…
Aquib Khan·Jun 13Evolution of Attention [Part 2. Improved Alignment / Attention]In Part 1, we saw how Bahdanau gave the decoder a way to look back — at every step, the alignment model scans all encoder states…
Aquib Khan·Apr 4, 2022PERTPRE-TRAINING BERT WITH PERMUTED LANGUAGE MODEL https://arxiv.org/abs/2203.06906