InTDS ArchivebyAnish Dubey·Jul 11, 2024Towards Monosemanticity: A Step Towards Understanding Large Language ModelsUnderstanding the mechanistic interpretability research problem and reverse-engineering these large language models
InTDS ArchivebyAnish Dubey·Jul 5, 2024LLM Alignment: Reward-Based vs Reward-Free MethodsOptimization methods for LLM alignmentA response icon1A response icon1
InTowards AIbyAnish Dubey·Jun 26, 2024Compute-efficient Way to Scale LLM — Journey Around Data, Model, and ComputeScaling in AI models requires balancing model parameters, compute resources and data
InTowards AIbyAnish Dubey·Jun 14, 2024Exploration of Parameters-efficient fine tuning methods (LoRA/MoRA/DoRA) in LLMParameter-efficient fine-tuning (PEFT) methods like LoRA, DoRA, and MoRA allow effective learning with fewer parameters
InTDS ArchivebyAnish Dubey·May 29, 2024Flash attention(Fast and Memory-Efficient Exact Attention with IO-Awareness): A deep diveFlash attention is power optimization transformer attention mechanism that provides 15% efficiency
Anish Dubey·Jun 7, 2020Strategic analysis on the rise of spontaneous communication platformsSpontaneous communication is radicalizing the way we communicate or hangout remotely. Due to covid-19, there’s been a surge of people who…
Anish Dubey·Oct 17, 2016Amazon Echo vs Google HomeGoogle just unveiled its voice activated speaker powered by the Google assistant. Its a straight competition to Amazon echo which is…
Anish Dubey·Oct 9, 2016Is Netflix nearing the end of its glory days?Netflix has been one of our favorite online streaming services among Amazon Prime, Hulu and Netflix. Different streaming services focus on…A response icon1A response icon1