Arun prakash·Aug 20, 2024Pretraining GPT-2 From ScratchTraining GPT-2 small model from scratch in Hugging Face (with Pytorch backend)A response icon1A response icon1
Arun prakash·Aug 12, 2024Clean Coding in PytorchTraining a deep learning model is a complex task, especially if you want to customize the existing models for your needs. This is a routine…
Arun prakash·May 31, 2022Gradient as a Guide: A Simple GameThe Backpropagation algorithm is the powerhouse of all Deep Learning models. It is one of the methods of efficiently calculating Gradient…
Arun prakash·May 6, 2022Bringing Python to Browser using PyScriptJupyter notebook has always been a de-facto choice when you teach the Python programming language or while developing prototype machine…
Arun prakash·Apr 15, 2022Making Sense of Positional Encoding in Transformer Architectures with IllustrationsAre you wondering about the peculiar use of a sinusoidal function to encode the positional information in Transformer architecture? Are…A response icon3A response icon3