PinnedInLevel Up CodingbyLuís Tchitue·Aug 24Building an LLM From Scratch — 7/7: Pre-training the modelThis article implements the code that pre-trains our modelA response icon1A response icon1
PinnedInLevel Up CodingbyLuís Tchitue·Aug 19Building an LLM From Scratch — 6/7: Coding The GPT ClassThis article builds the remaining building blocks necessary to put together a GPT-like LLM.A response icon1A response icon1
PinnedInThe AIbyLuís Tchitue·Aug 7Building an LLM From Scratch — 5/7: Adding Causal Masking And DropoutWe will add causal masking and dropout to combat memorization and overfitting.
PinnedInThe AIbyLuís Tchitue·Aug 5Building an LLM From Scratch — 4/7: Building The Multi-head Self-Attention Class In PyTorchThis Article will focus on building the multi-head self-attention mechanism based on the ideas from the last article.
InThe AIbyLuís Tchitue·Jul 15Building an LLM From Scratch — 3/7: Self-Attention MechanismsHaving covered data preparation, we now go on to one of the most important architectural ideas behind modern LLMs — Self-Attention…
InLevel Up CodingbyLuís Tchitue·Jul 13Building an LLM From Scratch — 2/7: Data Preparation (Embeddings)This article covers embeddings — the process of transforming raw text data into a numeric representation appropriate for LLM training.A response icon2A response icon2
InThe AIbyLuís Tchitue·Jul 7Building an LLM From Scratch — 1/7: Mastering the fundamentalsThis article looks into how LLMs function at a high level— from how they are trained to the transformer architecture.A response icon1A response icon1
Luís Tchitue·Feb 17Backpropagation & Gradient Descent: The Learning Engine Of AIThe Simple Procedure That Trains The World’s Most Complex AI SystemsA response icon1A response icon1
InThe AIbyLuís Tchitue·Jul 14, 2025Python For Deep Learning 101 — Part IVariables, Objects, and Types
InThe AIbyLuís Tchitue·Jun 14, 2025Linear Algebra For Deep Learning 101 — Part IVEigendecomposition (continuation).A response icon1A response icon1