Neeraj Kushwaha·Jul 17Day 16: The Economics of AI — Cost Optimization for Engineers“The best AI engineer isn’t the one who builds the most powerful system. It’s the one who builds a system that’s powerful enough and cheap…
Neeraj Kushwaha·Jul 12Day 15: Vector Databases — The Memory Layer of AI Applications“If embeddings are the language AI thinks in, vector databases are the long-term memory it thinks with.” — Pinecone Engineering Blog, 2024
Neeraj Kushwaha·Jul 11Day 14: Understanding AI Hallucination — Causes, Patterns & Defenses“A language model is not a database. It is a probability distribution over tokens, trained to be plausible — not truthful. Plausibility and…
Neeraj Kushwaha·Jul 11Day 13: Small Language Models (SLMs) — Phi, Gemma, and On-Device AI"A 4B model trained on textbooks beats a 70B model trained on the internet — not because it's smarter, but because what you learn matters…
Neeraj Kushwaha·Jul 8Day 12: Mixture-of-Experts (MoE) Architecture“Why activate the entire brain for every thought? MoE asks the right specialists and leaves the rest sleeping — that’s how you scale to a…
Neeraj Kushwaha·Jul 8Day 11: AI Reasoning Models: o3, Claude Sonnet Thinking, Gemini Thinking“Standard models answer. Reasoning models think before they answer. The difference isn’t vocabulary — it’s the willingness to be wrong…
Neeraj Kushwaha·Jun 18Day 10: Context Windows — The Key Architectural Constraint“Context is not just memory. It is the entire universe the model can see. Everything outside the window does not exist.”
Neeraj Kushwaha·Jun 14Day 9: LLM Inference Fundamentals — Temperature, Top-P, and Sampling“The difference between a poet and a fact-checker isn’t intelligence — it’s entropy. Temperature is how you dial between the two.”
Neeraj Kushwaha·Jun 7Day 8: Running LLMs Locally with Ollama & LM Studio“The most powerful AI model is the one you fully control — running on your own hardware, your own network, with your own data never leaving…
Neeraj Kushwaha·May 30Day 7 — Setting Up Your AI Engineering Environment“A craftsman is only as good as their tools — and their discipline in maintaining them. Your development environment is the foundation of…