PinnedShriom Tripathi·Jun 10llama.cpp: CPU Inference for LLMs on Consumer HardwareWhy CPU Inference on Consumer Hardware Works Now (And Why It Shouldn’t)
PinnedShriom Tripathi·Jun 8PyTorch 100B Training: Memory & Parallelism ArchitectureParallelism Is Not About Speed, It’s About Memory Architecture
Shriom Tripathi·Aug 12GEM at LLM Scale: Meta Doubled Training Efficiency by Fighting One NumberThe Core Insight: Twenty to twenty-five percent Model FLOPs Utilization reads like a failing grade next to the forty-plus percent a dense…
Shriom Tripathi·Aug 8Two-Sided RDMA Strikes Back: Why Disaggregated Memory Databases Are Rethinking the One-Sided…The Core Insight: The one-sided versus two-sided RDMA argument was never really about bypassing the remote CPU. It was about key…
Shriom Tripathi·Jun 5Zero-Growth Stack, Real Gains: How Stack Allocation Can Save 10% CPU in GoGC CPU is not spent at collection time; it is pre-purchased at allocation time. The only allocation that costs nothing is the one escape…
Shriom Tripathi·Jun 4Beyond Prediction: Solving the Multiple Knapsack Problem at ScaleA better prediction only raises the ceiling on value; the Multiple Knapsack solver is what captures it. Because the multiple-knapsack....
Shriom Tripathi·Jun 3Scaling Real-Time Traffic Forecasting with a Graph-Aware TransformerA graph-aware transformer is accurate because it lets every point in the road network influence every other; that same global ......
Shriom Tripathi·Jun 2How Uber Conquered Database Overload: From Static Rate-Limiting to Intelligent Load ManagementA static rate limit is a guess frozen in time; durable overload protection replaces the guess with a feedback loop — stop counting…
Shriom Tripathi·Jun 1Zero-Scan Data Quality: Your Table Format Already Knows If the Data Is BrokenHere is a scene that repeats itself in every mature data platform. A nightly job lands a few hundred gigabytes into a partition of an…A response icon1A response icon1
Shriom Tripathi·May 31Ring-Buffer Shuffle: Why Parallel Queries Stall on Coordination, Not DataThere is a particular kind of performance bug that humbles experienced engineers, because the fix you reach for makes it worse. You have a…