InTheBroadsideBulletinbyBen Meehan·Nov 8vLLM Crash Course Part 2 — Serving Our First ModelIn the last part, we looked at why serving an LLM is more complicated than it might seem. Models generate one token at a time…
InTheBroadsideBulletinbyBen Meehan·Nov 1vLLM Crash Course Part 1 — Why LLM Serving Is HardLet’s say we start working with large language models, almost all of the attention goes to training. Training is the expensive. It needs…A response icon1A response icon1
Ben Meehan·Jun 30Semantic Deduplication with OpenAI Embeddings and pgvectorApplications that process large amounts of text often run into duplicate content. While exact duplicates are easy to detect using hashes…
Ben Meehan·Apr 24How Kafka Achieves High Performance Even on Hard DisksDisk-based design, when done right, can sometimes outperform memory-first systems.
Ben Meehan·Mar 6Golang Crash Course Part 10 — Observability and Distributed TracingWhen you run a backend service locally, debugging is easy. You can print logs, step through the code with a debugger, and see exactly what…
Ben Meehan·Jan 9Comparision Timing Attacks: Common Pitfalls and PreventionTiming attacks are a class of side-channel attacks where an attacker learns sensitive information by measuring how long an operation takes…
Ben Meehan·Nov 14, 2025Designing Microservices Without Losing Local DevelopmentThe moment a service can only run inside a full cluster, the team loses the fastest feedback loop they have.
Ben Meehan·Nov 9, 2025Distributed Algorithms Crash Course — Part 4: Byzantine Fault ToleranceIn the previous part of this series, we explored Paxos, a protocol that achieves consensus even when nodes fail, crash, or restart…
Ben Meehan·Nov 4, 2025Distributed Algorithms Crash Course Part 3 — Paxos Consensus AlgorithmThe Paxos consensus algorithm is one of the earliest and most influential distributed consensus protocols, proposed by Computer Scientist…
Ben Meehan·Nov 1, 2025Understanding Change Data Capture (CDC): The Backbone of Real-Time Data SystemsModern software systems generate and consume massive volumes of data at every moment from financial transactions and IoT sensor readings to…