Manish Immadisetty·Nov 5Yet Another Inference Engineering Blog: A Tour of the Whole Serving StackYes, I know I know one more blog about AI, but my only purpose for the next 20 minutes is to get you excited about something maybe…
Manish Immadisetty·Jul 1Building an HTTP server three times, from the socket down to the wireWhat this actually is
Manish Immadisetty·Jun 10I Built an LLM Inference Engine on a 15 year old GPU and the Math was the Easy PartThere’s a fun lie that gets talked about AI engineering, that the hard part is the machine learning. The math. The architecture. The loss…A response icon1A response icon1