Parv Bhargava·Aug 14Your LLM Judge Scores 4.2 Out of 5 and Catches NothingA walkthrough of how production evaluation actually fails — with a worked example, the statistics that matter, and the failure modes that…
Amit.Kumar·May 27Testing Non-Deterministic Systems: How to Test Your AI Agent When the Output is Never the SameYour unit tests pass. Your integration tests pass. And then your agent confidently tells a user the wrong thing. Here’s how to actually…
Sundar Ram Subramanian·May 23Multi Agentic Merchandiser | Caught in Flight, Found in TracesIn the last article, we saw the Multi Agentic building blocks of the Multi Agentic Merchandiser. Here, I am sharing the specific failure…
Sundar Ram Subramanian·May 21Agentic AI | Planning & Multi-Agent WorkflowsThis article is about the remaining two patterns: Planning and Multi-agent collaboration.
Saranya Sankar·Mar 30Evals are a PM’s best tool for shaping agent design.If you’re a PM working on AI products and have the opportunity to get involved in evals then take it.
InTowards AIbyDeepak Vadera·Mar 24Evaluating an AI Experimentation Agent for a Marketplace — What OpenAI’s Codex Got Right, What…This is Part 1 of a two-part series. Part 2 will cover online evaluation — live traffic simulation, guardrail monitoring, and experiment…
Agarwal Astha - Lead AI Architect (Microsoft)·Mar 17Your AI Agent Works — Until It Doesn’t: A Practical Guide to Evaluation & Red TeamingPart 1 of 2 — The concepts, architecture, and metrics behind a four-phase evaluation framework for AI agents.
Reelfy·Jan 21The Evaluation Gap: Why Your Agent Tests Are Lying to YouYour tests say your agent works. Its behavior tells a different story.
InAI AdvancesbyDebmalya Biswas·Jan 12Agentic AI Evaluation Strategy & MetricsEvals for AI Agents & ToolsA response icon14A response icon14
InTowards AIbyCharles Thayer·Jan 9AI SW Engineers: You’re Not Prod-Ready Until You Have This(For AI SW Engineers who build agents and prompts)
