Luan Bui·Oct 5My answer key was wrongI built an eval to catch an agent naming the wrong cause. The first wrong cause it caught was mine.
Luan Bui·Oct 5Six valid dates, all wrongWhat a fixed answer key found in a document pipeline on Azure: a silent locale bug, a “cheap” path that cost three times more, and a review…
Luan Bui·Oct 5A citation is not evidenceI scored a RAG system on whether its answers could be checked, not just whether they were right. The model on its own knew more than half…
Luan Bui·Sep 19Reproducible and wrongI ran six models through the same eval three times each. The two that gave me the same answer every time were the two that were…
Luan Bui·Sep 15An agent’s cost is set by what it can’t answerThree things I measured building AI agents over corpus data, and the one that decides what yours costs to run.
Luan Bui·Jul 28, 2018My top 3 junior mistakes as a product manager in a startup hubWhen you are 8, no one really learns how to ride a bike until you can feel the cold air blowing over your grazed knees & hands as you pedal…