PinnedInThe Ai StudiobyAmrutalohabare·Jun 1Using AI to Find Coverage Gaps in Your Playwright Test SuiteYou can’t see your blind spots from inside your own test suite. Here’s how I use AI to find them.A response icon1A response icon1
PinnedAmrutalohabare·Apr 5Migrating from Selenium to Playwright: Real Challenges Teams Face (and What Actually Works)Migration from Selenium to Playwright is often presented as a straightforward upgrade.A response icon1A response icon1
Amrutalohabare·6h agoI Let an AI Judge My AI. It Disagreed With Itself.Learning to test AI, Session 8 (LLM-as-judge & custom rubrics): two near-identical answers, opposite verdicts, and why the rubric is part…
Amrutalohabare·6d agoTwo Tests Failed. Only One Was the AI’s Fault.Learning to test AI, Session 7 (your first automated eval with promptfoo): 15 tests, two models, one command, and why the score was the…
Amrutalohabare·Nov 1My AI Returned Perfect JSON. Then It Added an Essay.Learning to test AI, Session 6 (structured outputs & output validation): the same prompt, two runs, two formats, and why valid JSON isn’t…A response icon1A response icon1
Amrutalohabare·Oct 26My Chatbot’s Most Dangerous Bug Was Its Most Helpful AnswerLearning to test AI, Session 5 (prompt failure classification): I tested my HR bot against all 8 categories of prompt failure. The critical…
Amrutalohabare·Oct 25The Best Thing My AI Skills Do Is Check Before They ActThree skills, and the step that saves me the most time isn’t the writing.
Amrutalohabare·Oct 17I Told My HR Bot a Lie. It Emailed the Whole Company.Learning to test AI, Session 4: I wrote a “complete” system prompt for an HR bot, then broke it with an unverified claim and a little…
Amrutalohabare·Oct 14AI Tests a Moment. Your Users Live in Time.Every generated test starts clean and finishes in two seconds. Real users don’t work like that.
Amrutalohabare·Oct 13Every AI Chatbot Looks the Same. The Bugs Don’t.Learning to test AI, Session 3: Simple LLM, RAG or agent, and why the type decides what you test first.