Dina Bavli·4d agoDigital Experiments: The Statistics Were Never the Hard PartEleven parts later, the durable lesson is not a formula. It is how to make a defensible decision before, during and after an experiment.
Jeremy Shapiro·6d agoThe Down-Sell That Made Millions with Jon WebergWhat if ninety percent of the money you spend on marketing is being wasted not because your ads are failing, but because your business is…
Dina Bavli·Nov 3Digital Experiments: When the Treatment Is a Language ModelWhat non-determinism actually changes in an experiment — and what randomization, measurement and causal design still demandA response icon1A response icon1
Dina Bavli·Oct 30Digital Experiments: The Experiment Worked. It Cost $2.5 Billion.From statistical evidence to product decisions: economic significance, Simpson’s paradox, ITT, p-hacking, and the limits of optimization
Dina Bavli·Oct 27Digital Experiments: Can We Trust This Result?The strongest-looking result in the dashboard can still come from an experiment that quietly stopped being the one you designed
Dina Bavli·Oct 23Digital Experiments: How Much Evidence Is Enough?Power, sample size and duration only make sense after you decide what evidence would actually change the decision
Dina Bavli·Oct 20Digital Experiments: You’re Not Testing What You ThinkTreatment design is the contract between what your hypothesis says, what production delivers, and what your analysis eventually claims
Soumabrata Sarkar·Oct 16Innocent Until Proven Significant: A Gentle Intro to Null and Alternative HypothesesStatistics is a field I genuinely love. Unfortunately, the feeling isn’t always mutual. Every now and then, it acts like that one professor…A response icon1A response icon1
Dina Bavli·Oct 16Digital Experiments: Your Control Group Isn’t a Control GroupAssignment mechanisms, interference, and SUTVA — when randomizing by user quietly corrupts what you measured
Sam Austin AI·Oct 15A/B Testing Prompts in Production: A Practical GuideYour new prompt crushed the offline evals. Your team cheered. Then you shipped it, and your resolution rate dropped three points.
