Show Notes
- Amazon USA Store: https://www.amazon.com/dp/1108724264?tag=9natree-20
- Amazon Worldwide Store: https://global.buys.trade/Trustworthy-Online-Controlled-Experiments-Ron-Kohavi.html
- Apple Books: https://books.apple.com/us/audiobook/scientific-method-and-critical-thinking-master/id1817592032?itsct=books_box_link&itscg=30200&ls=1&at=1001l3bAw&ct=9natree
- eBay: https://www.ebay.com/sch/i.html?_nkw=Trustworthy+Online+Controlled+Experiments+Ron+Kohavi+&mkcid=1&mkrid=711-53200-19255-0&siteid=0&campid=5339060787&customid=9natree&toolid=10001&mkevt=1
- Read more: https://english.9natree.com/read/1108724264/
#Randomizedcontrolledexperiments #Sampleratiomismatch #Statisticalpowercalculations #Guardrailmetrics #Experimentationculture #TrustworthyOnlineControlledExperiments
Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing is a technical and managerial guide to designing, running, and interpreting online randomized controlled experiments. Written by Ron Kohavi, Diane Tang, and Ya Xu, it draws on experience with experimentation programs at major technology companies and addresses the realities of testing changes on websites, applications, and digital services. Its purpose is not merely to explain how to compare a treatment with a control. Instead, it shows why apparently simple A/B tests can produce misleading results when assignment, instrumentation, metrics, statistical inference, or organizational processes are weak. The book combines foundations of causal experimentation with operational advice for teams that must make product decisions quickly and repeatedly. It treats experimentation as an institutional capability: reliable results require sound methodology, automated quality checks, shared metrics, and a culture willing to accept evidence that challenges intuition. The central standard is trustworthiness, meaning that a reported effect should be credible enough to support a real decision rather than simply pass a statistical threshold.