How to Design Product Experiments

Tools Mentioned

• The Experiment Cards by the Fountain Institute

• Experiment Cards Instructions by Jeff Humble

• The Test Cards by Strategyzer

• A/B Test Calculator by CXL

• Usability Hub, Maze, UX Mining, UserTesting.com for Advanced, Unmoderated User Tests

Recommended Courses

• Designing Product Experiments by the Fountain Institute

• Free Experimentation Short Course by the Fountain Institute

• Free Analytics Courses by Segment

• Free Statistics Course by Cassie Kozyrkov

Articles Mentioned

• The Designer’s Guide to Testing and Experimentation by Jeff Humble

• What is the Double Diamond Design Process Model? by Jeff Humble

• The Myth of the Grand Unified UX Metric (Medium paywall) by Jared Spool

• How To Set Up Hypotheses by Cassie Kozyrkov

• Why Testing Everything Doesn’t Work by Teresa Torres

• How Assumptions Mapping Can Focus Your Teams On Running Experiments That Matter by David J. Bland

• Everything a Designer Needs to Know about Agile by Jeff Humble

• Opportunity Mapping: An Essential Skill for Driving Product Outcomes by Teresa Torres

• Fake Doors MVP by Tomer Sharon

• MVE and MVP: Defining the Difference by Testrail

• A/B Testing Tutorial: From Beginner to Pro in a Blog Post by CXL

• Don’t Do A/B Testing [Rant] by Peep Laja

• 3 Ways to Design Better A/B Tests by Jeff Humble

• Spurious Correlations by Tyler Vigen

• Killed by Google by Cody Ogden

• “Let me show you.” by Jeff Humble

• Principles of Experiment Flow by David J. Bland

• Why These Tech Companies Keep Running Thousands Of Failed Experiments by Ben Clarke (good intro to send your boss)

• Designing Product Experiments, 22 days of live classes to build a Continuous UX Research System

Videos Mentioned

• Is Design Metrically Opposed? by Jared Spool

• Best Practices in Hypothesis Testing by Teresa Torres

• Making Data Useful by Cassie Kozyrkov

• How to Do UX Research Weekly by Jeff Humble

Books Mentioned

• Lean UX by Jeff Gothelf & Josh Seiden

• Continuous Discovery Habits by Teresa Torres

• Testing Business Ideas by David Bland & Alex Osterwalder

• The Power of Experiments: Decision Making in a Data-Driven World by Michael Luca & Max H Bazerman

• Designing with Data by Rochelle King, Elizabeth F. Churchill, and Caitlin Tan

Learn Experimentation in a FREE short course

Get the 5-day email course on Designing Product Experiments and learn how you can level up in data skills for UX innovation work.