The Measurement Roadmap: How it Works

In this episode of the Ecommerce Playbook podcast, Richard Gaffin and Taylor Holiday discuss measurement roadmaps, a tool used at Common Thread Collective to determine what to test and why, particularly concerning incrementality. They explore how accumulating test results from platforms like Meta provides a range of potential incrementality, helping to establish benchmark factors and understand the possible upside or downside of current measurement approaches. They emphasize the importance of narrowing error bars through continuous testing to achieve a progressively better understanding of truth, even amidst ambiguity. The discussion also covers prioritizing tests based on potential outcome swings, the significance of aligning channel measurement with overall financial reality, and the complexities of trusting incrementality tests, including the impact of Meta on platforms like Amazon.