Experiments Illustrated: How Random Assignment Saved Us $1M in Marketing Spend

Author:Murphy  |  View: 21035  |  Time: 2025-03-22 18:36:40

Running cool experiments is easily one of my favorite parts of working in data science.

Most experiments don’t deliver big wins, so the winners make for fun stories. We’ve had a few of these at IntelyCare, and I’m sharing each story in a way that highlights a concept related to experimentation.

And in this post, we’ll share a story about how we avoided doing something stupid by running an experiment first, and using it to discuss the multiple comparisons problem.

Background: IntelyCare hires nurses at scale… and it’s covid

Tags: Data Analysis Experiment Design Marketing Statisitcs Testing Techniques

Comment

Recommend

  • ◦ Applied Python Chronicles: A Gentle Intro to Pydantic
  • ◦ Data Scaling 101: Standardization and Min-Max Scaling Explained
  • ◦ Basics of GANs & SMOTE for Data Augmentation
  • ◦ The Chaos Data Engineering Manifesto
  • ◦ Forecast Multiple Time Series Like a Master
  • ◦ Uncovering the Link Between Municipalities' Influence, Public Health Spending, and PatientR
  • ◦ 7 Steps to Help You Make Your Matplotlib Bar Charts Beautiful
  • ◦ ASCVIT V1: Automatic Statistical Calculation, Visualization and Interpretation Tool
  • ◦ How to Train a Vision Transformer (ViT) from Scratch
  • ◦ How Computers Work: For The Greenhorns Amongst Us.
  • ◦ To Index or Not to Index
  • ◦ Maximizing AI Efficiency in Production with Caching: A Cost-Efficient Performance Booster