What is Controlled Placebo?

Controlled Placebo is a mental model used for better thinking and decision-making.

How do you apply Controlled Placebo?

To apply Controlled Placebo, identify situations where this framework is relevant, then use it as a lens to evaluate your options and decisions. The model is most useful when combined with other complementary mental models.

What category does Controlled Placebo fall under?

Controlled Placebo falls under the General Thinking & Meta-Models category of mental models. Other models in this category can be found on the General Thinking & Meta-Models hub page.

Why is Controlled Placebo important?

Controlled Placebo is important because it provides a structured way to think about problems that would otherwise be approached with intuition alone. Understanding this model helps you avoid common reasoning errors and make better decisions.

Controlled Placebo Mental Model…

Controlled Placebo Mental Model… | Faster Than Normal

Section 2

How to See It

Product & Growth

You're seeing the need for controlled placebo when a new feature launches and metrics improve — but you didn't run a holdout group. The improvement might be the feature, or it might be seasonality, novelty effect, or a concurrent change.

Team & Culture

You're seeing it when a new management practice is introduced and morale improves. Without a control (a team that didn't get the practice), you can't attribute the change to the intervention — the Hawthorne effect alone can lift results.

Section 3

How to Use It

Whenever you want to know if something actually works, build a control. In product: A/B test with a holdout. In process: pilot the change with one team while another continues the old way. In hiring: compare outcomes for candidates from the new process against the old. The control doesn't need to be perfect — it needs to be present. Without it, you're measuring belief, not effect.

Decision filter

"Did we test this against a proper control, or are we attributing results to the intervention without isolating the effect?"

As a founder

Default to controlled tests for any material change — features, pricing, processes, campaigns. A holdout group is cheap insurance against false positives. When the team says "it's working," ask: compared to what?

Section 5

Founders & Leaders

Anna WojcickiCo-founder and CEO, 23andMe

Wojcicki built 23andMe at the intersection of genetics and consumer health — a domain where controlled studies are foundational. She brought clinical-trial rigour to a consumer company, insisting on evidence standards that separated real genetic signal from noise. Founders can apply this mindset to any business decision: run the controlled test before declaring victory. When you launch a feature, change pricing, or try a new process, compare against a control. The discipline to ask "compared to what?" prevents the most common error in startup decision-making — attributing results to your intervention when they would have happened anyway.

Section 7

Connected Models

Reinforces

Randomized Controlled Experiment

The controlled placebo is a component of the RCT — the gold standard for causal inference. RCTs use randomisation plus a placebo control to isolate effects. The placebo control is the baseline that makes the experiment valid.

Tension

Placebo Effect

The placebo effect is why you need a controlled placebo — belief alone can produce real results. The tension: if the placebo "works," is the intervention necessary? The control tells you whether you're adding real value beyond expectation.

Leads-to

Confounding Factor

Without a control, confounding factors hide in your results. Controlled placebos are the primary tool for exposing confounds — if both groups experience the same context but different interventions, confounds are neutralised.

Section 8

One Key Quote

"The gruesome tally of the past teaches us one thing above all: without a proper control, we do not know what we have done."
— Austin Bradford Hill, pioneer of the randomised clinical trial

Section 11

Summary & Further Reading

Controlled placebo: to know if something works, compare it against a baseline that lacks the active ingredient. Without a control, you're measuring expectation and noise, not effect. Default to controlled tests for material business decisions.

Bad Science — Ben Goldacre (2008)

Book

Accessible treatment of why controls and placebos matter in separating truth from noise.

Trustworthy Online Controlled Experiments — Ron Kohavi et al. (2020)

Book

Rigorous guide to A/B testing and controlled experiments in tech.

Controlled Placebo

Continue exploring

Popular Mental Models

Core Idea

How to See It

How to Use It

Founders & Leaders

Connected Models

One Key Quote

Summary & Further Reading

This connects to...

Continue exploring

Popular Mental Models

More like this, in your inbox

Core Idea

How to See It

How to Use It

Founders & Leaders

Connected Models

One Key Quote

Summary & Further Reading

This connects to...