Skip to content
Faster Than Normal
General Thinking & Meta-Models

Bias Against Null Results

Model #0722Category: General Thinking & Meta-ModelsDepth to apply:

By Updated 2 sources

4 min read

Contents

  1. 1. Core Idea
  2. 2. How to See It
  3. 3. How to Use It
  4. 4. Founders & Leaders
  5. 5. Connected Models
  6. 6. One Key Quote
  7. 7. Summary & Further Reading
General Thinking & Meta-Models
Section 1

Core Idea

Bias against null results is the systematic tendency to undervalue, ignore, or suppress findings that show no effect. Journals prefer "positive" results (something happened); teams prefer experiments that "worked." The consequence: the information base is skewed toward effects and away from non-effects, even though knowing what doesn't work is equally valuable. For founders, this bias hides critical signal — failed experiments, features that didn't move metrics, and strategies that had no impact get buried instead of learned from. Null results are data. Ignoring them is ignoring half the map.

Get Faster Than Normal by email

Ideas from founders and companies.

Free newsletter. Unsubscribe anytime.

Or open the full subscribe page.

Section 2

How to See It

Research & Testing
You're seeing it when only positive A/B test results get shared in team updates. The experiments that showed no effect — often the majority — are quietly dropped, and the organisation learns nothing from them.
Strategy & Decision-Making
You're seeing it when a team tries three strategies, one works, and the retrospective only discusses the winner. The two that failed are treated as wasted effort instead of useful evidence about what doesn't work.
Section 3

How to Use It

Institutionalise learning from null results. Require teams to document and share experiments that showed no effect, not just wins. In decision-making, ask "what did we try that didn't work, and what does that tell us?" Treat null results as map updates — they narrow the search space and prevent others from repeating dead-end experiments.
Decision filter
"Are we only hearing about what worked? What experiments showed no effect, and what do those null results tell us about where to look next?"
As a founder
Build a culture that values null results. Share failed experiments in all-hands alongside wins. Make "what didn't work" a standing section in retrospectives. This prevents repeated dead-end work and accelerates learning.
Section 5

Founders & Leaders

Marie CuriePhysicist; Nobel laureate; pioneer of radioactivity research
Curie's research was defined by rigorous experimentation — including hundreds of tests that showed no effect before isolating radium. She treated every null result as evidence that narrowed the search space rather than as failure. Founders can apply this by building systematic experiment logs where null results are documented and shared. When your team runs twenty tests and three move the needle, the seventeen that didn't are just as valuable — they tell you where the signal isn't. Stop burying nulls. Start learning from them.
Section 7

Connected Models

Reinforces
Publication Bias
Publication bias is the systemic version — journals and organisations preferentially publish positive results. Bias against null results is the individual and cultural version. Together they create a world where the evidence base over-represents effects.
Reinforces
Confirmation Bias
We seek evidence that confirms our beliefs. Null results disconfirm — so we dismiss or ignore them. Confirmation bias is the psychological engine that drives bias against null results.
Leads-to
Replication Crisis
When null results go unpublished and positive results are over-represented, the evidence base becomes unreliable. Bias against null results is a root cause of the replication crisis — false positives persist because the nulls aren't visible.
Section 8

One Key Quote

"Negative results are not failures. They are the map of where the treasure isn't — and that map is essential to finding where it is."
— John Ioannidis, on research methodology
Section 11

Summary & Further Reading

Bias against null results: we systematically ignore findings that show no effect. Counter it by institutionalising learning from nulls — document, share, and use them to narrow the search space. What didn't work is as informative as what did.
01
Why Most Published Research Findings Are False — John Ioannidis (2005)
Paper
The landmark paper on how publication bias and positive-result preference distort science.
02
The Book of Why — Judea Pearl (2018)
Book
How causal reasoning and proper experimental design reduce the bias toward spurious positive findings.

Why this matters next

mental modelsConfirmation Bias

Bias Against Null Results applied the Confirmation Bias mental model

mental modelsScientific Method

Bias Against Null Results applied the Scientific Method mental model

mental modelsP-hacking

Bias Against Null Results applied the P-hacking mental model

mental modelsPublication Bias

Bias Against Null Results applied the Publication Bias mental model

mental modelsReplication Crisis

Bias Against Null Results applied the Replication Crisis mental model

mental modelsBias Against Null Results

Bias Against Null Results applied the Bias Against Null Results mental model

Frequently asked questions

What is Bias Against Null Results?

Bias Against Null Results is a mental model used for better thinking and decision-making.

How do you apply Bias Against Null Results?

To apply Bias Against Null Results, identify situations where this framework is relevant, then use it as a lens to evaluate your options and decisions. The model is most useful when combined with other complementary mental models.

What category does Bias Against Null Results fall under?

Bias Against Null Results falls under the General Thinking & Meta-Models category of mental models. Other models in this category can be found on the General Thinking & Meta-Models hub page.

Why is Bias Against Null Results important?

Bias Against Null Results is important because it provides a structured way to think about problems that would otherwise be approached with intuition alone. Understanding this model helps you avoid common reasoning errors and make better decisions.

Continue exploring

5W

Mental model

5 Whys

A root-cause analysis technique that drills past symptoms by asking why five suc

AW

Mental model

All Models Are Wrong

George Box s insight that every model is a simplification of reality — the quest

AL

Mental model

Amara's Law

We tend to overestimate the effect of a technology in the short run and underest

EM

Mental model

Eisenhower Decision Matrix

A prioritization framework that sorts tasks into four quadrants based on urgency

FT

Mental model

First Principles Thinking

Breaking down complex problems to their most fundamental truths, then reasoning

GL

Mental model

Goodhart's Law

When a measure becomes a target, it ceases to be a good measure — incentives shi

Get Faster Than Normal by email

Ideas from founders and companies.

Free newsletter. Unsubscribe anytime.

Or open the full subscribe page.

Popular Mental Models

First Principles ThinkingOccam's RazorCircle of CompetenceInversionConfirmation BiasSecond-Order ThinkingDunning-Kruger EffectSurvivorship BiasPareto PrincipleOpportunity Cost