What is Bias Against Null Results?

Bias Against Null Results is a mental model used for better thinking and decision-making.

How do you apply Bias Against Null Results?

To apply Bias Against Null Results, identify situations where this framework is relevant, then use it as a lens to evaluate your options and decisions. The model is most useful when combined with other complementary mental models.

What category does Bias Against Null Results fall under?

Bias Against Null Results falls under the General Thinking & Meta-Models category of mental models. Other models in this category can be found on the General Thinking & Meta-Models hub page.

Why is Bias Against Null Results important?

Bias Against Null Results is important because it provides a structured way to think about problems that would otherwise be approached with intuition alone. Understanding this model helps you avoid common reasoning errors and make better decisions.

Bias Against Null Results Mental…

Bias Against Null Results Mental… | Faster Than Normal

Section 2

How to See It

Research & Testing

You're seeing it when only positive A/B test results get shared in team updates. The experiments that showed no effect — often the majority — are quietly dropped, and the organisation learns nothing from them.

Strategy & Decision-Making

You're seeing it when a team tries three strategies, one works, and the retrospective only discusses the winner. The two that failed are treated as wasted effort instead of useful evidence about what doesn't work.

Section 3

How to Use It

Institutionalise learning from null results. Require teams to document and share experiments that showed no effect, not just wins. In decision-making, ask "what did we try that didn't work, and what does that tell us?" Treat null results as map updates — they narrow the search space and prevent others from repeating dead-end experiments.

Decision filter

"Are we only hearing about what worked? What experiments showed no effect, and what do those null results tell us about where to look next?"

As a founder

Build a culture that values null results. Share failed experiments in all-hands alongside wins. Make "what didn't work" a standing section in retrospectives. This prevents repeated dead-end work and accelerates learning.

Section 5

Founders & Leaders

Marie CuriePhysicist; Nobel laureate; pioneer of radioactivity research

Curie's research was defined by rigorous experimentation — including hundreds of tests that showed no effect before isolating radium. She treated every null result as evidence that narrowed the search space rather than as failure. Founders can apply this by building systematic experiment logs where null results are documented and shared. When your team runs twenty tests and three move the needle, the seventeen that didn't are just as valuable — they tell you where the signal isn't. Stop burying nulls. Start learning from them.

Section 7

Connected Models

Reinforces

Publication Bias

Publication bias is the systemic version — journals and organisations preferentially publish positive results. Bias against null results is the individual and cultural version. Together they create a world where the evidence base over-represents effects.

Reinforces

Confirmation Bias

We seek evidence that confirms our beliefs. Null results disconfirm — so we dismiss or ignore them. Confirmation bias is the psychological engine that drives bias against null results.

Leads-to

Replication Crisis

When null results go unpublished and positive results are over-represented, the evidence base becomes unreliable. Bias against null results is a root cause of the replication crisis — false positives persist because the nulls aren't visible.

Section 8

One Key Quote

"Negative results are not failures. They are the map of where the treasure isn't — and that map is essential to finding where it is."
— John Ioannidis, on research methodology

Section 11

Summary & Further Reading

Bias against null results: we systematically ignore findings that show no effect. Counter it by institutionalising learning from nulls — document, share, and use them to narrow the search space. What didn't work is as informative as what did.

Why Most Published Research Findings Are False — John Ioannidis (2005)

Paper

The landmark paper on how publication bias and positive-result preference distort science.

The Book of Why — Judea Pearl (2018)

Book

How causal reasoning and proper experimental design reduce the bias toward spurious positive findings.

Bias Against Null Results

Continue exploring

Popular Mental Models

Core Idea

How to See It

How to Use It

Founders & Leaders

Connected Models

One Key Quote

Summary & Further Reading

This connects to...

Continue exploring

Popular Mental Models

More like this, in your inbox

Core Idea

How to See It

How to Use It

Founders & Leaders

Connected Models

One Key Quote

Summary & Further Reading

This connects to...