Case Study: The Open Science Movement — Dissent That Changed a Field

The Challenge

By 2010, a growing community of psychologists had recognized that the field had serious structural problems: underpowered studies, publication bias toward positive results, researcher degrees of freedom ("p-hacking"), and a culture that rewarded novelty over rigor. The evidence for these problems was strong — but so was the institutional resistance.

The senior researchers whose careers were built on the current system had no incentive to change it. The journals that published exciting, novel findings had no incentive to publish boring, negative replications. The funding agencies that rewarded productivity had no incentive to reward accuracy. The consensus enforcement machine (Chapter 14) was operating at full power.

The Open Science reformers faced a classic dissent problem: how do you change a field's practices when the field's incentive structures actively resist change?

The Strategy

The Open Science movement's strategy was a textbook application of the Seven Principles — not because the reformers had read this book, but because effective dissent strategies converge on the same structural insights.

Principle 1 (Build Allies). The reformers spent years building a coalition before launching their most visible challenges. Brian Nosek founded the Center for Open Science in 2013, creating an institutional base. The Reproducibility Project recruited dozens of researchers from multiple universities. By the time the movement went public, it was a broad coalition — not a handful of complainers.

Principle 2 (Frame as Extension). The reformers framed their work as making psychology more scientific — not as attacking psychology for being unscientific. Pre-registration was presented as "a tool for better research design," not as "proof that your current methods are flawed." This framing allowed researchers to adopt the reforms without admitting their prior work was unreliable.

Principle 3 (Positive Evidence First). Before publishing devastating critiques, the movement published positive tools: the Open Science Framework (a platform for pre-registration and data sharing), guidelines for transparent reporting, and tutorials on better statistical practices. The tools were useful regardless of your position on the replication crisis — which built adoption before the critical message landed.

Principle 4 (One Heresy). The movement focused relentlessly on replicability — a single, well-defined dimension of scientific quality. It did not simultaneously challenge theory, challenge hiring practices, challenge teaching, or challenge funding. One heresy at a time.

Principle 5 (Hold to Values). The movement's most powerful argument was: "Psychology claims to be a science. Science requires replicability. Let's test replicability." This held the field to its own stated values — and the field could not reject the demand without rejecting its identity as a science.

Principle 6 (Inside vs. Outside). The reformers worked primarily from inside — publishing in psychology's own journals, presenting at psychology's own conferences, building tools that psychology's own researchers could use. This was appropriate because psychology's Dissent Tolerance was moderate (not high, but not catastrophically low) and the reformers had sufficient structural protection (tenure, institutional backing).

Principle 7 (Undeniable Evidence). The Reproducibility Project's 2015 results — attempting to replicate 100 published psychology studies and finding that only 36-39% replicated — was the undeniable demonstration. The evidence was too large-scale, too systematic, and too public to be dismissed.

The Outcome

By 2025, psychology had changed more than any other field in response to an internal critique:

• Pre-registration is increasingly standard at top journals
• Registered Reports (where journals commit to publishing results before data are collected) have been adopted by hundreds of journals
• Data sharing is increasingly required
• Replication studies are publishable and valued (though still undervalued relative to novel findings)
• Statistical practices have improved (more attention to effect sizes, confidence intervals, and power)

The change is incomplete — many of the structural incentives that produced the replication crisis remain. But the trajectory is clear, and psychology is arguably the field that has reformed most aggressively in response to its own epistemic failures.

Why This Worked (and What Didn't Transfer)

The Open Science movement succeeded because of specific structural conditions:

1. The evidence was producible. Replication attempts could be conducted and the results were unambiguous — either a study replicated or it didn't. This gave the reformers access to Principle 7 (undeniable evidence).

2. The field had moderate dissent tolerance. Psychology was not criminal justice — dissenters were not destroyed. The credibility tax was real but survivable, especially for tenured researchers.

3. The tools were useful. Pre-registration, data sharing, and transparent reporting were valuable to researchers regardless of their position on the replication crisis. This lowered the adoption barrier.

4. The coalition was broad. The movement was not a single person or a small group — it was a large, international coalition with institutional backing.

These conditions do not exist in every field. Criminal justice has low dissent tolerance, education lacks producible evidence, and nutrition science has entrenched funding conflicts. The Open Science strategy was effective for psychology — but its transferability depends on structural conditions.

Analysis Questions

1. The Open Science movement succeeded using insider reform. Could it have succeeded using outsider challenge (Mode 2) or circumvention (Mode 3)? What would each alternative strategy have looked like?

2. The Reproducibility Project found that only 36-39% of studies replicated. This was undeniable evidence — but the field's response was not uniform. Some senior researchers embraced reform; others resisted or minimized the findings. Apply the institutional grief cycle (Chapter 19): where is psychology in the denial-anger-bargaining-depression-acceptance sequence?

3. Identify a field where the Open Science strategy could be adapted. What modifications would be needed? Which principles would apply directly and which would need to be modified for the new field's structural conditions?