Key Takeaways: The Epistemic Health Checklist
The Big Idea
The Red Flag Scorecard (Ch.31) evaluates individual claims. The Epistemic Health Checklist evaluates the systems that produce claims — a deeper structural assessment of whether a field or organization is capable of self-correction or is structurally stuck.
The 10 Dimensions
| # | Dimension | What It Detects |
|---|---|---|
| 1 | Dissent tolerance | Consensus enforcement / outsider problem |
| 2 | Replication culture | Replication problem |
| 3 | Incentive alignment | Incentive structures manufacturing error |
| 4 | Measurement validity | Streetlight effect / precision without accuracy |
| 5 | Outsider access | Outsider problem / credentialism |
| 6 | Correction speed | Speed of truth / crisis-driven correction |
| 7 | History awareness | Revision myth |
| 8 | Claim falsifiability | Unfalsifiability |
| 9 | Method diversity | Einstellung / imported error |
| 10 | Process transparency | Precondition for all correction |
Interpretation
- Average 7-10: Strong — trust provisionally
- Average 5-7: Mixed — trust with verification
- Average 3-5: Poor — evaluate individual claims with Red Flag Scorecard
- Average 1-3: Critical — default to skepticism
Worked Examples
- Medicine: 6.0/10 — mixed; corrects but slowly
- Nutrition science: 3.1/10 — poor; structurally prone to error persistence
- Software engineering: 6.1/10 — mixed; strong on technical, weak on methodology
Profile Pattern > Average
Specific vulnerabilities produce specific types of error. A field with strong replication (D2) but weak measurement validity (D4) will catch statistical errors but miss validity problems. The pattern tells you what to watch for.
Epistemic Audit — Chapter 32 Addition
Complete the full 10-dimension health profile for your target field. Identify the three lowest-scoring dimensions and design structural interventions.