Exercises: The Archaeology of Error

These exercises progress from concept checks to challenging applications. Estimated completion time: 2–3 hours.

Difficulty Guide: - ⭐ Foundational (5–10 min each) - ⭐⭐ Intermediate (10–20 min each) - ⭐⭐⭐ Challenging (20–40 min each) - ⭐⭐⭐⭐ Advanced/Research (40+ min each)

Part A: Conceptual Understanding ⭐

A.1. In your own words, explain the difference between an individual cognitive bias and a systemic failure mode. Give one example of each that is NOT drawn from the chapter.

A.2. The chapter argues that the gastroenterologists who resisted Marshall and Warren were "locally rational." What does this mean? Why is it important for understanding structural failure modes?

A.3. A colleague argues: "If we just hired smarter, more honest researchers, we wouldn't have these problems." Using the framework from section 1.2, explain why this response is insufficient. What would you need to change instead?

A.4. List the seven stages of the "lifecycle of a wrong idea." For each stage, write one sentence describing the key mechanism at work.

A.5. The chapter states that "the feeling of being wrong is identical to the feeling of being right." What does this mean in practice? Why does it matter for epistemology?

A.6. Explain why the book's framework is NOT an argument for rejecting expert consensus. What's the difference between structural critique and contrarianism?

Part B: Applied Analysis ⭐⭐

B.1. Choose one of the six anchor examples (peptic ulcers, dietary fat, neural networks, Challenger, Innocence Project, 2008 crisis). Map it to the seven-stage lifecycle. For each stage, identify at least one specific historical detail.

B.2. The chapter argues that individual cognitive biases are "symptoms, not causes" of knowledge failure. Choose a well-known cognitive bias (e.g., confirmation bias, anchoring, availability heuristic) and explain how institutional structures can amplify its effects from an individual quirk to a field-wide failure mode.

B.3. Consider the table comparing individual error and systemic failure (section 1.2). Create three additional rows for a field you know well, following the same format: one column for the individual error, one for the corresponding systemic failure mode.

B.4. The "Active Right Now" section (1.6) lists several areas where failure modes might currently be operating. Choose one and analyze it using the lifecycle framework. Which stage do you think it's in? What evidence supports your assessment?

B.5. The Challenger disaster and the 2008 financial crisis were both preceded by warnings from individuals who were ignored. Compare the two cases: What structural factors caused the warnings to be filtered out in each case? What do the cases have in common?

Part C: Research Design Challenges ⭐⭐–⭐⭐⭐

C.1. Design a study to test whether your own field exhibits any of the structural failure modes described in this chapter. What would you measure? How would you distinguish between healthy skepticism and problematic resistance to new evidence? What are the ethical considerations?

C.2. The lifecycle model predicts that wrong ideas follow a common trajectory. Identify a case (from any field) where the trajectory did not follow the seven-stage pattern. What was different? Does this weaken the model, or does it help us understand the boundary conditions?

C.3. A policy organization asks you to design an "early warning system" that would detect when a field is entering Stage 4 (counter-evidence) or Stage 5 (resistance) of the lifecycle. What indicators would you monitor? What data would you need?

Part D: Synthesis & Critical Thinking ⭐⭐⭐

D.1. The chapter argues that the same structural forces that create wrong consensus also create correct consensus. This creates a fundamental problem: how do you tell the difference in real time? Using only the information from Chapter 1, list at least five questions you might ask to distinguish between a healthy consensus and an entrenched wrong answer. (We'll develop this more formally in Part V.)

D.2. Critique the chapter. Identify at least two potential weaknesses in the book's framework as presented so far. For example: Does the seven-stage lifecycle oversimplify? Does the structural argument underestimate individual responsibility? Is the distinction between "individual error" and "systemic failure" as clean as the chapter suggests? Make your case with specific reasoning.

D.3. The chapter uses the analogy of "swimming in water you can't feel" for the experience of holding beliefs that are wrong. Evaluate this analogy. Where does it illuminate? Where does it mislead? Can you propose a better analogy?

D.4. The ethics section (1.11) argues for "consistency, proportionality, and humility" in applying diagnostic tools. Design a specific scenario in which each of these principles would be violated. What would the violation look like in practice?

Part M: Mixed Practice (Interleaved) ⭐⭐–⭐⭐⭐

Since this is Chapter 1, the interleaved section draws on general knowledge rather than prior chapters. Starting in Chapter 3, this section will integrate material from multiple chapters.

M.1. Think of a time when you changed your mind about something important because of evidence. Describe the experience. Did it follow any of the stages in the lifecycle model? What made you willing to change when others might have resisted?

M.2. Identify a current debate in any field where one side appears to be in Stage 5 (resistance) of the lifecycle. What evidence supports this assessment? What evidence contradicts it? How confident are you?

M.3. The chapter mentions several spiritual predecessors (Kuhn, Kahneman, Popper, etc.). Choose one that you're familiar with and explain how this book's framework differs from or extends their work.

Part E: Research & Extension ⭐⭐⭐⭐

E.1. Historical Investigation. Choose a field not discussed in this chapter and investigate a historical case where the field maintained a wrong consensus for an extended period. Document the case using the seven-stage lifecycle framework. Write a 1,000–2,000 word analysis.

E.2. Comparative Analysis. Select two of the six anchor examples and conduct a detailed comparison. Which failure modes were strongest in each case? Which were absent? What does the comparison reveal about which structural factors matter most?

E.3. Epistemic Audit: First Entry. Begin your Epistemic Audit (the progressive project). Complete the baseline assessment described in the Project Checkpoint (section after 1.10). Then write an additional 500 words analyzing your own confidence levels: Why are you confident about what you're confident about? What structural factors might be creating false confidence?

Solutions

Selected solutions in appendices/answers-to-selected.md. For exercises with rubrics, see instructor-guide/additional-assessments/rubrics.md.