Exercises: The Humility Chapter

Part A: Comprehension and Application

A.1. Explain why "the feeling of being wrong is identical to the feeling of being right." Why can't you use introspection to detect which of your beliefs are correct and which are wrong?

A.2. Define "metacognitive blindness" and explain why it makes external tools (diagnostic questions, calibration exercises, peer challenge) necessary for error detection.

A.3. Distinguish between epistemic humility and epistemic nihilism using the table from the chapter. Why is the distinction important? What would happen if a reader of this book concluded "I can't know anything"?

A.4. Complete Calibration Exercise 1 (90% confidence intervals) if you haven't already. Report your score. Were you calibrated (approximately 9 out of 10 correct), overconfident (below 7), or underconfident (10 out of 10, with intervals too wide)?

A.5. Describe the three practices for maintaining calibrated uncertainty (Regular Confidence Audit, Pre-Mortem, Surprise Journal). For each, explain the cognitive mechanism it targets and why it improves calibration over time.

Part B: Analysis

B.1. The chapter argues that calibration is a skill, not a personality trait. Evaluate this claim using the evidence from Tetlock's superforecasting research: what do well-calibrated people do differently? Is it cognitive ability, personality, or practice that determines calibration?

B.2. Apply the "What Would Change Your Mind?" test (Exercise 3) to the following beliefs: - (a) Your field's most important practical recommendation - (b) A political belief you hold with high confidence - (c) Your assessment of your own professional competence

For each, specify the evidence that would change your mind. If you cannot, analyze why — is the belief unfalsifiable, or is the evidence simply hard to imagine?

B.3. The chapter identifies a danger: readers might overcorrect from "I know everything" to "I know nothing." Apply the overcorrection framework (Chapter 21): what would "epistemic overcorrection" look like in practice? What would its costs be? How would you detect it?

Part C: Synthesis and Evaluation

C.1. This chapter is the most personal in the book. Evaluate its pedagogical strategy: does experiencing overconfidence (through calibration exercises) change beliefs more effectively than reading about overconfidence? What learning science principles (from the generator framework) does this strategy employ?

C.2. The chapter claims that epistemic humility combines "confidence in methods, humility about conclusions." Evaluate whether this is achievable in practice. Can you trust your methods while doubting your conclusions? What happens when your methods themselves might be flawed (as this book has documented in multiple fields)?

C.3. Apply the Red Flag Scorecard (Chapter 31) to the central claim of this chapter: "You are currently wrong about something important." Score the claim on at least 8 of the 15 questions. Is the chapter's own claim well-supported, or does it trigger red flags?

Part D: Mixed Practice (Interleaved)

D.1. Review your complete Epistemic Audit (accumulated through Chapters 1-34). Identify the three conclusions you are most confident about. For each, apply the "What Would Change Your Mind?" test AND the Red Flag Scorecard. Produce a "humility-adjusted" confidence rating for each conclusion.

D.2. A colleague tells you they've read this book and concluded that they should distrust all expert consensus. Using the epistemic humility vs. epistemic nihilism framework, explain why this conclusion is an overcorrection. What would you recommend instead?