Quiz: The Meta-Question

Q1. The chapter applies the Red Flag Scorecard to this book and finds:

(a) No vulnerabilities — the book is perfect (b) 1 red flag, 9 yellow flags, 4 green flags — predominantly uncertain, with genuine vulnerabilities but no major structural red flags (c) 15 red flags — the book is completely unreliable (d) The scorecard doesn't work on books

Answer**(b)** The honest score reveals genuine uncertainties — the framework hasn't been prospectively tested, the example selection is biased toward dramatic vindications, and the scoring tools look more precise than the underlying knowledge warrants — without any major structural red flags.

Q2. Why does the chapter argue that self-critique strengthens rather than weakens the book?

(a) Because it makes the book longer (b) Because a framework that claims immunity from its own analysis is unfalsifiable (Chapter 3), while a framework that honestly identifies its own weaknesses demonstrates that its tools are genuinely applicable — including to itself (c) Because readers enjoy self-criticism (d) Because all books should be self-critical

Answer**(b)** Unfalsifiability is a red flag (Chapter 3). A framework that exempts itself from its own analysis would be structurally suspicious. Honest self-critique demonstrates intellectual integrity and proves the tools are genuinely general-purpose.

Q3. The "survivorship bias in example selection" vulnerability means:

(a) All examples are fabricated (b) The book focuses on cases where dissenters were vindicated, potentially creating the impression that dissenters are usually right — when in fact, most dissenters are wrong and the consensus is more often correct than the example selection suggests (c) The examples are too old (d) More examples are needed

Answer**(b)** By selecting cases where Marshall, Wegener, Hinton, and others were vindicated, the book may overrepresent the rate at which dissenters are correct. The consensus is right far more often than it is wrong.

Q4. The "plausible story problem" applied to this book means:

(a) The book's stories are made up (b) The book may be imposing coherent patterns on diverse historical cases that are superficially similar but structurally different — the narrative may be more satisfying than the evidence warrants (c) The stories are too complicated (d) The book doesn't tell enough stories

Answer**(b)** The plausible story problem (Chapter 6) warns that humans find narrative explanations compelling even when reality is more complex. This book's synthesis — connecting cases across fields through a unified framework — may impose more structure than actually exists.

Q5. The chapter's assessment of "what survives the self-critique" includes:

(a) Everything in the book (b) Nothing — the book is entirely unreliable (c) The core claim (structural failure modes), the tools (as heuristics, not precision instruments), and the design principles (as evidence-derived guidelines) — with qualification that scoring systems should be treated as thinking tools (d) Only the case studies

Answer**(c)** The honest assessment: the core insights survive, the tools are useful heuristics rather than validated instruments, and the reader should apply the same skepticism the book teaches to the book itself.

Q6. "Framework overconfidence" means:

(a) The book is too confident overall (b) The scoring systems (1-10 scales, traffic lights, 15 questions) create an appearance of precision that the underlying knowledge may not support — the tools should be treated as thinking guides, not validated measurements (c) All frameworks are overconfident (d) Confidence is always bad

Answer**(b)** This is precision without accuracy (Chapter 12) applied to the book's own tools. The structured format is useful for organizing thinking but should not be mistaken for empirically validated measurement.

Q7. The "AI author problem" is relevant because:

(a) AI can't write books (b) Readers might evaluate the arguments based on the source (AI) rather than the evidence — either trusting AI too much (authority cascade) or too little (inverse authority cascade) — when the arguments should be evaluated on their merits regardless of authorship (c) AI books are always wrong (d) AI books are always right

Answer**(b)** This is the authority cascade (Chapter 2) operating in real time. The question is not "should I trust AI?" but "does the evidence and reasoning support the conclusions?" — regardless of who or what generated them.

Q8. The chapter's most important conclusion is:

(a) This book is unreliable (b) This book is perfect (c) The reader should apply to this book exactly the skepticism it teaches — treating it as one useful lens, not as the definitive truth, and evaluating its claims on evidence rather than on authority (d) The reader should read a different book

Answer**(c)** The meta-lesson: the tools are for evaluating everything, including this text. A reader who exempts this book from critical evaluation has not understood its central message.

Scoring Guide

  • 7-8 correct: Excellent. You can apply the book's tools to the book itself — the highest-order skill.
  • 5-6 correct: Good. Review the specific vulnerabilities and the "what survives" assessment.
  • Below 5: Re-read the chapter — and consider whether your score reflects genuine confusion or defensive resistance to the self-critique.