Exercises: Building Better Knowledge Systems
Part A: Comprehension and Application
A.1. Define the difference between a self-correcting institution and a self-protecting institution. Give one example of each from Part IV's field autopsies.
A.2. List the seven design principles for self-correcting institutions. For each, identify the primary failure mode it targets and one concrete implementation example.
A.3. Explain the "self-correction illusion." Why does every institution believe it self-corrects? Why is this belief partially true and substantially misleading?
A.4. Define "correction fragility" and identify four specific mechanisms by which self-correcting structures can erode over time. For each, provide an example from the book.
A.5. Walk through the six-step Institutional Reform Template. For each step, identify which chapter's tools or frameworks it draws upon.
Part B: Analysis
B.1. Apply all seven design principles to evaluate your own institution (or field). Score each principle on a 1-10 scale (1 = completely absent, 10 = fully implemented). Which principles are strongest? Which are weakest? How does this profile compare to the Epistemic Health Checklist profile you completed in Chapter 32?
B.2. The chapter argues that Principle 2 (Incentive Alignment) is the most important principle because "incentives determine behavior, and behavior determines outcomes, regardless of stated values." Evaluate this claim. Are there cases where institutional values override misaligned incentives? Or do incentives always win?
B.3. Design a "correction celebration" program (Principle 6) for your organization. What would it look like in practice? What specific corrections would be celebrated? How would you overcome the cultural resistance to celebrating what has traditionally been seen as failure?
B.4. The self-correction illusion is particularly dangerous because it is partially true — institutions do correct, just slowly and incompletely. Design a test that would distinguish between genuine self-correction and the self-correction illusion. What evidence would show that an institution's correction mechanisms are adequate vs. inadequate?
Part C: Synthesis and Evaluation
C.1. Complete the full Institutional Reform Template (§37.3) for your field. This is the capstone exercise of Part V — produce a document that diagnoses the problem, proposes a structural change, analyzes the resistance, and monitors for overcorrection.
C.2. The seven design principles are derived from the failure modes. Could a different analysis — starting from different failure modes or different case studies — produce different design principles? Are the seven principles universal, or are they contingent on the specific cases examined in this book?
C.3. The chapter warns that self-correction is fragile and requires continuous investment. Is there a design that makes self-correction robust — resistant to erosion even without continuous attention? Or is fragility an inherent feature of any correction mechanism? Argue both sides.
Part D: Mixed Practice (Interleaved)
D.1. You are advising a newly founded research institute. Using all seven design principles, the Epistemic Health Checklist (Chapter 32), and the nine tools (Chapter 34), design the institute's foundational structures. Specify: hiring criteria, funding model, publication policy, error-handling protocol, leadership selection, and review mechanisms. For each structural choice, identify which failure mode it addresses and which overcorrection risk it carries.
D.2. A government regulatory agency (e.g., a food safety authority, an environmental protection agency, a financial regulator) asks you to assess its epistemic health and propose reforms. The agency has been criticized for being "captured" by the industry it regulates. Apply the full toolkit from Part V: diagnose with the Checklist, score key claims with the Red Flag Scorecard, identify dissent suppression with the Seven Principles framework, propose tools from Chapter 34, and design a reform proposal using this chapter's template.