Chapter 15: Exercises
Comprehension Check
1. Describe three cognitive biases that have survived the replication crisis with strong evidence. For each, explain what the bias is and why it's robust.
2. Describe two famous cognitive bias findings that failed to replicate or substantially shrank. What does this tell you about the "humans are irrational" narrative?
3. Explain Gigerenzer's ecological rationality perspective. How does it challenge the standard "biases = errors" framework?
4. What is the difference between a "bias" and an "adaptive heuristic"? Can the same cognitive process be both?
5. Why does knowing about cognitive biases have limited effect on overcoming them? What interventions are more effective?
Application
6. Find a "cognitive bias" poster or infographic that lists 100+ biases. Apply the toolkit to five specific biases listed: - Is there replication evidence for each? - Is it a well-established finding or a one-study curiosity? - Could it be reframed as an adaptive heuristic rather than an error?
7. Identify one decision you made recently that might have been influenced by a cognitive bias (confirmation bias, sunk cost, anchoring, etc.). Then consider: was the heuristic actually adaptive in that context? Did it lead to a bad outcome, or did it work well enough?
8. Find a corporate "unconscious bias training" program. Apply the toolkit: - What does the training claim to achieve? - What does the research on debiasing show about the effectiveness of awareness-based training? - Is the IAT used? What are its psychometric limitations?
9. Apply the ecological rationality lens to three common "biases": - Availability heuristic: when is "judging frequency by ease of recall" actually a good strategy? - Recognition heuristic: when is "choosing the option you recognize" actually wise? - Status quo bias: when is "sticking with what you have" actually rational?
10. Test your own confirmation bias: choose a belief you hold strongly. Spend 15 minutes deliberately searching for evidence AGAINST it. How easy or difficult was this? What did you find?
Critical Thinking
11. Kahneman's Thinking, Fast and Slow became one of the bestselling science books ever. Some of the findings it presents have since failed to replicate. Should the book include a revised edition with updated evidence? How should science popularizers handle the replication crisis?
12. The "bias bias" — seeing irrationality everywhere — is itself a framing effect. Is this a genuine criticism, or is it a way of dismissing legitimate concerns about human cognitive limitations?
13. If many cognitive biases are adaptive heuristics that work well in typical environments, what happens when the environment changes dramatically (as with social media, information overload, and algorithmic content)? Do previously adaptive heuristics become genuinely harmful in novel environments?
14. The IAT has poor test-retest reliability and weak predictive validity for behavior, yet it remains central to many diversity training programs. Should organizations continue using it? What would an evidence-based approach to reducing discrimination look like?
15. Mercier and Sperber argue that reasoning evolved for social argument, not truth-seeking. If this is true, what are the implications for critical thinking education? Can we train people to use reasoning for truth-seeking even if it didn't evolve for that purpose?
Fact-Check Portfolio
16. If any of your 10 claims involve cognitive biases, decision-making, or human rationality: - Has the specific bias been replicated post-crisis? - Is the claim using the "blanket irrationality" framing or acknowledging adaptive functions? - Does the claim assume that awareness alone reduces bias? - Update your evidence rating.