Chapter 37: Further Reading
This reading list is organized by the 3-tier citation system introduced in Section 1.7. Tier 1 sources are verified and directly cited in or relevant to the chapter's core arguments. Tier 2 sources are attributed to specific authors and widely discussed in the relevant literature but have not been independently verified at the citation level for this text. Tier 3 sources are synthesized from general knowledge and multiple unspecified origins. All annotations reflect our honest assessment of each work's relevance and quality.
Tier 1: Verified Sources
These works directly inform the arguments and examples in Chapter 37. They are well-established publications whose claims have been independently confirmed.
Nassim Nicholas Taleb, The Black Swan: The Impact of the Highly Improbable (2007)
The book that introduced the concept of "silent evidence" to a wide audience. Taleb argues that survivorship bias is one of the principal mechanisms by which we systematically misunderstand risk, success, and history. His treatment of the drowned sailors, the silent graveyard, and the structural impossibility of learning from evidence that has been destroyed by the process under study provides the theoretical backbone of this chapter's argument. The Black Swan is polemical, digressive, and sometimes deliberately provocative, but its core insights about silent evidence are original and important.
Relevance to Chapter 37: Taleb's concept of silent evidence provides the formal framework for Section 37.8 and the threshold concept. His examples -- the drowned sailors, the silent graveyard of failed businesses, the invisible risk takers who were destroyed by the risks they took -- are the conceptual foundation on which this chapter's cross-domain analysis is built.
Best for: Readers interested in risk, probability, and the structural limits of empirical knowledge. Taleb's writing style is distinctive and not to everyone's taste, but the ideas repay the effort.
Nassim Nicholas Taleb, Fooled by Randomness: The Hidden Role of Chance in Life and in the Markets (2001)
Taleb's earlier and more focused treatment of survivorship bias, particularly as it operates in financial markets. The book argues that much of what we attribute to skill in investing, business, and life is actually the result of chance -- and that survivorship bias is the mechanism that makes chance look like skill. The treatment of fund manager performance and the "cemetery of failed traders" is the intellectual foundation for Section 37.7.
Relevance to Chapter 37: Provides the detailed argument for why fund manager track records are contaminated by survivorship bias and why the financial industry's incentive structures perpetuate the bias.
Best for: Readers interested in finance, probability, and the psychology of success attribution. More focused and disciplined than The Black Swan, and a better starting point for readers new to Taleb.
Abraham Wald, A Method of Estimating Plane Vulnerability Based on Damage of Survivors (Statistical Research Group, Columbia University, 1943; reprinted 1980)
The original technical memorandum in which Wald presented his analysis of the bomber damage data. The document is a model of clear statistical reasoning: Wald shows precisely why the naive interpretation of the data (armor the damaged areas) leads to the wrong conclusion and how the correct analysis (armor the undamaged areas) follows from understanding the selection process. The reprinted version includes a useful introduction that places the work in historical context.
Relevance to Chapter 37: Wald's analysis is the canonical example discussed in Section 37.1. The original document demonstrates the insight in its most precise form.
Best for: Readers with a statistical or mathematical background who want to see the formal argument. The original is technical but not inaccessible.
Jordan Ellenberg, How Not to Be Wrong: The Power of Mathematical Thinking (2014)
Ellenberg's chapter on survivorship bias provides the most accessible retelling of the Wald bomber story and connects it to a wide range of contemporary examples. Ellenberg, a mathematician at the University of Wisconsin, writes with exceptional clarity and humor, and his treatment of survivorship bias is the single best short introduction available.
Relevance to Chapter 37: Ellenberg's retelling of the Wald story influenced the structure of Section 37.1. His broader treatment of mathematical thinking in everyday life provides context for the countermeasures discussed in Section 37.10.
Best for: General readers who want a clear, engaging introduction to survivorship bias and its mathematical underpinnings.
John P. A. Ioannidis, "Why Most Published Research Findings Are False" (PLOS Medicine, 2005)
The most cited paper in the history of medical methodology. Ioannidis demonstrates mathematically that under realistic conditions -- small sample sizes, small effect sizes, multiple testing, financial and career incentives, and publication bias -- the majority of published findings in many research fields are likely to be false positives. The paper's argument depends critically on the file drawer problem: publication bias enriches the literature for false positives by suppressing the true negatives that would reveal them.
Relevance to Chapter 37: Ioannidis provides the theoretical and mathematical foundation for the publication bias discussion in Section 37.9. His paper is the single most important document in the modern understanding of how survivorship bias operates on the scientific record.
Best for: Readers with some background in statistics or research methodology. The paper is concise and devastating. It should be required reading for anyone who reads scientific papers.
Robert Rosenthal, "The File Drawer Problem and Tolerance for Null Results" (Psychological Bulletin, 1979)
The paper that named the file drawer problem and provided the first systematic analysis of its consequences for scientific knowledge. Rosenthal calculated the number of null results that would need to exist in file drawers to overturn a published positive finding and showed that, for many research topics, the required number was plausibly small.
Relevance to Chapter 37: Rosenthal's paper is the origin of the "file drawer" concept discussed in Section 37.9. His framework for thinking about the ratio of published to unpublished studies remains the standard approach.
Best for: Readers interested in research methodology and the philosophy of science.
Jim Collins, Good to Great: Why Some Companies Make the Leap... and Others Don't (2001)
Collins's bestselling study of eleven companies that transitioned from good to sustained great performance. The book is included here not because its methodology is sound but because it is the most influential example of the survivorship-biased approach to business research. Understanding why Collins's conclusions have not held up over time is essential to understanding the argument of Section 37.2.
Relevance to Chapter 37: Collins's work is the primary example in Section 37.2 of business success literature that suffers from survivorship bias. The post-publication performance of his "great" companies provides the most compelling evidence that the methodology identified luck rather than replicable strategies.
Best for: Readers who want to understand the appeal and limitations of business success literature. Read alongside Phil Rosenzweig's critique (below) for the full picture.
Tier 2: Attributed Sources
These works are attributed to specific authors and widely discussed in the relevant literature. They provide important context and depth.
Phil Rosenzweig, The Halo Effect... and the Eight Other Business Delusions That Deceive Managers (2007)
The most rigorous and readable critique of survivorship bias in business success literature. Rosenzweig, a professor at IMD business school, systematically dismantles the methodologies of In Search of Excellence, Good to Great, and similar books. His central argument -- that these books mistake correlated attributes for causal factors and ignore the role of luck, timing, and circumstance -- is the intellectual foundation of Section 37.2's critique.
Relevance to Chapter 37: Rosenzweig provides the most thorough analysis of why business success literature fails as causal evidence. His concept of the "halo effect" -- the tendency to attribute positive traits to successful companies after the fact -- complements the survivorship bias argument.
Best for: Readers interested in business strategy, management research methodology, and critical thinking about popular business advice.
Tom Peters and Robert H. Waterman Jr., In Search of Excellence: Lessons from America's Best-Run Companies (1982)
The book that launched the modern business success genre. Peters and Waterman studied forty-three companies judged to be excellent and identified eight attributes of excellence. The book's subsequent predictive failure -- roughly a third of the profiled companies were in financial difficulty within two years -- provides the earliest and most dramatic evidence of survivorship bias in business literature.
Relevance to Chapter 37: Provides the historical context for the business success literature discussion in Section 37.2.
Best for: Historical interest. Read alongside Rosenzweig's critique for the most informative experience.
Daniel Kahneman, Thinking, Fast and Slow (2011)
Kahneman's synthesis of decades of research on cognitive biases includes important discussions of the outside view, base rate neglect, and the planning fallacy -- all of which are relevant to the countermeasures discussed in Section 37.10. Kahneman's treatment of the outside view as a corrective to optimistic forecasting is the most accessible introduction to this countermeasure.
Relevance to Chapter 37: Provides the theoretical foundation for the "outside view" countermeasure discussed in Section 37.10 and the connection between survivorship bias and base rate neglect discussed throughout the chapter.
Best for: General readers interested in cognitive biases and decision-making. The most influential popular book on behavioral science.
Edwin J. Elton, Martin J. Gruber, and Christopher R. Blake, "Survivorship Bias and Mutual Fund Performance" (Review of Financial Studies, 1996)
The landmark empirical study that quantified the magnitude of survivorship bias in mutual fund performance data. Elton, Gruber, and Blake showed that survivorship bias inflated average reported fund returns by approximately one percentage point per year -- a finding that has been replicated and extended in subsequent research.
Relevance to Chapter 37: Provides the empirical foundation for the fund manager performance discussion in Section 37.7. The one-to-two percentage point annual bias figure cited in the chapter derives from this and subsequent studies.
Best for: Readers with a background in finance or statistics who want the empirical details behind the chapter's claims.
Robert Mark, Experiments in Gothic Structure (1982)
Mark's engineering analysis of Gothic cathedral structures, which documented both the successes and the failures of medieval structural engineering. Mark used photoelastic models and finite element analysis to show that medieval builders were working at the limits of structural feasibility, with failure a realistic possibility for many of the most ambitious projects.
Relevance to Chapter 37: Provides the technical foundation for the discussion of structural failures in Gothic architecture in Section 37.4 and Case Study 2. Mark's work demonstrates that the surviving cathedrals are the successes of an experimental building program that included significant failures.
Best for: Readers interested in architectural history and structural engineering. Technical but well-written and richly illustrated.
Brian Nosek, "Registered Reports" (Social Psychology, 2014, special issue)
The special issue that introduced registered reports as a publication format in psychology, in which journals commit to publishing studies based on the quality of the research design, regardless of results. The issue demonstrated that registered reports produce a dramatically different pattern of findings than traditional publications -- far more null results, suggesting that the traditional publication process was systematically filtering them out.
Relevance to Chapter 37: Provides the evidence base for the pre-registration countermeasure discussed in Section 37.10.
Best for: Readers interested in research methodology and the reform of scientific publishing.
Tier 3: General Sources and Synthesized Knowledge
These observations draw on general knowledge from multiple sources and do not rely on any single citation.
The Survivorship Bias in Historical Music
The estimate that over ninety percent of medieval music has been lost is a synthesis of findings from multiple musicological sources. The precise figure varies depending on the period, region, and genre considered, but musicologists broadly agree that the surviving corpus is a small and non-representative fraction of what was composed and performed. The mechanisms of loss -- manuscript decay, institutional dissolution, cultural forgetting -- are well-documented in the musicological literature.
Best for: Readers interested in the cultural implications of survivorship bias. The musicological literature is accessible and often beautifully written.
Roman Building Failures
The claim that Roman construction was not uniformly excellent draws on the writings of Juvenal (Satires), Vitruvius (De Architectura), Tacitus (Annals), and modern archaeological analysis. The specific claim about the poor quality of Roman insulae (apartment blocks) is widely attested in the ancient sources and confirmed by archaeological evidence of building collapses and fire damage in Roman cities.
Best for: Readers interested in ancient history and the gap between monumental architecture and everyday construction.
The Women's Health Initiative and Hormone Replacement Therapy
The reversal of medical opinion on hormone replacement therapy is documented in the published results of the Women's Health Initiative (writing group, JAMA, 2002) and subsequent analyses. The case is widely used in epidemiology and medical methodology teaching as an example of how the healthy user effect can distort observational evidence.
Best for: Readers interested in medical research methodology and the limits of observational evidence.
Recommended Reading Order
For readers who want to explore survivorship bias beyond this chapter, the following sequence is recommended:
-
Start with Ellenberg (How Not to Be Wrong) for the clearest introduction to the Wald bomber story and the mathematical intuition behind survivorship bias.
-
Read Taleb (Fooled by Randomness, then The Black Swan) for the deepest treatment of silent evidence and its implications for risk, success, and knowledge.
-
Read Rosenzweig (The Halo Effect) for the most thorough critique of survivorship bias in business success literature.
-
Read Ioannidis ("Why Most Published Research Findings Are False") for the mathematical argument that publication bias has corrupted the scientific record.
-
Read Kahneman (Thinking, Fast and Slow) for the broader cognitive context and the outside view countermeasure.
-
Read Wald's original paper for the canonical example in its purest form.
This sequence moves from accessible to technical, from specific to general, and from the most vivid examples to the most rigorous arguments.