Chapter 28 Quiz: Self-Assessment

Instructions: Answer each question without looking back at the chapter. After completing all questions, check your answers against the key at the bottom. If you score below 70%, revisit the relevant sections before moving on to Part V.

Multiple Choice

Q1. "Dark knowledge" as defined in this chapter refers to:

a) Knowledge that has been deliberately classified or hidden for security reasons b) The collective, unwritten knowledge that entire fields, organizations, and communities possess but never codify c) Knowledge that is false or misleading but widely believed d) Knowledge that exists only in digital form and is inaccessible without technology

Q2. The primary difference between tacit knowledge (Ch. 23) and dark knowledge (Ch. 28) is:

a) Tacit knowledge is real; dark knowledge is hypothetical b) Tacit knowledge resides in individuals; dark knowledge operates at the collective level, distributed across a community c) Tacit knowledge is about physical skills; dark knowledge is about intellectual understanding d) Tacit knowledge can be made explicit; dark knowledge cannot

Q3. When the chemical plant reopened with new operators and followed documented procedures perfectly, the product was wrong because:

a) The documentation contained errors b) The equipment had degraded during the shutdown c) The experienced operators had possessed dark knowledge -- undocumented adjustments, compensations, and sensory cues -- that made the documented procedures actually work d) The raw materials had changed suppliers

Q4. The chapter uses the metaphor of "dark matter" from physics to describe dark knowledge because:

a) Dark knowledge, like dark matter, is invisible but constitutes the majority of what exists, detectable only through its effects b) Dark knowledge, like dark matter, does not actually exist c) Dark knowledge, like dark matter, is only found in outer space d) Dark knowledge, like dark matter, is a theoretical construct with no practical implications

Q5. Aboriginal songlines are an example of dark knowledge because:

a) They were kept secret from European colonizers b) They encoded practical knowledge (navigation, botany, ecology) within oral narrative structures that were never written down and that depended on the community and the landscape for their transmission c) They contained false information designed to mislead outsiders d) They were written in a script that has never been deciphered

Q6. The four reasons dark knowledge stays dark are:

a) Laziness, secrecy, incompetence, and indifference b) Cost, complexity, regulation, and technology limitations c) Difficulty of articulation, nobody asks, political inconvenience, and insider obviousness d) Classification, encryption, compartmentalization, and redaction

Q7. "Organizational amnesia" occurs when:

a) An organization deliberately destroys its records b) An organization loses a critical mass of experienced members, and the dark knowledge they carried is lost, often without the organization realizing what it has forgotten c) An organization's computer systems crash and backup data is lost d) An organization changes its name and branding

Q8. The medieval guild system deliberately maintained dark knowledge because:

a) Guild members were illiterate and could not write down their knowledge b) The guild's competitive advantage depended on keeping expertise scarce; codification would have destroyed the monopoly c) Written materials were too expensive in the medieval period d) Guild members did not believe their knowledge was important enough to document

Q9. Clinical intuition in medicine is best described as:

a) Individual guesswork that has no place in evidence-based medicine b) The collective dark knowledge of experienced clinicians -- pattern recognition and judgment built through the community's clinical experience and transmitted through apprenticeship c) The application of published clinical guidelines to individual patients d) A supernatural ability possessed by talented physicians

Q10. "Code smell" in software development is an example of dark knowledge because:

a) It is a formal metric that can be measured by automated tools b) It is a reliably detected property of source code that experienced developers agree on but cannot precisely define or reduce to explicit rules c) It refers to actual physical odors in server rooms d) It is a marketing term with no technical meaning

Q11. The "automation paradox" refers to:

a) The tendency of automated systems to create more work than they save b) The phenomenon where automating the explicit portion of a job reveals (through failures in non-routine cases) the dark knowledge that the human worker possessed c) The tendency of automated systems to become more expensive than manual processes d) The fact that all automated systems eventually fail

Q12. The chapter argues that when oral traditions were replaced by written texts, the result was:

a) A straightforward improvement in knowledge preservation b) A complete loss of all knowledge c) A paradox: literacy preserved explicit, propositional knowledge but destroyed the embodied, contextual, integrated dark knowledge that oral traditions maintained d) No significant change in knowledge preservation

Q13. Which of the following is NOT a method for extracting dark knowledge discussed in the chapter?

a) Ethnography b) Standardized testing c) After-action reviews / debriefing d) Storytelling and narrative methods

Q14. Knowledge engineering (building expert systems) largely failed to capture dark knowledge because:

a) The technology was not powerful enough b) Expert systems ran headlong into Polanyi's Paradox: the dark knowledge that distinguishes experts from competent practitioners is precisely the knowledge that resists the propositional decomposition that expert systems require c) Experts refused to cooperate with knowledge engineers d) The approach was never actually attempted

Q15. The threshold concept of this chapter -- "The Dark Majority" -- states that:

a) Most fields are dominated by a majority of poorly trained practitioners b) In any field, the written/explicit/formal knowledge is the minority, and the majority of what practitioners know and use is dark knowledge that has never been written down c) The majority of published knowledge in any field is wrong d) Most knowledge is deliberately hidden by powerful institutions

Q16. The institutional memory decay curve described in the chapter follows this pattern:

a) Sudden, catastrophic loss immediately after the experienced cohort departs b) Gradual initial decline, accelerating middle phase as the experienced cohort thins, and eventual complete loss or adapted (lower) capability c) No loss at all, because documented procedures capture all necessary knowledge d) Improvement after the experienced cohort leaves, because new staff bring fresh perspectives

Q17. The chapter argues that dark knowledge is relevant to AI because:

a) AI systems will soon replicate all dark knowledge b) AI systems trained on explicit data (text, documentation, published research) are trained on the minority of what professions know; the dark knowledge majority is absent from the training data because it was never documented c) AI systems possess their own form of dark knowledge d) Dark knowledge is irrelevant to AI development

Q18. The Part IV wrap-up connects dark knowledge to the other six epistemological patterns by arguing that:

a) Dark knowledge is the most important pattern and the others are secondary b) The seven patterns form an interconnected web: maps simplify reality (Ch. 22), tacit knowledge resists articulation (Ch. 23), paradigms frame perception (Ch. 24), the adjacent possible constrains innovation (Ch. 25), multiple discovery reveals structure (Ch. 26), boundary objects enable cooperation (Ch. 27), and dark knowledge constitutes the invisible majority that makes all the others work c) Each pattern contradicts the others d) The seven patterns can be reduced to a single principle

Q19. NASA's inability to replicate the Saturn V rocket decades after the Apollo program illustrates:

a) That the original engineering was not well done b) That the blueprints and specifications (explicit knowledge) were insufficient without the community of engineers, technicians, and operators whose dark knowledge made the documented procedures actually work c) That rocket technology has not advanced since the 1960s d) That NASA lost all its documentation

Q20. The chapter's final argument about "the wise institution" is that:

a) The wise institution documents everything b) The wise institution understands what documentation can and cannot do, investing in apprenticeship, storytelling, and community maintenance alongside knowledge management systems c) The wise institution avoids all documentation and relies entirely on oral tradition d) The wise institution replaces all human expertise with AI systems

Short Answer

Q21. In two to three sentences, explain how dark knowledge differs from individual tacit knowledge. Use the hospital example from the chapter to illustrate the distinction.

Q22. The chapter identifies four reasons dark knowledge stays dark. Choose the one you believe is most important and explain why, using a specific example.

Q23. Explain the "automation paradox" and provide an example (from the chapter or from your own experience) of a situation where automating the explicit portion of a job revealed the importance of the dark portion.

Q24. The chapter argues that the transition from oral to literate knowledge storage was accompanied by significant dark knowledge loss. In your own words, explain what was lost and why writing could not capture it.

Q25. Apply "The Dark Majority" threshold concept to a field you know well. Estimate the ratio of explicit-to-dark knowledge in that field and explain what types of knowledge constitute the dark majority.

Answer Key

Multiple Choice:

Q1: b -- Dark knowledge is the collective, unwritten knowledge that entire fields, organizations, and communities possess but never codify. It extends tacit knowledge from the individual to the collective level. (Section 28.1-28.2)

Q2: b -- Tacit knowledge resides in individuals (the surgeon's feel for tissue, the chef's palate). Dark knowledge operates at the collective level -- it is distributed across a community, with different members holding different pieces. No single individual carries the complete picture. (Section 28.2)

Q3: c -- The experienced operators possessed dark knowledge -- compensations for equipment quirks, sensory cues for process stages, undocumented workarounds -- that made the documented procedures produce a quality product. Without this dark knowledge, following the procedures perfectly produced an inferior result. (Section 28.1)

Q4: a -- Like dark matter in physics, dark knowledge is invisible but constitutes the majority of what exists, and its presence is detectable only through its effects on visible phenomena. Roughly 85% of matter in the universe is dark matter; analogously, the majority of what any field knows is dark knowledge. (Section 28.2)

Q5: b -- Songlines encoded detailed geographic, ecological, botanical, and navigational information within oral narrative structures that were tied to specific landscapes and transmitted through community practices, never written down. (Section 28.4)

Q6: c -- The four structural reasons are: (1) it is hard to articulate (Polanyi's Paradox at the collective level), (2) nobody asks about it (cognitive blind spot), (3) articulating it would be politically costly, and (4) insiders do not recognize it as knowledge because it is "just the way things are done." (Section 28.8)

Q7: b -- Organizational amnesia occurs when an organization loses experienced members and the dark knowledge they carried, often without recognizing what has been lost, because the organization does not have a category for "knowledge we didn't know we had." (Section 28.9)

Q8: b -- Guilds deliberately maintained dark knowledge because their competitive advantage depended on monopolizing expertise. Publishing guild secrets would have destroyed the economic model by making the expertise freely available. (Section 28.5)

Q9: b -- Clinical intuition is the collective dark knowledge of experienced clinicians -- pattern recognition, judgment, and feel for clinical situations built through the community's clinical experience and transmitted through the apprenticeship system of medical training. (Section 28.6)

Q10: b -- Code smell is a property that experienced developers detect reliably and agree on, but that cannot be reduced to a precise, complete set of explicit rules. It meets the definition of dark knowledge: shared, reliable, collectively maintained, and resistant to codification. (Section 28.7)

Q11: b -- The automation paradox is the phenomenon where automating the explicit, rule-based portion of a job makes the dark knowledge visible -- but only through failures in non-routine cases that the human worker's dark knowledge previously handled. (Section 28.11)

Q12: c -- Literacy preserved explicit, propositional knowledge (facts, descriptions, arguments) but could not capture the embodied, contextual, integrated knowledge that oral traditions maintained through performance, context-sensitive transmission, and the integration of knowledge with practice. (Section 28.4)

Q13: b -- Standardized testing is not discussed as a dark knowledge extraction method. The five methods discussed are ethnography, apprenticeship, debriefing/after-action reviews, storytelling/narrative methods, and knowledge engineering. (Section 28.10)

Q14: b -- Knowledge engineering attempted to extract expert knowledge through structured interviews and model it as rules and decision trees. But expert knowledge, per Polanyi's Paradox, resists propositional decomposition. The expert systems captured the explicit rules (the iceberg tip) but missed the dark knowledge (the iceberg mass) that distinguishes expert performance from competent rule-following. (Section 28.10)

Q15: b -- The Dark Majority states that in any field, the explicitly documented knowledge is the minority, and the majority of what practitioners actually know and use has never been written down and may be impossible to write down. (Section 28.12)

Q16: b -- The decay curve shows slow initial decline (experienced members compensate for losses), accelerating decline (the experienced cohort thins below the threshold needed to cover all gaps), and eventual complete loss or adaptation to a lower level of capability. (Case Study 2)

Q17: b -- AI systems trained on text, documentation, and published research are trained on the explicit minority of professional knowledge. The dark knowledge majority -- the collective intuitions, pattern recognition, and judgment that practitioners transmit through apprenticeship and shared experience -- was never in any dataset because it was never written down. (Section 28.12)

Q18: b -- The seven patterns form an interconnected web describing how knowledge is created, communicated, simplified, resisted, and lost, with dark knowledge constituting the invisible majority that supports all the other patterns. (Section 28.13-28.14)

Q19: b -- The Saturn V blueprints and specifications survived, but the community of engineers whose dark knowledge -- manufacturing techniques, testing interpretations, integration intuitions -- made the documented procedures work had dispersed. The explicit knowledge was insufficient without the dark knowledge. (Case Study 2)

Q20: b -- The wise institution understands that documentation captures only the explicit minority; it invests in apprenticeship, storytelling, community maintenance, and other methods that preserve the dark knowledge majority alongside formal knowledge management systems. (Section 28.14)

Short Answer Rubric:

Q21: Dark knowledge differs from individual tacit knowledge in that it operates at the collective level -- it is distributed across a community rather than residing in any single person. In the hospital example, no single nurse or physician holds all the dark knowledge; different members know different pieces (which doctors prefer which communication methods, which equipment has which quirks, which workarounds keep the system functioning), and the organization's dark knowledge is the integration of all these pieces across the network of relationships and shared experiences.

Q22: Answers will vary. A strong answer selects one of the four reasons, explains why it is the most consequential or most difficult to address, and provides a concrete example. For instance: "Insider obviousness is the most important reason because it prevents the community from even recognizing that it possesses dark knowledge. The chemical plant operators did not think of their ability to diagnose reactor behavior by sound as 'knowledge' -- they thought of it as 'just paying attention.' Because they did not recognize it as knowledge, they did not think to document or transmit it. You cannot preserve what you do not know you have."

Q23: The automation paradox occurs when automating the explicit portion of a job reveals, through failures, the dark knowledge that the human worker possessed. The automated system handles routine cases correctly but fails on non-routine cases that the human's dark knowledge would have caught. Example: the chemical plant automation follows documented procedures perfectly but produces an inferior product because it lacks the operators' undocumented adjustments for equipment quirks, variable raw materials, and sensory cues.

Q24: Oral traditions maintained knowledge through integration with practice (the songline was navigated as it was sung), context-sensitive transmission (learning happened in the environment where knowledge would be used), and embodiment (knowledge engaged the full sensory-motor system). Writing can capture propositional content ("the water source is at this location") but not the embodied, contextual, performative character of the knowledge as maintained in oral tradition. The "how" -- how to read the landscape, how to feel the current, how to integrate multiple sensory inputs into a navigational judgment -- was lost because it cannot be reduced to written propositions.

Q25: Answers will vary. A strong answer identifies a specific field, estimates a ratio (with justification), and provides concrete examples of what constitutes the dark majority. For example: "In software engineering, I estimate the ratio is roughly 20:80 -- twenty percent explicit (documentation, code, specifications) and eighty percent dark (debugging instincts, system folklore, deployment lore, code smell, the collective understanding of why the system is structured the way it is, the knowledge of which parts of the codebase are fragile, and the informal agreements between teams about how to handle edge cases)."