Appendix A: The Forensic Disciplines and the Crime Laboratory

This appendix is a map. The body of the book travels through the forensic disciplines one at a time, each in its own chapter, with its own case files and its own argument about what it can and cannot do. Here, in one place, is the whole federation laid out for reference: every discipline the book covers, the question it actually answers, where it sits on the validity spectrum, and the chapter that develops it. After the disciplines come the institution that performs most of them — the crime laboratory — and the systems meant to keep it honest. Read it as a standalone reference; turn to the cited chapter when you need the full account.

Two reminders before the map. First, a discipline's position on the validity spectrum is a statement about the strength of the scientific foundation for its core comparison claim, as assessed chiefly by the 2009 National Academy of Sciences report (Strengthening Forensic Science in the United States) and the 2016 PCAST report (the President's Council of Advisors on Science and Technology) — not a verdict on its every possible use. Forensic odontology is near-worthless for "these teeth made this bite" and genuinely reliable for identifying a body from dental records: same specialty, opposite ends of the spectrum, depending on the question (Chapter 17). Second, a method's position is a ceiling on reliability, not a guarantee of it. DNA, at the top of every table in this book, can still be ruined by a mislabeled tube, a misinterpreted mixture, or a biased analyst. Where a method sits tells you how good it can be; it never tells you how good a particular result is.

A.1 The disciplines at a glance

The table below covers every forensic discipline treated in this book. The "validity status" column uses the book's shorthand — Strong, Moderate, Contested, Weak, Discredited — anchored to the NAS 2009 and PCAST 2016 assessments and stated more fully in each chapter. Where a discipline has two faces (a valid use and an invalid one), both are noted.

The disciplines that anchor the book's argument are the extremes. DNA analysis (7–9) is the one method built from the start on rigorous, quantified science, and it reset the standard for what "individualization" should even mean. At the other end, bite-mark analysis (16) claims to reach a single source by visual comparison with essentially no validated method for doing so, and it has helped convict the innocent. Between them lies everything else — and the recurring lesson of the book is that "forensic" is not one level of trustworthiness but a spectrum from rigorous to discredited, and that telling a validated method from a plausible-sounding one is the most important skill a juror, analyst, or attorney can have.

⚠️ Junk-Science Alert Be most suspicious of any method whose central claim is "I can match this mark to one unique source by visual comparison" and which lacks published, well-designed studies measuring how often that matching is wrong. That combination — high certainty, absent error rate — describes bite marks, much of toolmark "identification," and the strongest versions of hair and handwriting claims. The presence of an expert, a microscope, and confident testimony is not evidence of validity. The error rate is. If no one can tell you the error rate, that is the finding (Chapter 1, §1.5; Chapter 6).

A.2 The honest verbs: what every discipline is really saying

Whatever the discipline, the conclusion it offers falls somewhere on a single ladder of strength, introduced in Chapter 1 and used everywhere after. The most common forensic error — the one at the root of nearly every wrongful conviction in this book — is climbing one rung too high.

• Excludes. The evidence and the source do not share features they would have to share if the source were correct. This is forensic science's surest, cleanest voice; a single robust mismatch can eliminate a suspect. (DNA exclusions freed many of the people in Appendix C.)
• Cannot exclude / consistent with. They share features; the suspect cannot be ruled out. True and useful — and the rung most often overstated into something it is not.
• Strongly supports. The shared features are numerous, specific, or quantifiably rare enough that the evidence supports the association far over a random alternative — ideally with a number attached, as DNA provides.
• Proves. Reserved for almost nothing. A physical fit (torn tape that jigsaws back together) or a quantified DNA match approaches it for association; nothing physical "proves" the human story of guilt, which is the jury's conclusion, not the analyst's.

The whole book can be read as training your ear to hear when someone has quietly stepped from strongly supports into proves — because that single step is where the science ends and the trouble begins.

A.3 Inside the crime laboratory: sections and workflow

Behind almost every result above is a building the public never pictures correctly. A crime laboratory is a facility — public or private — that examines physical evidence to produce results for use in the legal system. It is not one gleaming room where one analyst runs every test; it is a federation of specialized sections under one roof, each staffed by analysts trained and certified in that one area, each with its own instruments, standards, and backlog. The DNA analyst does not dust fingerprints; the firearms examiner does not run the mass spectrometer. A typical full-service public lab contains some version of these sections (Chapter 4, §4.1):

Not every lab has every section. A small county lab might do drug chemistry and latent prints in-house and refer out the rest — most often to a larger state crime laboratory serving the whole state. This matters: a single case's evidence may be split across two or more institutions, each with its own chain-of-custody record (Chapter 2), its own queue, and its own quality system. Every handoff is a seam, and seams are where evidence and accountability fray.

An item's real journey from "collected at a scene" to "result in a report" runs through six stages, and the science is only one of them (Chapter 4, §4.1):

1. Intake / evidence receiving — the sealed, labeled package is logged, its seal verified, and a unique laboratory item number assigned. A broken seal here is a chain-of-custody problem before any science begins.
2. Storage / property room — secured, refrigerated or frozen for biological evidence, where it may sit for days, weeks, or months.
3. Assignment / triage — a case is assigned and ordered; a case with a suspect in custody jumps ahead of a property crime with no leads.
4. Examination — the analyst performs the testing (presumptive then confirmatory) and records every step in contemporaneous bench notes an opposing expert will one day scrutinize line by line.
5. Technical and administrative review — a second qualified analyst reviews the work for technical soundness, and a separate check confirms the report is complete. This second set of eyes is one of the building's most important controls — and exactly the control the great scandals evaded.
6. Report and testimony — the written report is issued, and the analyst may later be called to testify (Chapter 30).

The single most important real-world fact about this workflow is the one television never mentions: the backlog. Demand for forensic testing vastly exceeds the capacity to perform it; cases queue for months. Any specific figure should be checked against a current, named source — the numbers are real and large but shift year to year. The backlog is not a logistical footnote: it can keep a guilty person free, keep an innocent person jailed pre-trial awaiting the test that would clear them, and create the pressure to work faster under which corners get cut.

A.4 Accreditation and standards: what "accredited" does and does not mean

If anyone offers "it came from an accredited lab" as if that settled a result's reliability, the right response is a sharper question. Accreditation is the formal recognition, by an independent accrediting body, that a laboratory operates a documented quality-management system and is competent to perform the specific tests within its declared scope. It is a credential awarded to the institution and its processes, after external assessment, and renewed by periodic reassessment.

The international standard most crime labs are accredited to is ISO/IEC 17025, General requirements for the competence of testing and calibration laboratories, which specifies what a competent testing laboratory must have in place: documented procedures, validated methods, controlled records, trained and authorized personnel, calibrated equipment, traceable measurements, and a system of internal audits. In the United States, forensic accreditation to this standard is granted by bodies such as the ANSI National Accreditation Board (ANAB) and the American Association for Laboratory Accreditation (A2LA). The field's professional body, the American Society of Crime Laboratory Directors (ASCLD), historically ran a widely used forensic accreditation program (ASCLD/LAB); ASCLD itself remains a professional association of laboratory directors, while accreditation functions consolidated under ANAB. You do not need to memorize the alphabet soup. You need one idea: accreditation means an outside body has verified that the lab has and follows a quality system of a recognized kind.

Here is what accreditation does not mean — the load-bearing point (Chapter 4, §4.2):

• It does not mean every result the lab produces is correct. Accreditation audits the system, largely through documentation and sampling, on a periodic schedule. It cannot watch every analyst run every test.
• It does not mean the underlying method is scientifically valid. A lab can be impeccably accredited to perform a technique that PCAST found lacks foundational validity. Accreditation certifies conformance, not validity. A lab can perfectly, auditably, reproducibly run bite-mark comparisons — and the result is still junk science.
• It does not make a dishonest analyst honest. An assessor reviewing records cannot easily detect an analyst fabricating those records, as the scandals below prove.

⚖️ In the Courtroom "Is your laboratory accredited?" is a near-ritual question on direct examination, and the affirmative answer is meant to clothe everything that follows in reliability. A prepared cross-examiner refuses the implication with honest follow-ups: Accredited by whom, and to what standard? Was your specific method within the accredited scope? When was your last assessment, and were any findings or corrective actions issued? Does accreditation review your individual casework, or your laboratory's system? It is the difference between a restaurant passing its health inspection and every dish being well cooked. The inspection makes the second more likely. It does not make a single meal good.

The recurring shape of every safeguard in this appendix: accreditation is necessary and insufficient. It raises the floor; it does not guarantee the result.

A.5 Quality assurance, quality control, and proficiency testing

Inside an accredited lab, quality is maintained by two related but distinct sets of activities that beginners constantly conflate. Together they are QA/QC, but the two halves do different jobs (Chapter 4, §4.3):

• Quality assurance (QA) is the overarching, proactive system — written standard operating procedures for every method, defined analyst qualifications and training, equipment calibration schedules, the technical- and administrative-review requirement, document control, and internal audits. QA asks: is the whole system built and run so that good results are the expected output?
• Quality control (QC) is the set of operational, sample-by-sample checks performed during an analysis: running known standards alongside the unknowns, including positive controls (must test positive), negative controls (must test negative), and reagent blanks (the reagents with no sample, which must come up clean). If a control fails, the run is invalid and the results are not reported, no matter how clean the unknown looks.

The mnemonic that sticks: QA is the system; QC is the sample. You need both. A lab with great QA but no QC on a run can produce a beautifully documented wrong answer; a lab that runs controls but has no QA has no way to know its analysts are trained or its methods validated.

Proficiency testing is the field's principal tool for verifying the analyst — the human judgment at the center of every comparison discipline. An analyst is given test samples whose correct answers are known to the provider (ideally not to the analyst) and graded on whether they reach the right result. It is required under accreditation, usually at defined intervals, for each analyst in each discipline. Done well, it is the very "measure how often examiners err on samples of known truth" study that Chapter 1 said the pattern disciplines historically skipped. But it has well-known limits (Chapter 4, §4.3):

• The analyst often knows it is a test, and people perform differently when graded than during routine casework under deadline. The gold standard — blind proficiency testing, a test sample slipped into the normal casework stream disguised as a real case — is far more revealing and far less common.
• The samples can be unrepresentatively easy — clean, single-source, unambiguous — telling you little about the degraded mixtures and partial prints where real errors cluster.
• Passing is not the same as a rigorously measured real-world error rate for the method as practiced on hard evidence.

A.6 Method validation and contamination control

Before a laboratory may use an analytical method on a real case, the method must be validated: tested and documented to demonstrate that it performs reliably for its intended purpose, under the conditions of the lab that will use it. Method validation is the unglamorous work of running a method against samples of known truth to characterize how it behaves before anyone's liberty depends on the answer. It answers a battery of questions — accuracy (correct answer on known samples), precision (the same answer on repetition), sensitivity / limit of detection (the smallest amount reliably detected), specificity (responds to the target and not to look-alikes), robustness (holds up under small variations), and known error rate (Chapter 4, §4.4). There are two kinds: developmental validation proves a method can work in principle (often done once, by the developer or a major reference lab, under standards from bodies like SWGDAM and NIST), while internal validation proves this lab can run it correctly with its instruments, reagents, and staff. Skipping internal validation is the quieter, more common failure. The deepest version of the problem, though, is a whole discipline never developmentally validated at all that entered courtrooms anyway — which is precisely the gap the NAS and PCAST reports indicted, and what PCAST meant by foundational validity.

Contamination is the introduction of foreign material into a sample — or the transfer of material between samples — anywhere from scene to bench. It is especially dangerous in the modern era because the sensitivity that makes DNA powerful also makes it vulnerable: a method that can detect a few cells from a perpetrator can equally detect a few cells shed by an analyst or a previous sample. Its recurring routes are scene/collection contamination, carryover between samples, analyst/personnel contamination, and reagent/consumable contamination (Chapter 4, §4.5). The defenses are QA and QC pointed at one threat: physical separation and unidirectional workflow, protective equipment changed between items, decontamination of surfaces and tools, blanks and controls that must come up clean, and elimination databases profiling staff so their DNA, if it appears, is flagged as contamination rather than mistaken for a perpetrator. The governing philosophy: assume contamination is always trying to happen, and design the workflow so that when it does, a control catches it rather than a jury believing it. Contamination caught by a blank is a success of the quality system. The danger is the undetected case — no blank run, or the blank ignored, and a contaminant reported as evidence.

A.7 When the system fails — and the structure underneath

An honest reference must record what happens when these systems fail. Three documented American scandals together tainted tens of thousands of convictions (Chapter 4, §4.6; and Appendix C): Annie Dookhan, a Massachusetts drug chemist who "dry-labbed" — reported results for tests she never ran — and tampered with samples; Sonja Farak, a chemist at a different Massachusetts lab who consumed the drug standards and case samples she was supposed to analyze; and Fred Zain, a serologist in West Virginia and then Texas who systematically fabricated and overstated results across two states. Strip away the specifics and the same structural failures appear in each: a single point of failure with too much trust and too little verification; no effective blind check on whether reported work was actually performed; production pressure prized over verification; and errors that ran consistently in the prosecution's favor. The lesson is blunt: a single unchecked analyst can poison an entire jurisdiction's casework, and accreditation alone will not stop them.

That last pattern points to the structural fact hanging over the whole enterprise, which the book does not fully confront until Chapter 38: most American crime laboratories are not independent. They are housed within, funded by, and answerable to law-enforcement agencies — the side of the adversarial system trying to secure convictions. This is the independence problem. The danger is rarely crude corruption; it is the subtle, pervasive pressure of allegiance and expectation, the case narrative that arrives with the sample, the "win" that is shared. The 2009 NAS report recommended that crime laboratories be made independent of law enforcement precisely to break that alignment. Most jurisdictions have not done it. It is Theme 3 — cognitive bias is the chief threat to forensic accuracy — elevated from the individual analyst to the institution: an individual can be biased by knowing the wanted answer; an entire laboratory can be structurally biased by being part of the side that wants it. The individual fix is context management and blind analysis (Chapter 31); the institutional fix is structural independence (Chapter 38). Neither alone is sufficient, and the field has been slow to adopt either.

A.8 Using this appendix

When a forensic claim is put in front of you — in this book, in a courtroom, or in the news — work the map in order. Which discipline is this, and where does it sit on the validity spectrum? (§A.1) Which honest verb does the conclusion actually warrant — exclude, consistent with, strongly supports — and has the speaker climbed past it? (§A.2) Which lab produced it, under what controls, with what could have gone wrong on the way to the bench? (§A.3–§A.7) And whose paycheck does the analyst depend on? (§A.7) The discipline-by-discipline chapters give you the depth; this appendix gives you the order of the questions. Asking them in this sequence protects you better than memorizing any single table — which is, in the end, the whole argument of the book compressed onto a few pages.