Discussion Guide — Chapter 40

Six prompts, with what to listen for. Each is written to be answerable from the chapter but not answerable by recall alone.

Prompt 1 — "Chapter 37 already checked our ratings. What is left for the audit to do?"

Open with this. It is the framing question for the session.

Listen for: the distinction between correctness, measured against an external and itself-dated source, and consistency, measured against the student's own other entries. Strong students notice that consistency is detectable from inside the document with no external reference, which is what makes it something they can do forever and Chapter 37 is not.

Listen for the misconception: "the audit is a second, stricter accuracy check." Students who say this will then run the four checks looking for wrong ratings and find nothing. Redirect by asking: if every one of your ratings matched Appendix A exactly, could your dossier still be broken? The answer is yes — Case Study 1's Entry 2 is exactly that case.

Push further if the room is strong: ask what a disagreement with Chapter 37 proves. Answer: very little on its own, since the book's ratings are dated and the student may have read something the book did not. Direction across many disagreements is the signal; individual disagreements are noise.

Prompt 2 — "Case Study 1's Entry 2 has the right rating. Why is it still a defect?"

The friction point of the chapter, deliberately surfaced as a discussion rather than left to be resisted silently.

Listen for: the separation of output from procedure. The rating matches the evidence; the method that produced it was distaste, and the same method produced ⚠️ on comparable evidence in Entry 3. A method that returns the right answer by coincidence will return the wrong one the moment the inputs change.

Listen for: recognition that the blank Field 12 makes the entry non-updating. If a well-designed human trial reports next year, this reader has not specified what would move them, and will judge the trial after seeing its result while holding a stated high-confidence position.

Listen for the good objection, and take it seriously: "if the rating is right, who is harmed?" The honest answer is nobody, yet — the harm is deferred and probabilistic. The strongest reply in the chapter is the asymmetry: the reader wrote Field 12 where they felt uncertain and skipped it where they felt sure, which is exactly inverted, because it is most valuable where it feels least necessary.

Watch for: students defending the reader on the grounds that the marketing really is bad. Agree that it is, then point at Field 8, which is where that observation belongs and where it does no harm.

Prompt 3 — "Is being too harsh really as bad as being too generous?"

The prompt most likely to divide the room, and the one worth the most time. Do not resolve it early.

Listen for: rating rule 4 and its mirror in rule 3 — both forbid a rating being moved by something that is not evidence. Strong students frame the symmetry structurally rather than morally.

Listen for: the asymmetry in feedback. The generous reader eventually finds out (the thing did not work). The harsh reader receives no corrective signal, because nobody is ever embarrassed for having been too critical of a supplement, so the error persists and compounds.

Listen for: the transmission cost — a ❌ looks identical whether it came from Field 5 or from taste, so the harsh reader exports an aesthetic reaction as an evidence assessment to everyone who asks them.

Listen for the misconception, and expect it from your most rigorous students: "caution is the correct default under uncertainty." This conflates a decision with a rating. Caution is a perfectly defensible decision rule. It is not a permissible input to Field 6, which is a description of the evidence. Separating those two is the whole point of §40.9's "input to a decision, not the decision."

Concrete anchor if the discussion stalls: a compound genuinely at ⚠️ gets recorded as ❌ because its advocates are insufferable. Two years later the confirmatory trial reports positive. What did the harshness protect the reader from, and what did it cost them? (Answer: nothing, and the ability to see it coming.)

Prompt 4 — "Your confidence in a compound has risen over two years. What would tell you whether that is justified?"

Aim this at §40.6 and at the mechanism rather than at the vocabulary.

Listen for: the selection account, stated as a process — publicizable results reach the reader, null results are published quietly, late, or not at all, and the reader's own searching applies the same filter a second time because they search for what they care about. A rising sense of support is what they would experience either way.

Listen for: the mechanical defense, and insist on its ordering. Do not adjudicate whether the picture has changed. Open Field 12, read the readout named there before they had a stake, and ask whether that specific thing happened.

Listen for the misconception: "I just need to be more skeptical of what I read." Vigilance is not the defense the chapter offers, and it fails for a stated reason — drift does not feel like drift, it feels like being appropriately responsive to new information. The defense is a written commitment made earlier, not better judgment made now.

Good follow-up: ask what a legitimate upgrade looks like, and make them name what an abstract, a preprint, and a mechanism paper each genuinely are evidence of. They are all real information — just not about the thing the rating tracks. Students who can say what each one does establish have understood the rule rather than memorized it.

Prompt 5 — "Take the twelve fields to something that is not a peptide. Where do they break?"

Run this after students have attempted Exercise AF. Have two or three read theirs aloud.

Listen for: the same four errors reappearing in the same four places — a category name mistaken for a specification, an origin story doing evidentiary work, a mechanism competing with a duller mechanism that predicts the same outcome, and a claimed use outrunning anything established.

Listen for: the structurally empty field. This is the discriminating observation. Field 7 for a diet is empty because no approval pathway exists, which carries no information; Field 7 for a drug being empty is highly informative and requires saying which of the five meanings applies. Students who spot that distinction unprompted have transferred the skill rather than the checklist.

Listen for: the modality/product split from Case Study 2 — evidence attaches to specified exposures, so a product that does not specify its exposure has inherited nothing. This is Chapters 32 and 34 with no chemistry in them, and it is the moment the transfer argument becomes concrete.

Listen for the misconception: "the fields don't apply because there's no molecule." Ask them which field they cannot ask. They will find they can ask all twelve; some answers are just shorter, and one or two are structurally empty.

Prompt 6 — "The next four chapters have no trial arms, no endpoints, and no placebo. Does the method survive?"

The handoff prompt. End on it, and do not tie it off neatly — it is meant to open Part VIII rather than close Chapter 40.

Listen for: honest acknowledgment that the twelve fields do not transfer cleanly, which is what §40.10 itself says. Students who claim the method works unchanged have not understood the difficulty; students who claim it fails entirely have not understood what survives.

Listen for: the identification of what does survive — for whom, measured how, compared to what, and how would we know if it were false — as a discipline rather than a form. And for candidate substitutes: natural experiments, before-and-after populations, cross-jurisdiction comparisons, survey data with stated sampling. Ask what each substitution costs.

Listen for the sentence that matters most, and supply it if nobody does: claims about molecules are made about compounds; claims about society are made about the students themselves — more often, more confidently, and with almost nobody applying any standard at all. That is why Part VIII is the point of the book rather than an appendix to it.

Close with the assignment, not a summary. Have them date the document, freeze a copy, and write the one sentence that goes at the top: what they would need to learn to change their mind about the entry they care about most. Then tell them Chapter 41 begins with a word rather than a molecule.