Midterm Exam — Parts I–III
Forty points. Seventy-five minutes. Closed book unless your instructor states otherwise; the four-line rating format in Section C may be reproduced on the board.
Covers Chapters 1–19 — the method (Part I), metabolic peptides (Part II), and growth and repair (Part III).
A note on what is being tested. Almost nothing on this exam asks you to recall a verdict. It asks you to produce one, from evidence you are given, using the rules. A student who has memorized Appendix A and not learned Chapter 5 will do poorly, which is the intended behavior of the instrument.
Every invented example on this exam is labeled [constructed teaching example]. Nothing labeled that
way is real, and none of it should be cited, repeated, or used outside this exam.
Section A — Multiple choice (12 points, 1 each)
Choose the single best answer.
A1. The book's central thesis is best stated as: a) Peptides are a promising new class of medicine that has been unfairly maligned. b) Most peptides sold today are unsafe. c) "It's a peptide" tells you almost nothing; the evidence separating two peptides can be enormous. d) Peptides work through mechanisms too complex for non-specialists to evaluate.
A2. Under Rule 1, an evidence rating attaches to: a) A molecule. b) A claim, with a population and an endpoint. c) A manufacturer. d) A regulatory decision.
A3. A ❌ rating means: a) The molecule is dangerous. b) The molecule has been proven not to work. c) The claim's hype outpaces its evidence. d) The compound is illegal.
A4. The main reason most peptides cannot simply be taken as ordinary pills is that: a) They are too large to be manufactured in tablet form. b) They are degraded by digestive proteases and cross the intestinal wall poorly. c) They are unstable at room temperature. d) They are always regulated as injectables.
A5. Which represents the stronger state of knowledge about a claim? a) No adequate trial has ever been run. b) An adequate trial was run and the result was negative. c) They are equivalent. d) Neither tells us anything.
A6. A compound's receptor binding is confirmed exactly as predicted, and no clinical outcome data exist. Under the rules, this: a) Justifies an upgrade to ⚠️. b) Justifies an upgrade to ✅ if the mechanism is well established. c) Justifies no upgrade at all; mechanism licenses a hypothesis, not a rating. d) Justifies a downgrade, because mechanism claims are usually marketing.
A7. The same GLP-1 receptor agonist, at the same dose and duration, produced roughly −15% body weight in adults with overweight or obesity without diabetes and roughly −10% in adults with type 2 diabetes. This difference is most directly a lesson about: a) Dose selection. b) Trial quality. c) Population. d) Endpoint choice.
A8. The incretin effect refers to the observation that: a) Insulin secretion is greater after oral glucose than after intravenous glucose producing the same blood glucose. b) Glucagon rises after a meal. c) Appetite falls as blood glucose rises. d) Gastric emptying accelerates after a protein meal.
A9. Growth hormone secretagogues differ from growth hormone itself in that secretagogues: a) Are absorbed orally in all cases. b) Act on a gland that then acts on tissues, adding a layer of variability. c) Have longer half-lives by design. d) Are approved for more indications.
A10. The evidence base for BPC-157's healing claims is best characterized as: a) Multiple large randomized controlled trials with mixed results. b) One large randomized controlled trial with a negative result. c) Substantial animal and preclinical work with no adequate human outcome trial. d) Extensive human observational data with no animal work.
A11. The risk that a gray-market vial contains something other than what its label says is: a) A reason to downgrade the molecule's rating. b) Independent of whether the molecule works, and belongs in a separate field. c) Only relevant for compounds with no approved indication. d) Eliminated by a certificate of analysis.
A12. A trial reports that a treatment lowered a blood marker associated with disease risk. The marker is: a) A hard outcome. b) A surrogate endpoint, and accepting it as benefit is a bet that moving the number moves the outcome. c) Irrelevant to evaluation. d) Equivalent to a mortality endpoint if the association is strong.
Section B — Short answer (18 points, 3 each)
Two to four sentences each. Precision is graded; length is not.
B1. Rewrite the following as a claim that could actually be evaluated, and name the two things you had to supply: "This peptide supports faster recovery."
B2. Distinguish the two kinds of ❌. Which one represents the stronger state of knowledge, and why do most readers get this backwards?
B3. Explain, using Rule 6, how one molecule can correctly carry ✅, 🔬, and ❌ ratings at the same time, without any of them being wrong.
B4. Chapter 6 asks you to write field 12 — what would change my mind — early, before you are invested in a compound. Give the reason, and state what an entry with an empty field 12 has become.
B5. A compound sold without any approval has "no reported side effects." Explain in two sentences why this is not the same as "no harms."
B6. A compound's human data were generated by one route of administration, and it is being sold and used by a different route. State what this does to the evidence base, and name the dossier field where this discrepancy becomes visible.
Section C — Extended item (10 points)
Read the constructed source below and rate the claim it makes, using the four-line format. Then answer the two follow-up questions.
[constructed teaching example]— the following product page is invented for this exam. COMPOUND Q does not exist. Nothing below is real, and none of it should be repeated outside this exam.
COMPOUND Q — advanced tissue support
Clinically studied. In a published study, participants taking COMPOUND Q showed a 47% improvement in tissue repair markers compared to their starting values over eight weeks.
COMPOUND Q is an exact fragment of a protein found naturally in the human body, and it binds directly to the receptors involved in healing — the same pathway your body already uses.
Thousands of athletes trust COMPOUND Q. Not evaluated by any regulatory agency.
C1. (6 points) Produce the four-line rating.
CLAIM:
EVIDENCE:
RATING: [✅ / ⚠️ / ❌ / 🔬] + [date] + [if ❌: absent / present-and-negative]
WOULD CHANGE IF:
C2. (2 points) The page makes two appeals that carry no evidentiary weight under the rules. Name both and say which rule each one would violate if you let it influence your rating.
C3. (2 points) One phrase in the source describes the comparison used in the study. Quote it, and explain what is missing from it.
Answer key
### Section A (12 points) | Item | Answer | Note | |---|---|---| | **A1** | **c** | The thesis of Chapter 1, carried through the whole book. (a) and (b) are verdicts on molecules, which the book never issues; (d) contradicts the book's entire purpose. | | **A2** | **b** | Rule 1. Accept no partial credit for (a) — this is the error the course exists to correct. | | **A3** | **c** | Rule 2: ❌ describes the *evidence*, not the molecule. (b) is the *other* kind of ❌ and is not what the symbol means on its own. | | **A4** | **b** | Chapter 4. Peptides are cleaved by digestive proteases and absorbed poorly across the intestinal wall; overcoming this is the central delivery problem of the class. | | **A5** | **b** | A negative result is knowledge. An absence of trials is ignorance. Struggle 3 in *Where Students Get Stuck*. | | **A6** | **c** | Rule 3. Note that (d) is also wrong, and for an equally important reason — Rule 4. | | **A7** | **c** | One enrollment criterion, materially different result. The justification for per-claim ratings. | | **A8** | **a** | The defining observation of the incretin system (Chapter 7). | | **A9** | **b** | Indirect action via the pituitary, which adds variability the direct agent does not have. | | **A10** | **c** | Chapter 17. Note that this places it at ❌ of the **evidence-absent** kind for its healing claims — not evidence-present-and-negative. | | **A11** | **b** | Chapter 19. Quality risk lives in fields 9 and 10 and never adjusts field 6. | | **A12** | **b** | A surrogate is a bet, not a fallacy — students who call it worthless have over-corrected. | ### Section B (18 points, 3 each) **B1.** A satisfactory rewrite supplies a **population** and an **endpoint**, and names both as supplied. Example: *"In recreationally active adults with an acute soft-tissue injury, does this peptide reduce time to return-to-activity compared with standard care?"* — supplied: the population (the source named none) and the endpoint (the source said "recovery," which is not measurable as written). - 3 pts: both supplied and explicitly identified as supplied. - 2 pts: both supplied, not identified as supplied. - 1 pt: one supplied. - 0: rating attached to the molecule, or no rewrite. **B2.** *Evidence absent* — no adequate trial has been run, so the claim is unsupported **and untested**. *Evidence present and negative* — a trial was run properly and the answer was no. **The second is the stronger state of knowledge.** Readers get it backwards because they import a presumption-of-innocence frame: "it hasn't failed yet" feels like a point in the compound's favor, when it is actually a statement that nobody knows anything. Full credit requires the direction of the comparison to be correct. **B3.** Rule 6 — one molecule, many ratings — because a rating attaches to a claim, and a molecule can be the subject of many claims with independent evidence bases. Example expected: a GLP-1 receptor agonist holding ✅ for weight loss in a defined population, 🔬 for a frontier indication under active investigation, and ❌ (evidence absent) for a longevity claim nobody has tested. Full credit requires the student to note that the ratings are **not in tension** — they are answers to different questions. **B4.** Field 12 is nearly impossible to write honestly once you are invested; a student who has spent a term defending a compound will write a falsification condition they can be confident will never be met. Written early, it is a fixed standard you can check yourself against later. **An entry with an empty field 12 has become a belief rather than a conclusion** — a claim the holder cannot imagine disconfirming. Full credit requires that last sentence's substance. **B5.** For an approved medicine there is a reporting pathway, so "no reports" carries some information. For a compound sold outside that system there is no pathway, no denominator, and no obligation on anyone to report anything — so "no reported side effects" mostly reports the absence of a reporting mechanism. The honest field 9 entry is *"unknown, and 'no reports' is not the same as 'no harms' when there is no reporting pathway."* **B6.** The evidence base **does not apply to the way the compound is actually being used** — route changes exposure, and a compound studied by one route has not been studied by another. Award the second point only for the correct field: **field 4 (Pharmacology)**, whose closing line asks whether the route used matches the route studied. Credit students who additionally note that the discrepancy is invisible unless both are written down. ### Section C (10 points) **C1 — the four-line rating (6 points).** A model answer:CLAIM: COMPOUND Q accelerates tissue repair -- population unspecified
by the source; endpoint stated as "tissue repair markers,"
which is a surrogate, not healing.
EVIDENCE: One study, design unstated. No comparator -- the change is
"compared to their starting values," i.e., within-subject
before-and-after, not versus placebo or standard care.
Population, size, and duration beyond "eight weeks" unstated.
Endpoint is a surrogate. No replication described.
Conspicuously absent: any controlled human outcome trial.
RATING: ❌ [date] -- kind: evidence ABSENT
WOULD CHANGE IF: A randomized controlled trial in a defined injured population,
with a clinical healing outcome (e.g., time to return to
activity or imaging-confirmed repair), an active or placebo
comparator, adequate duration, and enough participants to
detect a clinically meaningful difference -- replicated.
Scoring, 6 points:
| Element | Pts | Credit |
|---|---|---|
| Claim stated with population and endpoint, with the missing population **named as missing** | 1.5 | Full credit requires noticing the source supplied no population. |
| Endpoint identified as a **surrogate** | 1 | "Markers" is not healing. |
| **No comparator** identified as the central defect | 1.5 | The highest-value observation on the item. A before-and-after change is not a controlled result. |
| Rating ❌ **with the kind tagged as evidence-absent** | 1 | 0.5 for ❌ untagged. A defended ⚠️ can earn full credit **only** if the student explains that the uncontrolled design cannot support it — in practice this is rare and usually indicates the comparator point was missed. |
| Falsification condition specified as a trial (population, endpoint, comparator, duration, scale) | 1 | "More research" earns 0. |
**Do not deduct for a student who rates ❌ and adds that the compound may still turn out to work.** That
is Rule 2 applied correctly.
**C2 — the two weightless appeals (2 points, 1 each).**
1. **The origin story** — "an exact fragment of a protein found naturally in the human body." Origin
carries no evidentiary weight (dossier field 2). Letting it raise the rating is the error field 2
exists to quarantine; several compounds rated ❌ in this book are exact fragments of human proteins,
and one of the best-supported peptide drugs was found in lizard venom.
2. **The mechanism** — "binds directly to the receptors involved in healing." **Rule 3: mechanism never
upgrades a rating.** Confirmed target engagement is a hypothesis, not an outcome.
Accept **"thousands of athletes trust COMPOUND Q"** (popularity/testimonial — Chapter 6) in place of
either, for full credit. Accept **"not evaluated by any regulatory agency"** only if the student frames
it correctly: it is not evidence *against* the claim either, and treating it as a downgrade is the Rule 4
error in the other direction.
**C3 — the comparison (2 points).**
Quote: **"compared to their starting values."** Missing: **a comparator group.** A within-subject
before-and-after change cannot separate the compound's effect from natural healing over eight weeks,
regression to the mean, co-interventions, placebo response, or selection of who stayed in the study.
- 2 pts: correct quotation and the comparator problem named.
- 1 pt: correct quotation, vague explanation ("it's not controlled").
- 1 pt: comparator problem correctly explained but the wrong phrase quoted (commonly students quote the
"47%" figure, which is a magnitude problem, not the comparison problem).
- 0: identifies the percentage as the flaw with no reference to the comparison.
**A note for graders on the 47% figure.** Strong students will observe that a percentage improvement
against baseline on an unspecified marker in an uncontrolled study is close to uninterpretable, and that
no absolute figures are given. Award up to 1 bonus point (capped at the section maximum) for this, but do
not require it — the comparator point is the graded one.
Related: Chapters 1–19 · Appendix C (the twelve fields) · Appendix D (reading a trial) · Appendix F (red flags) · Appendix H (worked evaluations) · Appendix M (answers) · Claim Evaluation Rubric · Final Exam · Practical Evaluation Exam