Case Study 40.2: The Press Release Problem — Tracing the Gap from Study to Headline
The Headline
"Study Proves Playing Hard to Get Is the Secret to Attracting a Partner" — Press release from a fictional university communications office, widely syndicated
The Actual Study
The headline referred to a published study (fictional for this case study; designed to be realistic) by two researchers at a midsize American university. The study's actual title: "Perceived Partner Uncertainty as a Moderator of Romantic Intrigue: An Experimental Investigation."
Actual design: 154 participants (87% white, 94% heterosexual, mean age 19.3 years, all psychology undergraduates at one university) were randomly assigned to one of three conditions. In each condition, they saw the social media profile of a fictional potential romantic partner and read a vignette describing an interaction. The conditions varied only in how certain the participants were about whether the potential partner "liked them back": (1) Certain positive (partner clearly liked them), (2) Uncertain (couldn't tell if partner liked them), (3) Certain negative (partner didn't like them). Participants then rated their interest in the potential partner.
Actual finding: Participants in the uncertain condition reported slightly higher interest in the potential partner than those in the certain-positive condition (M_uncertain = 5.8, M_certain = 5.3, on a 7-point scale; t(101) = 2.13, p = .036, Cohen's d = 0.42). There was no significant difference between the uncertain and certain-negative conditions (p = .31).
What the paper actually concluded: "Results provide preliminary evidence that partner uncertainty may enhance romantic interest compared to certain reciprocation in a brief profile-rating paradigm. These findings should be interpreted cautiously given the homogeneous sample, single cultural context, and inability to assess whether this effect persists over time or generalizes to ongoing relationship formation."
Mapping the Distortions
Distortion 1: "Proves." The study did not prove anything. It provided preliminary correlational-experimental evidence in a single sample. "Proves" is never accurate in empirical science, but it is especially inaccurate for a single study with a non-diverse sample.
Distortion 2: "Playing hard to get is the secret." The study tested the effect of uncertainty about partner interest, not the strategy of "playing hard to get" — a specific behavioral approach that has its own literature and a fairly complex evidence base. The two things are related but distinct. The press release conflated an experimental condition (uncertain feedback) with a deliberate interpersonal strategy.
Distortion 3: "Attracting a partner." The study measured momentary interest ratings in a hypothetical profile, not actual partner attraction in real relationships. The outcome measure — a Likert rating after reading a vignette — is many steps removed from "attracting a partner" in any real sense.
Distortion 4: Missing effect size context. d = 0.42 is a small-to-medium effect. In the press release, there are no numbers at all. The effect sounds absolute ("the secret") rather than probabilistic and modest.
Distortion 5: Missing sample information. The press release does not mention that participants were 94% heterosexual undergraduates from one university. This is not just a limitation; it is information that directly determines how broadly the finding can be applied. "Playing hard to get" has been documented to operate differently across genders, sexualities, and cultural contexts — none of which are addressed by a sample of largely white, largely straight college students.
Distortion 6: "Secret." The word "secret" suggests the finding is actionable advice. The study's authors explicitly said the findings "should be interpreted cautiously" and said nothing about behavioral prescription. The gap between "preliminary experimental evidence that uncertainty may heighten momentary interest in a hypothetical profile" and "here is the secret to attracting partners" is enormous.
Why This Happens
University communications offices are not malicious. They are staffed by talented writers with a mandate to generate media coverage for their institution. Media coverage requires simplicity, certainty, and relevance to everyday life. Science, on its best days, produces complexity, uncertainty, and qualified relevance. The gap is structural.
The researchers in this case study did not lie. Their results were real. Their conclusions were appropriately hedged. The press release took something real and hedged and turned it into something absolute and prescriptive. The researchers may or may not have reviewed the press release before it went out; many university systems do not require researcher approval of communications office output.
The Cost
This particular study's findings will now circulate in popular culture as "proof" that playing hard to get works, cited in listicles, self-help books, and TikToks. People will modify their romantic behavior based on a distortion of a finding that was preliminary, limited, and carefully hedged by its authors. Some of those modifications will work out fine. Others may damage genuine connections by introducing artificial uncertainty into situations that would have benefited from honest communication.
The cost of this specific distortion is probably modest. The cumulative cost of systematic press release distortion across thousands of social science studies is not.
Discussion Questions
-
Should researchers be legally required to approve press releases about their work before publication? What are the practical obstacles to this?
-
The case study attributes the distortion to structural incentives rather than individual bad actors. Does this change how you think about what should be done about press release distortion? Who is responsible?
-
The actual finding (uncertainty may momentarily heighten interest in a hypothetical profile) is actually interesting on its own terms. Why do you think the communications office felt they needed to dramatize it into "the secret"? What does this say about public science communication?