Case Study 2: The Proton Radius Puzzle — When Precision Reveals Surprises

The Setup: Two Ways to Measure a Proton

By 2010, the proton charge radius was considered a well-measured quantity. Two independent methods had been converging for decades:

Method 1: Electron-proton scattering. Measure the cross section for elastic $ep$ scattering as a function of momentum transfer $Q^2$, extract the electric form factor $G_E(Q^2)$, and determine the radius from the slope at $Q^2 = 0$:

$$\langle r_p^2 \rangle = -6 \frac{dG_E}{dQ^2}\bigg|_{Q^2 = 0}$$

This requires extrapolating $G_E(Q^2)$ from finite $Q^2$ down to $Q^2 = 0$ — a procedure that depends on the functional form assumed for $G_E$.

Method 2: Hydrogen spectroscopy. Measure the energy levels of the hydrogen atom with extreme precision. The proton's finite size shifts the $S$-state energies relative to a point-charge prediction:

$$\Delta E_{\text{size}} \propto |\psi_{nS}(0)|^2 \langle r_p^2 \rangle$$

Combining the measured $1S$--$2S$ transition frequency (known to 15 significant digits!) with QED theory yields $r_p$.

Both methods agreed: $r_p = 0.877 \pm 0.005$ fm (CODATA 2010 average).

The Surprise: Muonic Hydrogen

In 2010, Randolf Pohl and the CREMA (Charge Radius Experiment with Muonic Atoms) collaboration at the Paul Scherrer Institute (PSI) in Switzerland published a measurement of the $2S$--$2P$ Lamb shift in muonic hydrogen — an exotic atom where a muon replaces the electron.

The muon is 207 times heavier than the electron. Its Bohr radius is therefore 207 times smaller:

$$a_\mu = \frac{a_0}{m_\mu/m_e} = \frac{0.529 \text{ \AA}}{207} \approx 2.56 \times 10^{-3} \text{ \AA} = 256 \text{ fm}$$

This is still much larger than the proton ($r_p \sim 0.8$ fm), but the muon's wavefunction overlaps with the proton far more than the electron's does. The probability of finding the muon inside the proton is enhanced by a factor of $(m_\mu/m_e)^3 \approx 8.9 \times 10^6$. Consequently, the proton-size contribution to the Lamb shift is about 2% in muonic hydrogen (a $\sim 4$ meV effect on a $\sim 206$ meV splitting) versus $\sim 0.01\%$ in electronic hydrogen — an enhancement factor of roughly 200.

The Experiment

The CREMA experiment at PSI worked as follows:

1. A low-energy beam of negative muons was stopped in hydrogen gas, forming muonic hydrogen atoms in highly excited states.
2. The atoms cascaded to the $2S$ state (some fraction are metastable in $2S$ due to collisional quenching).
3. A tunable laser pulse was fired at the atoms. When the laser frequency matched the $2S$--$2P$ transition, the atoms were excited to $2P$, from which they promptly decayed to $1S$ by emitting a 2 keV X-ray.
4. By scanning the laser frequency and detecting the X-rays, the CREMA team mapped out the $2S$--$2P$ resonance.

The Result

The measured $2S$--$2P$ Lamb shift in muonic hydrogen was:

$$\Delta E(2S - 2P) = 206.2949 \pm 0.0032 \text{ meV}$$

Subtracting the QED contributions (radiative corrections, recoil, etc.) and the proton polarizability contribution, the proton radius was extracted:

$$r_p = 0.84087 \pm 0.00039 \text{ fm}$$

This was $5\sigma$ smaller than the CODATA 2010 value of $0.8775 \pm 0.0051$ fm. The discrepancy was $4\%$ in the radius — tiny in absolute terms but enormous relative to the claimed uncertainties.

The Debate: 2010--2019

The proton radius puzzle generated intense activity across atomic physics, nuclear physics, and particle physics.

Hypothesis 1: New Physics (Lepton Non-Universality)

If the electron and muon interacted differently with the proton — through a new force that couples more strongly to muons — the two measurements could give different radii without either being wrong. Models involving new light bosons, dark photons, or modified QED were proposed.

This was the most exciting possibility but also the most constrained. Any new muon-specific force had to be consistent with: - The anomalous magnetic moment of the muon ($(g-2)_\mu$) - Parity-violating electron scattering - Collider searches for new particles - Other precision tests of lepton universality

Most new-physics models were quickly ruled out or severely constrained. The window for new physics narrowed but did not close entirely.

Hypothesis 2: Experimental Error

The electron scattering measurements of $G_E(Q^2)$ at low $Q^2$ are extremely challenging. The form factor changes slowly near $Q^2 = 0$, and the radius extraction is sensitive to the functional form used for extrapolation (polynomial, dipole, continued fraction, etc.). Different fitting procedures applied to the same data yielded different radii, spanning a range from $0.83$ to $0.90$ fm.

The muonic hydrogen measurement, by contrast, is essentially a direct spectroscopic determination with fewer theoretical assumptions (the QED corrections are well-controlled, and the proton polarizability contribution, while uncertain, is small).

Hypothesis 3: Theory Error in QED Calculations

The extraction of $r_p$ from hydrogen spectroscopy relies on extremely precise QED calculations — including two-loop, three-loop, and higher-order corrections. Some theorists investigated whether errors in these calculations could account for the discrepancy. Most QED cross-checks confirmed the calculations, but the two-photon exchange contribution (a correction where the electron exchanges two virtual photons with the proton) remained a source of discussion.

Toward Resolution: 2017--Present

Several key measurements shifted the balance toward the smaller, muonic hydrogen value:

The Garching Hydrogen Measurement (2017)

A group at the Max Planck Institute for Quantum Optics in Garching measured the $2S$--$4P$ transition in ordinary (electronic) hydrogen using a novel spectroscopic technique. Their result:

$$r_p = 0.8335 \pm 0.0095 \text{ fm}$$

This was consistent with the muonic value and inconsistent (at $\sim 3\sigma$) with the CODATA 2010 value. It was the first electronic hydrogen measurement to favor the smaller radius.

The PRad Experiment at Jefferson Lab (2019)

The PRad experiment measured the proton electric form factor $G_E^p(Q^2)$ at very low $Q^2$ (down to $Q^2 = 2 \times 10^{-4}$ GeV$^2$) using a novel magnetic-spectrometer-free technique with a calorimeter and a GEM detector. Their result:

$$r_p = 0.831 \pm 0.007_{\text{stat}} \pm 0.012_{\text{syst}} \text{ fm}$$

Again consistent with the muonic value. The PRad technique avoided some of the systematic issues that affected earlier Rosenbluth separation analyses.

Muonic Deuterium (2016)

The CREMA collaboration measured the charge radius of the deuteron from muonic deuterium spectroscopy, obtaining a value consistent with the muonic hydrogen extraction when combined with the known neutron charge radius. This confirmed that the muonic method gives consistent results across different nuclei.

Reanalysis of World Electron Scattering Data

Several groups (the York/Toronto group, the Mainz A1 collaboration) reanalyzed the world $ep$ scattering data with more flexible functional forms for $G_E(Q^2)$ at low $Q^2$. They found that the previous extractions were sensitive to the assumed form, and that more conservative analyses yielded radii closer to the muonic value.

CODATA 2018

The Committee on Data for Science and Technology (CODATA) updated its recommended proton radius to:

$$r_p = 0.8414 \pm 0.0019 \text{ fm}$$

This is much closer to the muonic value than the 2010 recommendation, reflecting the new experimental inputs.

The CODATA 2014 Adjustment

Between the major experimental developments, the CODATA 2014 adjustment of fundamental constants faced a dilemma. The muonic hydrogen measurement was the most precise single determination of $r_p$, but it disagreed sharply with the (much larger) body of electronic measurements. CODATA 2014 chose to exclude the muonic hydrogen data and maintained $r_p = 0.8751 \pm 0.0061$ fm — essentially unchanged from 2010. This conservative decision was criticized by some as ignoring the most precise measurement available, but it reflected the genuine uncertainty about whether the discrepancy indicated a systematic problem with the muonic result, an error in the QED corrections, or new physics.

The Two-Photon Exchange Correction

A significant source of theoretical uncertainty in both the electron scattering and the spectroscopic extractions is the two-photon exchange (TPE) correction — a process where the lepton exchanges two virtual photons with the proton simultaneously, rather than one.

In electron-proton scattering, the TPE correction modifies the cross section and can bias the Rosenbluth extraction of $G_E/G_M$. A separate "Rosenbluth vs. polarization transfer" discrepancy in the $G_E^p/G_M^p$ ratio at large $Q^2$, identified around 2000, was attributed to TPE effects. The relevance of TPE for the proton radius extraction at low $Q^2$ has been the subject of extensive theoretical work.

In hydrogen spectroscopy, the TPE contribution to the Lamb shift is related to the proton's electromagnetic polarizabilities — how the proton's charge distribution distorts in response to an applied electric field. This "proton structure" correction is the dominant theoretical uncertainty in the muonic hydrogen extraction, contributing approximately $\pm 0.01$ fm to the radius. Different theoretical evaluations of this correction have yielded somewhat different results, though all are consistent with the muonic hydrogen value of $r_p \approx 0.84$ fm.

Current Status (Mid-2020s)

The consensus has shifted strongly toward the smaller value, $r_p \approx 0.84$ fm. The preponderance of evidence suggests that the original larger value from electron scattering was affected by systematic issues in the low-$Q^2$ form factor extrapolation.

However, some tension remains. The Paris/Orsay group's $1S$--$3S$ hydrogen spectroscopy measurement (2018) yielded $r_p = 0.877 \pm 0.013$ fm — consistent with the older, larger value. And the theoretical understanding of the proton polarizability contribution to muonic hydrogen has not yet reached consensus.

Ongoing and planned experiments will provide definitive resolution:

• MUSE (MUon Scattering Experiment) at PSI will measure both $e$-$p$ and $\mu$-$p$ elastic scattering in the same apparatus, providing a direct test of lepton universality at low $Q^2$.
• PRad-II at Jefferson Lab will improve the precision of the calorimetric $ep$ scattering measurement.
• Hydrogen spectroscopy measurements at multiple laboratories continue to improve.

Impact Beyond the Proton

The CREMA collaboration did not stop at muonic hydrogen. They extended their spectroscopic program to:

• Muonic deuterium ($\mu d$): The deuteron charge radius was measured as $r_d = 2.12562 \pm 0.00078$ fm (2016), consistent with the muonic hydrogen result when combined with the isotope shift data, and again smaller than the previous electronic value ($r_d = 2.1424 \pm 0.0021$ fm from CODATA 2010).

• Muonic helium-3 and helium-4: Measurements of the Lamb shift in muonic $^3$He and $^4$He provide charge radii of the helium isotopes with unprecedented precision — directly relevant to nuclear structure (the helium charge radii constrain nuclear models) and to the $^3$He-$^3$H charge radius difference (a test of charge symmetry).

These measurements have opened a new field: muonic atom spectroscopy as a precision nuclear structure tool. The charge radii of light nuclei, which require enormous experimental effort to measure by electron scattering, can be determined from muonic atom spectroscopy with an order of magnitude better precision. Future extensions to heavier muonic atoms ($\mu$-Li, $\mu$-Be, $\mu$-C) are under discussion and could provide a new, independent method for mapping nuclear charge radii across the chart of nuclides.

Lessons for Nuclear and Particle Physics

1. Precision Reveals Physics

The proton radius was "known" for decades. It took a new experimental method — muonic atom spectroscopy — with dramatically improved sensitivity to uncover a discrepancy. The puzzle did not arise from a dramatic failure but from a $4\%$ shift in a quantity that everyone thought was well-determined. In physics, precision is not mere refinement — it is a discovery tool.

2. Systematics Are the Enemy

The original discrepancy was not due to statistical fluctuations — both measurements had small statistical errors. The issue was systematic: the functional form assumed for the $Q^2$-extrapolation of $G_E(Q^2)$ in electron scattering biased the result. This is a universal lesson: in precision experiments, the dominant uncertainty is almost always systematic, and it is almost always harder to quantify than statistical uncertainty.

3. The Power of Complementary Methods

The resolution came not from repeating the same measurement more precisely but from bringing multiple independent methods to bear — muonic spectroscopy, electronic spectroscopy with different transitions, electron scattering with novel detectors, and independent theoretical cross-checks. Complementarity is more powerful than precision alone.

4. Nuclear Physics at the Precision Frontier

The proton radius puzzle sits at the intersection of nuclear physics (the proton is a nuclear object), atomic physics (the measurements are spectroscopic), and particle physics (lepton universality tests). It illustrates how the boundaries between these fields dissolve at the precision frontier — and how nuclear structure (in this case, the proton's internal charge distribution) matters for fundamental physics.

Discussion Questions

1. Why is muonic hydrogen so much more sensitive to the proton charge radius than ordinary hydrogen? Calculate the ratio of the wavefunction overlap with the proton for the two cases.

2. The proton radius puzzle stimulated searches for new physics (violation of lepton universality). Even though no new physics was found, was this investigation valuable? What did we learn?

3. The functional form used to fit $G_E^p(Q^2)$ at low $Q^2$ significantly affects the extracted radius. In general, how should one choose a fitting function when extrapolating data to a region where no measurements exist? What statistical tools are available?

4. The MUSE experiment at PSI will measure both electron-proton and muon-proton scattering in the same apparatus. What specific systematic uncertainties does this eliminate? Design an ideal experiment to test lepton universality in elastic scattering.

5. The proton charge radius enters the calculation of hydrogen energy levels at the part-per-million level. Why is it important to know $r_p$ precisely for tests of bound-state QED? How does the uncertainty in $r_p$ compare to the uncertainty in other fundamental constants used in the hydrogen energy level calculation?

6. Muonic atom spectroscopy is being extended to heavier nuclei (helium, lithium, beryllium). What advantages does this technique offer over electron scattering for measuring nuclear charge radii? What new challenges arise for heavier muonic atoms (hint: consider nuclear polarization effects)?