Case Study 1: Precision Hydrogen Spectroscopy — Testing QM to 12 Digits

Overview

The $1S$-$2S$ transition in atomic hydrogen has been measured with a precision of one part in $10^{14}$ — fifteen significant figures. This measurement, which required decades of technical innovation and pushed the boundaries of laser physics, metrology, and atomic physics simultaneously, represents the single most precisely verified prediction of any scientific theory. This case study traces the journey from early hydrogen spectroscopy to the modern precision frontier, showing how each improvement in measurement accuracy forced corresponding improvements in theoretical understanding.

Part 1: From Balmer to Bohr — The First Century

The Empirical Beginning

In 1885, Johann Jakob Balmer, a Swiss mathematics teacher, noticed that the visible spectral lines of hydrogen could be described by a simple formula:

$$\lambda = B\frac{n^2}{n^2 - 4}, \quad n = 3, 4, 5, 6$$

where $B = 364.56$ nm. Balmer had no physical theory — this was pure numerology, a pattern plucked from the data. But the pattern was exact, and patterns demand explanations.

Johannes Rydberg generalized Balmer's formula in 1888 to all hydrogen series:

$$\frac{1}{\lambda} = R_H\left(\frac{1}{n'^2} - \frac{1}{n^2}\right)$$

with $R_H = 1.0967758 \times 10^7$ m$^{-1}$. This formula predicted lines that had not yet been observed — the Lyman series (ultraviolet, $n' = 1$) and the Paschen series (infrared, $n' = 3$) — and they were subsequently found exactly where predicted.

Bohr's Breakthrough

Niels Bohr's 1913 model explained the Rydberg formula by postulating quantized angular momentum:

$$E_n = -\frac{m_e e^4}{2(4\pi\epsilon_0)^2\hbar^2 n^2} = -\frac{13.6 \text{ eV}}{n^2}$$

The Rydberg constant was now derivable from fundamental constants:

$$R_\infty = \frac{m_e e^4}{8\epsilon_0^2 h^3 c}$$

This was a stunning success: a single formula, derived from first principles, that predicted the entire hydrogen spectrum. But precision spectroscopy soon revealed that the Bohr model was incomplete.

The Fine Structure: Sommerfeld and Dirac

Arnold Sommerfeld (1916) extended Bohr's model to include relativistic effects, predicting that each Bohr level $n$ should split into sub-levels depending on a second quantum number. The Sommerfeld fine-structure formula coincidentally gave the same result as the later Dirac equation — a mathematical accident that confused physicists for years.

Paul Dirac's relativistic wave equation (1928) provided the correct theoretical foundation. The Dirac energy levels for hydrogen are:

$$E_{nj} = m_ec^2\left[\left(1 + \left(\frac{\alpha}{n - j - 1/2 + \sqrt{(j+1/2)^2 - \alpha^2}}\right)^2\right)^{-1/2} - 1\right]$$

Expanding to order $\alpha^4$:

$$E_{nj} \approx -\frac{13.6\text{ eV}}{n^2}\left[1 + \frac{\alpha^2}{n^2}\left(\frac{n}{j+1/2} - \frac{3}{4}\right)\right]$$

The Dirac theory predicted that the $2S_{1/2}$ and $2P_{1/2}$ levels should be exactly degenerate (same $j = 1/2$). This prediction would be tested — and found to fail — in one of the most consequential measurements in physics history.

Part 2: The Lamb Shift — QED is Born

The Experiment That Changed Everything

In 1947, Willis Lamb and Robert Retherford at Columbia University performed a microwave spectroscopy experiment on hydrogen that revolutionized physics. Using a beam of hydrogen atoms, they measured the energy difference between the $2S_{1/2}$ and $2P_{1/2}$ states directly.

The setup: Hydrogen atoms were produced in the metastable $2S_{1/2}$ state by electron bombardment. These atoms traveled through a microwave cavity tuned to the $2S_{1/2} \to 2P_{1/2}$ transition frequency. When the microwave frequency matched the transition, atoms were transferred to the $2P_{1/2}$ state, which immediately decayed to the ground state (lifetime $\sim 1.6$ ns). The surviving $2S_{1/2}$ atoms were detected downstream by their ability to eject electrons from a tungsten surface (the metastable $2S$ state has enough energy to cause electron emission; ground-state atoms do not).

The result: The $2S_{1/2}$ level lies about $1000$ MHz above the $2P_{1/2}$ level — a splitting that the Dirac equation says should be zero.

This measurement was announced at the Shelter Island Conference on June 2-4, 1947, attended by a small but extraordinary group of physicists including Hans Bethe, Richard Feynman, Julian Schwinger, Robert Oppenheimer, John Wheeler, Abraham Pais, and others. The impact was electric. Here was a precise, unambiguous experimental result that the best existing theory (Dirac's equation) could not explain.

Bethe's Train-Ride Calculation

Hans Bethe, on the train from Shelter Island back to Schenectady, New York, performed the first theoretical calculation of the Lamb shift. Working non-relativistically (a bold approximation for a relativistic effect), Bethe identified the dominant contribution: the electron's interaction with the quantized electromagnetic field causes its energy to shift.

The key physics is that the electron, even in a stationary state, constantly emits and reabsorbs virtual photons. This process shifts the electron's energy by an amount that depends on the wavefunction at the nucleus — specifically, on $|\psi(0)|^2$. Since only $s$-states have $|\psi(0)|^2 \neq 0$, the Lamb shift preferentially affects $s$-states.

Bethe obtained approximately 1040 MHz — within 4% of the experimental value. He later described this calculation as "the most important thing I ever did."

The Full QED Calculation

The complete theoretical calculation of the Lamb shift requires the machinery of quantum electrodynamics. The main contributions are:

1. Electron self-energy (dominant, +1017 MHz for $2S$): The electron's cloud of virtual photons effectively smears its charge over a distance $\sim \alpha a_0 \ln(1/\alpha)$, reducing the magnitude of the Coulomb interaction at the nucleus.

2. Vacuum polarization ($-27$ MHz for $2S$): Virtual electron-positron pairs screen the proton's charge at short distances.

3. Two-loop corrections (+0.2 MHz): Higher-order QED diagrams.

4. Nuclear size (+0.15 MHz for $2S$): The proton is not a point charge but has a finite size (charge radius $\sim 0.84$ fm).

The theoretical prediction, including all known terms up to order $\alpha^7$:

$$\Delta E_{\text{Lamb}}(2S_{1/2} - 2P_{1/2}) = 1057.845(9) \text{ MHz}$$

The experimental value (current best):

$$\Delta E_{\text{Lamb}}(2S_{1/2} - 2P_{1/2}) = 1057.845(3) \text{ MHz}$$

Agreement to 7 significant figures.

Part 3: The 1S-2S Transition — The Precision Frontier

Why 1S-2S?

The $1S \to 2S$ transition is the gold standard of precision spectroscopy for several reasons:

1. Narrow natural linewidth: The $2S$ state is metastable (lifetime $\sim 0.14$ s), so the natural linewidth is only $\sim 1.3$ Hz. Compare this to the $2P$ state, with a natural linewidth of $\sim 100$ MHz. Narrower lines can be measured more precisely.

2. Two-photon transition: The $1S \to 2S$ transition requires absorption of two photons (since $\Delta l = 0$ is forbidden for single-photon electric dipole transitions). If the two photons are counter-propagating, first-order Doppler broadening is eliminated. This is the Doppler-free two-photon spectroscopy technique developed by Theodor Hänsch.

3. Large transition frequency: The $1S-2S$ energy is $\frac{3}{4} \times 13.6$ eV, corresponding to a frequency of $2.47 \times 10^{15}$ Hz. A larger frequency allows more precision in a fractional sense.

The Optical Frequency Comb Revolution

Before 2000, optical frequencies ($\sim 10^{14}$ Hz) could not be directly measured — electronic counters work only up to $\sim 10^{10}$ Hz. Measuring the $1S-2S$ frequency required an elaborate "frequency chain" linking a microwave cesium standard to the optical domain through a series of intermediate oscillators. These chains were expensive, room-filling, and fragile.

The optical frequency comb, developed by Theodor Hänsch (Munich) and John Hall (Boulder) in the early 2000s, changed everything. A mode-locked femtosecond laser produces a spectrum consisting of evenly spaced "teeth" — a comb in frequency space:

$$f_n = nf_{\text{rep}} + f_{\text{offset}}$$

where $f_{\text{rep}} \sim 1$ GHz is the repetition rate and $f_{\text{offset}}$ is a carrier-envelope offset frequency. Both $f_{\text{rep}}$ and $f_{\text{offset}}$ are radio frequencies that can be measured precisely with electronic counters and locked to atomic standards.

The comb acts as a "frequency ruler" that directly links optical frequencies to microwave standards. Measuring an optical frequency is reduced to counting which comb tooth the frequency falls on — a problem that requires only a radio-frequency measurement.

Hänsch and Hall shared the 2005 Nobel Prize in Physics for the optical frequency comb.

The Current State of the Art

The most precise measurement of the $1S-2S$ transition (as of 2020, by Hänsch's group at the Max-Planck-Institut für Quantenoptik):

$$f_{1S-2S} = 2,466,061,413,187,035(10) \text{ Hz}$$

This is a fractional uncertainty of $4 \times 10^{-15}$ — fifteen significant figures. To appreciate this precision:

• If you measured the distance from the Earth to the Sun ($1.5 \times 10^{11}$ m) with the same fractional precision, your uncertainty would be less than one micrometer.
• The measurement is so precise that it is sensitive to the gravitational redshift from Earth's tidal bulge.
• The $1S-2S$ frequency is now measured more precisely than the second is defined (the cesium clock uncertainty is $\sim 10^{-16}$, but systematic effects limit practical performance to $\sim 10^{-15}$).

What the Measurement Determines

The $1S-2S$ measurement, combined with the theoretical QED prediction, determines two fundamental quantities:

1. The Rydberg constant $R_\infty$, which is currently known to 12 significant figures: $$R_\infty = 10,973,731.568160(21) \text{ m}^{-1}$$

2. The proton charge radius $r_p$, extracted from the nuclear-size contribution to the Lamb shift. The electronic hydrogen measurements give: $$r_p = 0.8758(77) \text{ fm}$$

These two quantities are entangled in the theory: $R_\infty$ sets the overall energy scale, and $r_p$ enters through the finite nuclear size correction. Disentangling them requires measurements of at least two different transitions.

Part 4: The Legacy and the Future

What Hydrogen Has Taught Us

The spectroscopy of hydrogen has driven the development of physics for over a century:

Ongoing and Future Experiments

• Hydrogen vs. deuterium: Comparing the $1S-2S$ frequency in hydrogen and deuterium determines the difference in nuclear charge radii ($r_p$ vs. $r_d$), testing nuclear structure theory.

• Hydrogen maser in space: The ACES (Atomic Clock Ensemble in Space) mission will compare hydrogen masers on the International Space Station with ground clocks, testing general relativity at the $10^{-6}$ level.

• Antihydrogen spectroscopy: The ALPHA experiment at CERN aims to measure the $1S-2S$ transition in antihydrogen to parts per billion, testing CPT symmetry.

• Nuclear clock transitions: If thorium-229's nuclear isomer transition can be harnessed, nuclear clocks may eventually surpass hydrogen in precision, but hydrogen will remain the benchmark.

Discussion Questions

1. The Lamb shift forced the development of QED. Can you think of other examples in physics where a small discrepancy between theory and experiment led to a major theoretical advance?

2. The $1S-2S$ measurement achieves 15 significant figures. At what point does increased precision cease to be scientifically useful? Is there such a point?

3. The optical frequency comb earned its inventors the Nobel Prize largely because of its utility for hydrogen spectroscopy. Discuss the relationship between instrumentation advances and fundamental physics discoveries.

4. Hans Bethe's train-ride Lamb shift calculation used non-relativistic quantum mechanics to compute a relativistic effect and got within 4% of the correct answer. What does this tell us about the relationship between approximate and exact methods in physics?

Further Exploration

• Read Willis Lamb's Nobel Lecture (1955): "Fine Structure of the Hydrogen Atom." Available online from the Nobel Foundation.
• Watch Theodor Hänsch's Nobel Lecture (2005): "Passion for Precision." A masterful overview of the optical frequency comb and hydrogen spectroscopy.
• Explore the NIST Atomic Spectra Database (physics.nist.gov/asd) for hydrogen transition frequencies — compare the listed values to your calculations in this chapter.