Case Study 1: Fine Structure — Precision Spectroscopy Meets Quantum Mechanics

Overview

The fine structure of hydrogen is not merely an academic exercise in perturbation theory — it is one of the great triumphs of theoretical physics, and its increasingly precise measurement has driven the development of quantum mechanics, quantum electrodynamics, and modern precision metrology. This case study traces the interplay between spectroscopic measurement and theoretical prediction from Michelson's first observations in the 1890s to modern laser spectroscopy experiments that test QED to 12 significant figures.

Part 1: Michelson and the First Hints (1891)

The Observation

In 1891, Albert A. Michelson — the same Michelson of Michelson-Morley fame — used his newly invented interferometer to examine the hydrogen spectral lines with unprecedented resolution. Conventional spectroscopes showed hydrogen's Balmer series as sharp, bright lines at well-defined wavelengths. But Michelson's interferometer could detect structure within individual lines.

What he found was startling. The red Balmer-$\alpha$ line (the $n = 3 \to n = 2$ transition at 656.3 nm) was not a single line. It was a cluster of closely spaced components separated by about 0.3 cm$^{-1}$ — roughly 10,000 times narrower than the line's wavelength but clearly resolved by his instrument.

The Theoretical Vacuum

In 1891, there was no quantum mechanics — not even the Bohr model, which would not arrive until 1913. There was no theoretical framework that could explain why a single atomic transition should produce multiple closely spaced lines. Michelson measured the splitting, tabulated it carefully, and essentially placed it on the shelf. The explanation would have to wait.

What We Know Now

Michelson was observing the hydrogen fine structure. The $n = 3$ level splits into three fine structure sub-levels ($j = 1/2$, $3/2$, $5/2$), and the $n = 2$ level splits into two ($j = 1/2$, $3/2$). The selection rules allow five distinct transition frequencies, clustered within a range of about 0.4 cm$^{-1}$ — exactly what Michelson observed.

Part 2: Sommerfeld's Triumph and Its Lucky Accuracy (1916)

The Old Quantum Theory Approach

Arnold Sommerfeld, working within the "old quantum theory" framework of Bohr and Sommerfeld, extended the Bohr model to include elliptical orbits and relativistic effects. An electron in an elliptical orbit moves faster near the nucleus (perihelion) than far away (aphelion). For inner orbits with high eccentricity, the speeds approach a significant fraction of $c$, and relativistic corrections become important.

Sommerfeld's key insight was that the relativistic mass increase of the electron causes the orbit to precess — the perihelion advances, much like Mercury's orbit in general relativity. This precession means the orbit no longer closes, and different angular momentum states (different eccentricities for the same energy) acquire different energies.

Sommerfeld's Formula

In 1916, Sommerfeld derived:

$$E_{n,k} = -\frac{m_e c^2 \alpha^2}{2n^2}\left[1 + \frac{\alpha^2}{n^2}\left(\frac{n}{k} - \frac{3}{4}\right)\right]$$

where $k$ was Sommerfeld's azimuthal quantum number ($k = 1, 2, \ldots, n$ in the old quantum theory, corresponding to $l + 1$ in modern notation — but also, coincidentally, to $j + 1/2$ in the correct quantum mechanical treatment).

The Lucky Coincidence

Sommerfeld's formula gives exactly the same fine structure splitting as the correct Dirac result. This is one of the most remarkable coincidences in the history of physics. Sommerfeld's derivation was wrong in multiple ways:

1. He used circular/elliptical orbits, not wave functions
2. He did not know about electron spin
3. He did not include the Darwin term or spin-orbit coupling
4. His quantum number $k$ mixed up two physically distinct quantities ($l + 1$ and $j + 1/2$)

Yet the final formula is exactly right. The reason is a deep mathematical coincidence: the accidental degeneracy of the Coulomb problem (the $\mathrm{SO}(4)$ symmetry) causes the relativistic correction, spin-orbit coupling, and Darwin term to combine into a result that depends on $j$ alone — and $j + 1/2$ just happens to match Sommerfeld's $k$.

This "lucky" agreement had a pernicious effect: it delayed the recognition that the old quantum theory was fundamentally flawed, since its predictions for hydrogen fine structure were accidentally correct.

Part 3: Dirac's Equation and the Definitive Formula (1928)

A Truly Relativistic Theory

In 1928, Paul Dirac published his relativistic wave equation for the electron. The Dirac equation is the correct synthesis of quantum mechanics and special relativity for spin-1/2 particles. Unlike Sommerfeld's approach, Dirac's equation:

• Predicts electron spin automatically (it was not put in by hand)
• Includes the relativistic correction, spin-orbit coupling, and Darwin term as a single unified effect
• Gives exact energy levels, not just perturbative approximations

The exact Dirac energy levels for hydrogen are:

$$E_{nj} = m_e c^2 \left[1 + \left(\frac{\alpha}{n - (j + 1/2) + \sqrt{(j+1/2)^2 - \alpha^2}}\right)^2\right]^{-1/2}$$

Expanding to order $\alpha^4$, this reproduces the Sommerfeld formula exactly. But the Dirac formula also predicts higher-order corrections (order $\alpha^6$, $\alpha^8$, etc.) that are in principle measurable.

What Dirac Predicted — and What He Missed

The Dirac equation predicts that the $2s_{1/2}$ and $2p_{1/2}$ states should have exactly the same energy. Both have $n = 2$ and $j = 1/2$. This $l$-degeneracy within a given $j$ level is a consequence of the exact symmetry of the Dirac equation with a Coulomb potential.

But nature had another surprise in store.

Part 4: The Lamb Shift — QED Triumphant (1947)

The Experiment That Changed Physics

In 1947, Willis Lamb and Robert Retherford used microwave spectroscopy — a technology developed during World War II for radar — to directly measure the energy difference between the $2s_{1/2}$ and $2p_{1/2}$ states of hydrogen. The Dirac equation predicted this difference to be exactly zero.

Lamb and Retherford found it was not zero. The $2s_{1/2}$ state lay above the $2p_{1/2}$ state by about 1057 MHz (0.035 cm$^{-1}$ or $4.37 \times 10^{-6}$ eV). This tiny discrepancy — the Lamb shift — could not be explained by any known physics.

The Resolution: Quantum Electrodynamics

The Lamb shift was explained by quantum electrodynamic (QED) effects not present in the single-particle Dirac equation:

1. Vacuum fluctuations: The quantum electromagnetic vacuum is not truly empty — virtual photon-electron pairs constantly appear and disappear. These fluctuations "jiggle" the electron, effectively smearing its charge over a region of size $\sim \alpha a_0 \ln(1/\alpha)$. This smearing affects $s$-states (which penetrate to the nucleus) more than $p$-states.

2. Electron self-energy: The electron interacts with its own electromagnetic field, acquiring a correction to its mass and energy.

3. Vacuum polarization: Virtual electron-positron pairs screen the nuclear charge, modifying the effective potential at short distances.

Hans Bethe performed the first successful QED calculation of the Lamb shift in 1947, during a train ride from the Shelter Island conference. His non-relativistic estimate gave 1040 MHz — remarkably close to the experimental value of 1057 MHz. Julian Schwinger, Richard Feynman, and Sin-Itiro Tomonaga independently developed the full relativistic QED calculation, which agreed with experiment to extraordinary precision. This was the triumph that established QED as the correct theory of electromagnetic interactions.

The Hierarchy Completed

With the Lamb shift, the complete hierarchy of hydrogen energy corrections is:

Part 5: Modern Precision Spectroscopy

The 1S-2S Transition

Today, the most precisely measured transition in hydrogen is the two-photon $1S_{1/2} \to 2S_{1/2}$ transition at 2466 THz (121.6 nm, or equivalently two photons at 243.1 nm). This transition is special because:

1. Both states are $s$-states, so the natural linewidth is extremely narrow (the $2s$ state is metastable with a lifetime of $\sim 0.14$ s)
2. The two-photon technique eliminates first-order Doppler broadening
3. Modern laser frequency combs allow measurement of optical frequencies with extraordinary precision

The current measurement precision is about 4 parts in $10^{15}$ — one of the most precise measurements in all of science. This measurement, combined with the theory, determines the Rydberg constant $R_\infty$ to 12 significant figures and provides stringent tests of QED.

The Proton Radius Puzzle

In 2010, the CREMA collaboration at the Paul Scherrer Institute measured the Lamb shift in muonic hydrogen — a hydrogen-like atom where the electron is replaced by a muon ($m_\mu \approx 207 m_e$). Because the muon is much heavier, it orbits 207 times closer to the proton, making it 207 times more sensitive to the proton's finite charge radius.

The muonic hydrogen measurement yielded a proton charge radius of $r_p = 0.841$ fm, which differed from the then-accepted value (from electronic hydrogen and electron scattering) of $r_p = 0.877$ fm by more than 5 standard deviations. This "proton radius puzzle" generated enormous controversy and motivated a decade of new experiments.

As of the mid-2020s, the puzzle appears largely resolved: newer electronic hydrogen measurements and re-analyses of electron scattering data have converged toward the smaller muonic hydrogen value. But the episode dramatically illustrates how precision spectroscopy of the simplest atom continues to probe the frontiers of physics.

Analysis Questions

1. Sensitivity analysis: The fine structure splitting of the $n = 2$ level is $\Delta E_{\text{FS}} \approx \alpha^2 E_2 / 4$. If the fine structure constant were $\alpha = 1/100$ instead of $1/137$, by what factor would the fine structure splitting change? Would the Lamb shift still be a small correction to the fine structure?

2. Historical counterfactual: If Sommerfeld's formula had not accidentally agreed with the correct quantum mechanical result, the inadequacy of the old quantum theory would have been recognized earlier. What specific prediction of Sommerfeld's theory would have disagreed with the correct result, and by how much?

3. Error analysis: Lamb and Retherford's original measurement (1947) had an uncertainty of about 10 MHz. The current best measurement of the $2s_{1/2} - 2p_{1/2}$ splitting is 1057.845(9) MHz. What fractional improvement is this, and what experimental advances enabled it?

4. The proton radius puzzle: The Lamb shift in hydrogen depends on the proton charge radius $r_p$ through the term $\Delta E = (2\alpha^4 m_e c^2 / 3n^3)(r_p / a_0)^2$ (for $s$-states). Calculate this correction for the $2s$ state using $r_p = 0.84$ fm and $r_p = 0.88$ fm. What is the difference in MHz? Is this within the measurement precision?

5. Design challenge: You are designing a spectroscopy experiment to measure the hydrogen fine structure. You need to resolve the $n = 3$ fine structure components (total spread $\sim 0.2$ cm$^{-1}$). What spectral resolution (in cm$^{-1}$) do you need? What kind of spectrometer could achieve this?

Key Takeaways from This Case Study

• The fine structure of hydrogen was observed (Michelson, 1891) decades before the theoretical explanation was available.
• Sommerfeld's old quantum theory (1916) gave the correct fine structure formula by a remarkable coincidence, delaying recognition of its fundamental flaws.
• The Dirac equation (1928) provided the first correct derivation, unifying relativity and quantum mechanics.
• The Lamb shift (1947) revealed effects beyond the Dirac equation, establishing quantum electrodynamics as the correct theory.
• Modern hydrogen spectroscopy achieves precisions of parts in $10^{15}$, testing QED at the frontier and even probing the internal structure of the proton.
• The simple hydrogen atom continues to serve as the most stringent testing ground for fundamental physics.