**One-sentence definition:** The fundamental tension between gathering new information (exploration) and acting on information you already have (exploitation). - **Mathematical abstraction:** The multi-armed bandit problem. - **Biological instance:** Bacterial chemotaxis (run-and-tumble), immune sys