The fundamental tension between gathering new information (exploring) and using existing knowledge for known rewards (exploiting); appears in evolution, business strategy, learning, and algorithm design. *First introduced: Ch. 8*