Are you exploiting because it is genuinely optimal, or because you are risk-averse and prefer the certainty of known rewards? - Are you exploring because it is genuinely valuable, or because you are avoiding the commitment required by exploitation? - Apply UCB thinking: if an option is highly uncert