Is the landscape changing? If so, how fast? - If stable: you can safely reduce exploration over time. - If changing: maintain a permanent exploration budget regardless of how much you know.