Mistake: hand-tuning one parameter at a time instead of searching systematically, or searching too fine a grid (overfitting hyperparameters).