Use cross-validation throughout

never evaluate on the test set until the final submission. - **Ensemble diverse feature sets** (Chapter 7) for maximum performance.