AAIA: Advanced in AI Audit

Hyperparameter tuning should be performed using a validation set that is separate from the training data. Tuning on the training set can overfit both the model and the tuning decisions to that data, producing performance results that may not generalize to unseen data.