Deep Learning Dictionary - Lightweight Crash Course

Validation Set and Network Validation - Deep Learning Dictionary

We know that during the training process of a neural network that we train the network on a dataset called the training set.

During the training process, we also incorporate a simultaneous validation process. This validation process supplies us with an unbiased evaluation to see how well our model is able to generalize, which may assist in adjusting our model and hyperparameters to perform better.