Deep Learning Dictionary - Lightweight Crash Course

Batch Size - Deep Learning Dictionary

Often times for example purposes, when discussing neural network training, we may talk about passing one sample from the data set to the network at a time, or even passing the entire data set to the network at once, but in reality, neither one of these options are the typical, optimal choice.

Instead, we split the data set up into batches and pass each batch of samples to the network separately. These batches are sometimes also referred to as mini-batches.