What problem does `batch` solve in Tensorflow Dataset pipeline creation and how does it interact with the (mini-) batch size used in training?

Question

When building input pipelines with Tensorflow\'s Dataset API, batching comes up a lot. For example in: tf.data: Build TensorFlow input pipelines or Out