What is good test data when comaring Stochastic Gradient Descent algorithms (SGD) | (SGA) | (SAG)

Question

I am trying to compare Stochastic Gradient Descent (SGD), Stochastic Gradient Descent with Averaging (SGA) and Stochastic Averaged Gradient Descent (SAG) to one another. (See Ch