In the empirical risk minimization formula that I am using for my neural net, the formula for updating the weights looks as follows:
Delta = (-Gradient of weight