Neural Network does not converge when using RELU or Leaky Relu

Question

I have programmed a simple NN library which creates a neural network with any size chosen and can train the network with a given activation function and its derivative. The