Some algorithms in the literature allow to recover input data used to train a neural network .. this is done using the gradients (updates) of weights, such as in https://arx