variational auto encoder loss goes down but does not reconstruct input. out of debugging ideas. works on mnist but not on other data

Question

My variational autoencoder seems to work for MNIST, but fails on slightly "harder" data.
By "fails" I mean there are at least two apparent problems