Loss Design with two ground truth when combine image style

Question

I am working on to generate an image, which shall be similar to two different input images. Or to say, combine the styles of two inputs.

The structure i am using is a