Resnet50(10gb) vs half resnet50(30gb) vram comsumption

Question

Hey!

So...Both are Resnet50v2s with the same extra layers added. RED also has the last convolutional block removed.

GREEN: 24.4M para