Just noticed the Simulator for the devices that do not run arm64 (so iPhone4/5, iPad 2, which should be running i386 simulator) runs x86_64 in the simulator for release mode now
Set Build Active Architecture Only to Yes