How to link against the correct Framework inside a XCFramework for different platforms with xcconfig files

Question

The situation

I was just migrating to latest XCode12.4, thus I have precompiled all of my dependencies to xcframeworks. Now i am using xcconfig