Please see Multiple APK Support in the Android documentation. This details some of the specifics of releasing multiple APKs of the same product/application.
As for the NDK specifics, and as already mentioned, you can utilize multiple platforms / ABIs in the APP_ABI value of your Android.mk.