I have made modifications to several example OpenCV projects within Android, however I am having some issues with using OpenCV successfully in a new Android project.
<When you add OpenCV from Properties->Android->libarary->Add you need to leave "Is Library" checkbox unchecked. Go to Project->Properties->Android and uncheck "Is Library" and then try again. It should solve your issue (it did for me) but if it doesn't please take a look at the answers of this question as other people have found some other things to be helpful as well.
When creating a new Android project, the only thing you need to do is
You should not then explicitly add OpenCV Library project into your new Android project's build path:
If you do latter step, you will get the exact error Could not find OpenCV-2.3.1.apk! described in the question.
Check out the New Android project's build path and remove OpenCV project if it exists, then give it another try and see if this helps.
I had this problem when I pulled in the jni_part.cpp file from a sample project. I forgot to change the names of the functions to fit the package name of the class I was using them from:
JNIEXPORT void JNICALL Java_org_opencv_samples_tutorial3_Sample3Native_FindFeatures ->
JNIEXPORT void JNICALL Java_<CLASSNAME_WITH_UNDERSCORES_INSTEAD_OF_DOTS>_<CLASS_NAME>_<METHOD_NAME>
Hope this helps someone.