Check out Essentia http://essentia.upf.edu/
Essentia is an open-source C++ library for audio analysis and audio-based music information ...It contains an extensive collection of reusable algorithms which implement audio input/output functionality, standard digital signal processing blocks, statistical characterization of data, and a large set of spectral, temporal, tonal and high-level music descriptors.
There is also an openFrameworks branch, although you might want to hold off until is officially 64 bit, C++11 in a couple of months.
https://github.com/MTG/essentia