It sounds as if a database is the only real option for you. If you chose SQLite or MySql or Postgres does not really matter in the column index point, though.
Maybe what you really want is a better database abstraction. You might want to try Poco, it has a great one: http://pocoproject.org/
