Searching a HDF5 dataset

Question

I\'m currently exploring HDF5. I\'ve read the interesting comments from the thread \"Evaluating HDF5\" and I understand that HDF5 is a solution of choice for storing the dat

Answer 1

Perhaps this paper will be very helpful to you. http://www.cse.ohio-state.edu/~wayi/papers/HDF5_SQL.pdf

Is this what you need? You can query a HDF5 data with SQL, which is a declarative language.

Unlike FastQuery, there is no index in this work, but our group also provides an open source version with bitmap index.

Moreover, if you want to complete the query (especially for aggregation) in real time, you should consider approximate aggregation or online aggregation. I have also developed some products which directly work on HDF5.

Furthermore, some queries over HDF5 can be much more complex than what you may have seen in relational databases. Some queries are array-oriented rather than relational table-oriented. Just google "SciQL", then you can find some complex and unique query types for array-based data model, which can certainly be applied to HDF5. Do you need to perform those kind of queries? I have also developed a product to support some of the complicated query types there.