PyTables seems to be the correct data storage

The PyTables package is a Python interface to HDF5, which is a general purpose library and file format for storing scientific data made at NCSA. HDF5 can store two primary objects: datasets and groups. A dataset is essentially a multidimensional array of data elements, and a group is a structure for organizing objects in an HDF5 file (very similar to a directory in a filesystem).

No related posts.