Tensorflow Dataset using many compressed numpy files
问题 I have a large dataset that I would like to use for training in Tensorflow. The data is stored in compressed numpy format (using numpy.savez_compressed ). There are variable numbers of images per file due to the way they are produced. Currently I use a Keras Sequence based generator object to train, but I'd like to move entirely to Tensorflow without Keras. I'm looking at the Dataset API on the TF website, but it is not obvious how I might use this to read numpy data. My first idea was this