optimal size of a tfrecord file

问题

From your experience, what would be an ideal size of a .tfrecord file that would work best across a wide variety of devices (hard-disk, ssd, nvme) and storage locations (local machine, hpc cluster with network mounts) ?

In case I get slower performance on a technically more powerful computer in the cloud than on my local PC, could the size of the tfrecord dataset be the root cause of the bottleneck ?

Thanks

回答1:

Official Tensorflow website recommends ~100MB (https://www.tensorflow.org/performance/performance_guide)

来源：https://stackoverflow.com/questions/52191167/optimal-size-of-a-tfrecord-file