Estimator with Coordinator as an input function for reading input data in distributed fashion in tensorflow

穿精又带淫゛_ 提交于 2019-12-25 12:23:11

问题


The CNN cifar10 tutorial (tensor flow tutorials) gives an example of low-level API use for reading data as an independent job to train model (with multiple GPU). Is it possible to use high-level API Estimator with low-level threading support and multi/single GPUs training?

I am looking for a way to combine both:

  • The custom Estimator from high-level API, details https://www.tensorflow.org/extend/estimators

  • input_fn as a queue, which gives the same functionality which is described in https://www.tensorflow.org/programmers_guide/reading_data for Coordinator class

    coord = tf.train.Coordinator()
    threads = tf.train.start_queue_runners(sess=sess, coord=coord)
    

It is not straightforward to me!


回答1:


I push a code to here.
It is support input_fn as a queue when using estimator. High-level API Estimator with low-level threading support and multi/single GPUs training. And easy to customer code all of you need.



来源:https://stackoverflow.com/questions/42529598/estimator-with-coordinator-as-an-input-function-for-reading-input-data-in-distri

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!