Inferencing with Tensorflow Serving using Java
问题 We are transitioning an existing Java production code to use Tensorflow Serving (TFS) for inferencing. We have already retrained our models and saved them using the new SavedModel format (no more frozen graphs!!). From the documentation that I have read, TFS does not directly support Java. However it does provide a gRPC interface, and that does provide a Java interface. My question, what are the steps involved in bringing up a Java application to use TFS. [Edit: moved steps to a solution] 回答1