Official document TensorFlow SavedModel Warmup says:
The TensorFlow runtime has components that are lazily initialized, which can cause high latency for the