I found many TF models would raise error when they are saved to SavedModel.
These include older version of keras, and even examples on TF official website. (See the issue