I'm getting this error while running the flask app in development mode:
FLASK_ENV=development flask run
The dynamic reloading feature from flask apparently does reload the metadata instances as you might expect. Restarting the app as suggested by "Spcogg the second" resolves this issue for me!