Is it memory expensive to wrap pretrained models from tf.keras.applications in tf.keras.layers.TimeDistributed layers?

Question

I have a Titan RTX with 24GB of memory... and I cannot wrap even mobilenetV2 in a tf.keras.layers.TimeDistributed layer, followed by an LSTM with 256 units, and train withou