How to initialize memory state of LSTM and not update the memory state

Question

I\'m trying to replicate the LSTM/HMM hybrid model outlined in this paper:

Improving the Performance of the LSTM and HMM Models via Hybridization (https://arxiv.org/pdf/1