Can i use the same huffman table to decode and encode each frame in a video?

Question

Currently working on a code where I used motion compensated predicition using SAD/SSD. It all works (by which i mean the PSNR and BPP are hitting the desired values) but I find