How to pass data to Matplotlib plot, from a serial port process/thread, to avoid figure freeze?

Question

I have a process to get data from the serial port that comes in every 10ms-10sec. If I update the plot directly from the serial process, the GUI freezes in-between updates.