What is the fastest way to merge two datasets in real time based on an ID?

Question

I have two datasets from my crawling code which should be merged in real time based on an ID. I know this is possible using pandas DataFrame and merge method. But I