I have multiple csv files that I would like to combine into one df.
They are all in this general format, with two index columns:
I think you need concat instead merge:
merge
df = pd.concat([pd.read_csv(f, index_col=[0,1]) for f in files])