Import multiple csv files into pandas and concatenate into one DataFrame

前端 未结 16 1773
既然无缘
既然无缘 2020-11-21 07:47

I would like to read several csv files from a directory into pandas and concatenate them into one big DataFrame. I have not been able to figure it out though. Here is what I

16条回答
  •  醉酒成梦
    2020-11-21 08:10

    one liner using map, but if you'd like to specify additional args, you could do:

    import pandas as pd
    import glob
    import functools
    
    df = pd.concat(map(functools.partial(pd.read_csv, sep='|', compression=None), 
                        glob.glob("data/*.csv")))
    

    Note: map by itself does not let you supply additional args.

提交回复
热议问题