Read a csv file from aws s3 using boto and pandas

前端 未结 3 497
一整个雨季
一整个雨季 2021-02-04 07:14

I have already read through the answers available here and here and these do not help.

I am trying to read a csv object from S3 bucket and have

3条回答
  •  粉色の甜心
    2021-02-04 08:09

    Maybe you can try to use pandas read_sql and pyathena:

    from pyathena import connect
    import pandas as pd
    
    conn = connect(s3_staging_dir='s3://bucket/folder',region_name='region')
    df = pd.read_sql('select * from database.table', conn)
    

提交回复
热议问题