How to handle fields enclosed within quotes(CSV) in importing data from S3 into DynamoDB using EMR/Hive

前端 未结 7 1070
梦毁少年i
梦毁少年i 2020-12-28 17:14

I am trying to use EMR/Hive to import data from S3 into DynamoDB. My CSV file has fields which are enclosed within double quotes and separated by comma. While creating exter

相关标签:
7条回答
  • 2020-12-28 18:16

    There can be multiple solutions to this problem.

    1. Write custom SerDe class
    2. Use RegexSerde
    3. Remove escaped delimiter chars from data

    Read more at http://grokbase.com/t/hive/user/117t2c6zhe/urgent-hive-not-respecting-escaped-delimiter-characters

    0 讨论(0)
提交回复
热议问题