Loading JSON file with serde in Cloudera

前端 未结 2 1763
长发绾君心
长发绾君心 2021-01-25 21:03

I am trying to work with a JSON file with this bag structure :

{
   \"user_id\": \"kim95\",
   \"type\": \"Book\",
   \"title\": \"Modern Database Systems: The O         


        
2条回答
  •  南笙
    南笙 (楼主)
    2021-01-25 21:46

    add jar only add to session which won't be available and finally it is getting error. Get the JAR loaded on all the nodes at Hive and Map Reduce path like the below location so that HIVE and Map Reduce component will pick this whenever it’s been called.

    1. /hadoop/CDH_5.2.0_Linux_parcel/parcels/CDH-5.2.0- 1.cdh5.2.0.p0.36/lib/hive/lib/json-serde-1.3.6-jar-with-dependencies.jar

    2. /hadoop/CDH_5.2.0_Linux_parcel/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/lib/hadoop-mapreduce/lib/json-serde-1.3.6-jar-with-dependencies.jar

    Note: This path varies to cluster.

提交回复
热议问题