Spark streaming + json4s-jackson dependency problems

后端 未结 2 1981
长发绾君心
长发绾君心 2021-01-18 15:07

I am unable to use json4s-Jackson 3.2.11 within my spark 1.4.1 Streaming application.

Thinking that it was the existing dependency within the spark-core project tha

2条回答
  •  醉梦人生
    2021-01-18 15:38

    Ok, I found the problem. As posted else where, you need to compile against jason4s 3.2.10. Apparently, doing so generates a binary which would then work with Spark (version 1.5 in my case. Same in some earlier versions as well). It has to do with the default parameter in the render() method which shows up in 3.2.11.

提交回复
热议问题