Spark Parallelize? (Could not find creator property with name 'id')

前端 未结 4 1568
灰色年华
灰色年华 2020-12-30 01:21

What causes this Serialization error in Apache Spark 1.4.0 when calling:

sc.parallelize(strList, 4)

This exception is thrown:



        
4条回答
  •  隐瞒了意图╮
    2020-12-30 02:05

    I had the same problem with a project built with Gradle and I excluded the transitive dependencies from the project that was creating the problem:

    dependencies
    {
        compile('dependency.causing:problem:version')
        {
            exclude module: 'jackson-databind'
        }
    
    ....
    
    }
    

    That worked perfectly for me.

提交回复
热议问题