Spark Accumulators to instrument Pyspark Jobs using SparkListener

后端 未结 0 698
北海茫月
北海茫月 2021-02-03 13:12

I am trying to use accumulators in pyspark to instrument my udf\'s or custom spark methods in my pyspark jobs. I have written a custom SparkListener in java/scala to listen to t

相关标签:
回答
  • 消灭零回复
提交回复
热议问题