Pandas Udf in Pyspark running in only 1 Executor in yarn client or cluster mode

后端 未结 0 1332
爱一瞬间的悲伤
爱一瞬间的悲伤 2021-01-23 21:05

I have a code which reads data from Hive Table and applies a pandas udf, the moment it reads data from table it runs in 11 executors , however the moment it executes a pandas ud

相关标签:
回答
  • 消灭零回复
提交回复
热议问题