which is better to copy the files on worker nodes or use Sparkfiles addFile?

前端 未结 0 1954
旧巷少年郎
旧巷少年郎 2020-11-30 03:26

Which is better to copy the file on worker nodes or use Sparkfiles sc.addFile? How Spark works if I copy the text file on all nodes? Do the file partition among the nodes or

相关标签:
回答
  • 消灭零回复
提交回复
热议问题