How to automatically clean up the checkpoint files for spark Kafka checkpoints?

前端 未结 0 403
轻奢々
轻奢々 2021-02-01 00:44

I have a long run spark structure streaming job to read data for a Kafka topic. I am using s3 as the kafka checkpoint storage. It works well. However, I saw a lot files were cre

相关标签:
回答
  • 消灭零回复
提交回复
热议问题