how spark.sql.streaming.minBatchesToRetain property affect state store in checkpoint location?

后端 未结 0 1498
时光说笑
时光说笑 2021-01-16 07:47

We currently work on stateful processing and we need to store more than 3 years of data in store.

Then i read this property spark.sql.streaming.minBatchesToReta

相关标签:
回答
  • 消灭零回复
提交回复
热议问题