We currently work on stateful processing and we need to store more than 3 years of data in store.
Then i read this property spark.sql.streaming.minBatchesToReta
spark.sql.streaming.minBatchesToReta