We have an application based on Spark Structured Streaming 2.4.6, reading from a Kafka topic, doing some calculation or aggregation according to the users\' configuration(hi