Spark Streaming does not recover pending batches (TextFileStream)

Question

I am using Spark 2.3.1 in order to process a stream of text files. Context setup is as follows:

val ssc = new StreamingC