I have a spark structured streaming job that does the following:
Streams from S3 Folder a file containing json (many json