Apache Spark Aggregate JSONL DataFrames Grouped By keeping null values

Question

I am pretty new to Spark so I might use some help from you.

I have a couple of JSONL files like these in an S3 bucket, each one of them has a field which contains the nam