Continuous EMR consistency failures when writing CSV data in Spark

Question

I\'m using Spark to update some CSV metadata.

The structure is that I aggregate a bunch of data into a CSV file and write it into a directory.

Code