How to fix stage failure error in Spark while copying dataframe to Spark?

Question

I\'ve been struggling with this one a lot. I keep getting different errors at different times of execution.

I have > 4 GB file which I copied to dbfs filestore using c