My Pyspark job running on AWS EMR cluster with m5.24x large instances ( memory - 384 GB, VCores - 96) - 28 nodes are on the cluster. (total memory - 10.2 TB