Unable to perform join after repartition of pyspark data frame

Question

We are joining two huge files.

So we are trying to repartition on key column and then we are trying to join on the key column.

Code snippet