Trying to reduce empty pyspark dataframes using unionall

Question

My pyspark version is 2.4.3 which i am running on databricks.

My code works in a loop and creates 3 dataframes. Now depending upon the conditions, they might have dat