Filtering a pyspark dataframe to get rows from last N days doesn't work correctly and returns some data before the stated date

Question

I added a new column to my spark dataframe by combining these 4 columns year,month,day,time_hour as follow:

df = df.withColumn("tmp_timestamp&q