How to optimally decides the number of partition in dataframe dynamically?

Question

I have two dataframes of around 11 million records .After transformation and some window analytic function I am having around 7 million records .I am currently trying to fin