This question is pretty much a follow up from Pandas pivot or reshape dataframe with NaN
When decoding videos some frames go missing and that data needs to be interpo