Need help modifying code so it checks for skips any duplicates (GOOGLE COLLAB)

Question

So I came across this code in Google Collab, and there are times it doesn\'t fully complete the task (I have a lot of files so I understand). My problem is that When I redo the