Slicing a large file, removing duplicates and merging into output using Pandas

Question

So, I have a geopackage with 1.25 billion features. The file doesn\'t actually contain geometry and only has one attribute \'id\' which is a unique id. There are a lot of duplic