How can i insert only unique rows into SQL Server Database table with threadpoolexecutor?

Question

So basically, i am doing an api call and trying to store the extracted dataframe in a SQL Server database table.

The problem is that the table already has some data i