how to avoid a link to be crawled multiple times

Question

I am using following code to crawl news using newspaper

def extract_news():

    df_news = pd.read_csv(r"file.csv")

    list=[]
    for ind in df_n