how to skip duplicate records when importing in phpmyadmin

Question

I have a db on my local machine and I want to import the data to the db on my hosting. Both db\'s are identical, the same table names, column names

Answer 1

In phpMyAdmin , in Settings tab, you can try checking the following values:

• Settings -> SQL Queries -> Ignore multiple statement errors

If you are using CSV format:

• Settings -> Import -> CSV -> Do not abort on INSERT error

If you are using SQL format:

• Settings -> Export -> SQL -> Use ignore inserts

Answer 2

There are a couple of ways to do what you want:

The brutal way:

TRUNCATE TABLE yourTbl; -- emtpies out the table

Then import, but you might loose data, so perhaps create a backup table. All things considered, just don't do this, check the alternatives listed below:

Write your own INSERT query, with IGNORE clause:

INSERT IGNORE INTO yourTbl -- as shown in the linked duplicate

But, since you are importing a file, the query will, most likely be a LOAD DATA [LOCAL] INFILE. As you can see in the manual, you can easily add an IGNORE to that query, too:

LOAD DATA LOCAL INFILE '/path/to/files/filename1.csv' IGNORE -- IGNORE goes here
    INTO TABLE your_db.your_tbl
        FIELDS TERMINATED BY ';'
               OPTIONALLY ENCLOSED BY '"'
        LINES TERMINATED BY '\n'
    (`field1`,`field2`);

That's it. Don't worry if you're not too comfortable writing your own queries like this, there are other ways of doing what you want to do:
The CLI way:

mysqlimport -i dbname fileToImport
# Or
mysqlimport --ignore dbname fileToImport

Also CLI, create a file containing the LOAD DATA query above, then:

$: mysql -u root -p
*********** #enter password
mysql> source /path/to/queryFile.sql

This requires you to have access to the command line, and run this command Here's the manual page of MySQL

Using phpMyAdmin, when importing, you'll find a checkbox saying "Ignore duplicates", check that and import. Here's a page with screenshots
You could also choose to check "Ignore errors", but that's another brute-force approach, and I wouldn't recommend that.