load-data-infile

I am contemplating a switch from MySQL to PostgreSQL. What are your tips, tricks and gotchas for working with PostgreSQL? What should a MySQLer look out for? See also: How different is PostgreSQL to MySQL? See also: Migrate from MySQL to PostgreSQL Note - I don't think this is a duplicate. In particular the type of answers are quite diffferent and the responses here have much more implementation detail, which is what I was looking for rfusca Just went through this myself, well I still am... Case sensitive text Lack of INSERT IGNORE and REPLACE Explicit casting needed almost everywhere No

I'm using MySQL LOAD DATA INFILE to move CSV file data into a database table. I'm looking for a way to reference the original file line number (row) in the imported record. So that a table like this: CREATE TABLE tableName ( uniqueId INT UNSIGNED NOT NULL PRIMARY_KEY, import_file VARCHAR(100), import_line INT, import_date = DATETIME, fieldA VARCHAR(100), fieldB VARCHAR(100), fieldC VARCHAR(100) ); Where import_file,import_line and import data are meta data relevant to the specific file import. fieldA, fieldB and fieldC represent the actual data in the file. Would be updated by a query like

I am trying to load data into a table of my MySQL database, and getting this error. LOAD DATA LOCAL INFILE 'C:\Users\Myself\Desktop\Blah Blah\LOAD DATA\week.txt' INTO TABLE week; Reference: this The path is hundred percent correct, I copied it by pressing shift and clicking "copy path as" and checked it many times. So any tips on this will be much appreciated . . My research: Seeing this answer, I tried by changing C:\Users to C:\\Users . It did not work for me. Secondly, is there a way to use some kind of a relative path (rather than an absolute path) here? I don't know what version of MySQL

I've got several CSV files I want to import into a table. They all contain different numbers of columns, so some data will be absent during each import. I need a tool that will let me map which CSV column goes into which MySQL column. Doesn't look like MySQL workbench can do this. What else can I use? MySQL has the LOAD DATA INFILE syntax: LOAD DATA INFILE 'data.txt' INTO TABLE tbl_name FIELDS TERMINATED BY ',' ENCLOSED BY '"' LINES TERMINATED BY '\r\n' IGNORE 1 LINES; See the documentation about custom data handling. jranz If you're running on a Mac, Sequel Pro is pretty good for this sort of

I recently upgraded my Ubuntu 10.04 dev server to 14.04. It is actually a fresh install. PHP version was 5.4.15, and is now PHP 5.5.9. MySQL went from 5.1.67 to 5.5.37. I am trying to LOAD LOCAL DATA INFILE on a new server. It works running the command using the local mysql cli client. It does not work when executing using PDO: PHP Fatal error: Uncaught exception 'PDOException' with message 'SQLSTATE[42000]: Syntax error or access violation: 1148 The used command is not allowed with this MySQL version' in /home/ubuntu/mysqltest.php:21 Stack trace: #0 /home/ubuntu/mysqltest.php(21): PDO->exec(

I am looking for a syntax definition, example, sample code, wiki, etc. for executing a LOAD DATA LOCAL INFILE command from python. I believe I can use mysqlimport as well if that is available, so any feedback (and code snippet) on which is the better route, is welcome. A Google search is not turning up much in the way of current info The goal in either case is the same: Automate loading hundreds of files with a known naming convention & date structure, into a single MySQL table. David Well, using python's MySQLdb, I use this: connection = MySQLdb.Connect(host='**', user='**', passwd='**', db='

Question What is the fastest way to dump a large (> 1GB) XML file into a MySQL database? Data The data in question is the StackOverflow Creative Commons Data Dump. Purpose This will be used in an offline StackOverflow viewer I am building, since I am looking to do some studying/coding in places where I will not have access to the internet. I would like to release this to the rest of the StackOverflow membership for their own use when the project is finished. Problem Originally, I was reading from XML/writing to DB one record at a time. This took about 10 hours to run on my machine. The

Is there a way to dynamically specify a file name in the LOAD DATA INFILE? Can it be parameterized like for instance (syntax may be incorrect) LOAD DATA INFILE '$filename'? A citation from MySQL documentation : The LOAD DATA INFILE statement reads rows from a text file into a table at a very high speed. The file name must be given as a literal string. That means that it can not be a parameter of a prepared statement. But no one forbids to make the string interpolation while the statement is just a string in your PHP code. Unfortunately, this feature is not yet supported in MySQL and is