LOAD DATA LOCAL INFILE fails - from php, to mysql (on Amazon rds)

Question

We're moving our database from being on the webserver to a separate server (from an Amazon EC2 webserver to an RDS instance.)

We have a LOAD DATA INFILE that worked before that is going to need the LOCAL keyword added now that the database will be on a different machine to the webserver.

Testing on my dev server, it turns out that it doesn't work:

• I can still LOAD DATA INFILE from php as I have been
• I can LOAD DATA LOCAL INFILE from mysql commandline (with --local_infile=1)
• I can't LOAD DATA LOCAL INFILE from php.

Between those 2 things that do work, it rules out:

• problems with the sql or php code
• problems with the upload file, including syntax and file permissions
• mysql server settings problems

The error I get is: ERROR 1148 (42000): The used command is not allowed with this MySQL version (I get that error from the mysql commandline if I don't use --local_infile=1)

---

A few other bits of relevant info:

• Ubuntu 12.04, mysql 5.5.24, php 5.3.10
• I'm using php's mysql_connect (instead of mysqli, because we're planning on using facebook's hiphop compiler which doesn't support mysqli.)

• Because of that, the connect command needs an extra flag set:

  mysql_connect($dbHost, $dbUser, $dbPass, false, 128);
  

• I've used phpinfo() to confirm that mysql.allow_local_infile = On
• I've tried it on Amazon RDS (in case it was a problem in my dev server) and it doesn't work there either. (With the local_infile param turned on.)

The only thing I've read about that I haven't tried is to compile mysql server on my dev server with the flag turned on to allow local infile... but even if I get that working on my dev server it's not going to help me with Amazon RDS. (Besides which, LOAD DATA LOCAL INFILE does work from the mysql commandline.)

---

It seems like it's specifically a problem with php's mysql_connect()

Anybody using LOAD DATA LOCAL INFILE (maybe from Amazon RDS) that knows the trick to getting this to work?

Solution 1

I've given up on this, as I think it's a bug in php - in particular the mysql_connect code, which is now deprecated. It could probably be solved by compiling php yourself with changes to the source using steps similar to those mentioned in the bug report that @eggyal mentioned: https://bugs.php.net/bug.php?id=54158

Instead, I'm going to work around it by doing a system() call and using the mysql command line:

$sql = "LOAD DATA LOCAL INFILE '$csvPathAndFile' INTO TABLE $tableName FIELDS TERMINATED BY ',' OPTIONALLY ENCLOSED BY '\\\"' ESCAPED BY '\\\\\\\\' LINES TERMINATED BY '\\\\r\\\\n';";
system("mysql -u $dbUser -h $dbHost --password=$dbPass --local_infile=1 -e \"$sql\" $dbName");

That's working for me.

Solution 2

Here's a check list to rule out this nasty bug:

---

1- Grant the user FILE privileges in MySQL, phpMyAdmin generaly does not cover this privilege:

GRANT FILE ON *.* TO 'db_user'@'localhost';

2- Edit my.cnf in /etc/mysql/ or your mysql path:

[mysql]
local-infile=1
[mysqld]
local-infile=1

3- In php.ini at /etc/php5/cli/ or similar:

mysql.allow_local_infile = On

Optionally you can run ini_set in your script:

ini_set('mysql.allow_local_infile', 1);

4- The database handler library must use the correct options.
PDO:

new PDO('mysql:host='.$db_host.'.;dbname='.$db_name, $db_user, $db_pass,
array(PDO::MYSQL_ATTR_LOCAL_INFILE => 1));

mysqli:

$conn = mysqli_init();
mysqli_options($conn, MYSQLI_OPT_LOCAL_INFILE, true);
mysqli_real_connect($conn,server,user,code,database);

5- Make sure that the INFILE command uses the absolute path to the file and that it exists:

$sql = "LOAD DATA INFILE '".realpath(is_file($file))."'";

6- Check that the target file and parent directory are readable by PHP and by MySQL.

$ sudo chmod 777 file.csv

7- If you are working locally you can remove the LOCAL from your SQL:

LOAD DATA INFILE

Instead of:

LOAD DATA LOCAL INFILE

---

Note: Remember to restart the MySQL and PHP services if you edit their configuration files.

Hope this helps someone.

Solution 3

As referred in this post, adding 3rd and 4th parameter to mysql_connect are required to get LOAD LOCAL DATA INFILE working. It helped me. Any other suggestions (apparmor, local-infile=1 in my.cnf widely discussed in internet) did not help. Following PHP code worked for me!

mysql_connect(HOST,USER,PASS,false,128);

True, this is in manual, too.

Solution 4

use the following line that client activates with infile true

mysql --local-infile=1 -u root -p

View more solutions