Loading mysql table into python takes a very long time compared to R

Question

I have a fairly large mysql table, about 30M rows, 6 columns, about 2gb when loaded into memory.

I work with both python and R. In R, I can load the table into memory a

Answer 1

There is also a pure C/C++ ultramysql MySQL driver which can be used with the umysqldb adapter. The projects are not active, but could be of use for a one-time thing - I would not be using them in production though.

Since pymysql is a pure-Python driver, you may also try running it on PyPy.