large file import massive slowdown

raphael75's profile image raphael75 posted 2 weeks ago in Import/Export Permalink

I am trying to load a sql file that is 87.2GB and includes creating 37 tables and importing millions of rows of data. I selected the option to split it into multiple queries. It started out fast, but when it got over 2GB the speed of import has almost ground to a halt. It says it's imported around 30 million rows, but the time to completion keeps increasing. It currently has imported 2.5GB and shows 77 hours to finish.

I created this file by concatenating the 37 separate files together into a single file. Would it be more efficient to import each one separately?

raphael75's profile image raphael75 posted 4 days ago Permalink

Please disregard. It actually did manage to complete, but it took about 5 days. But it kept running the whole time, churning away with no issues!

ansgar's profile image ansgar posted 3 days ago Permalink

Glad to hear that worked in the end!

Although I would indeed recommend to use the mysql command line client for such large files.

Please login to leave a reply, or register at first.