Saturday, January 20, 2018

[google-cloud-sql-discuss] Re: Very Slow mysqldump Execution (First Gen to Second Gen)

Hello Eran,

I can have a quick look. You can provide me with the following information in a private message:

1. Project-number
2. Cloud SQL instances and Compute engine instance names 
3. Confirm if you are following this documentation[1].
4. Output of the : gcloud sql operations list -i <instance-name>
                          gcloud sql operations describe <operation-id-associated-with-the-export>


[1] https://cloud.google.com/sql/docs/mysql/upgrade-2nd-gen

On Saturday, January 20, 2018 at 2:50:45 PM UTC-5, Eran Dagan wrote:
Hello,
I'm currently in the process of migrating a First Generation instance to a Second Generation one.
I've prepared both instances in terms of auth, users, storage, RAM etc.

Problem is, once I set the instance into read only mode and run mysqldump with the recommended flags, the dumping process is painfully slow (it runs on average of 300KB/s, for a 5GB database)
The script is running from a Compute Engine instances which is located in the same region of both First Gen & Second Gen instances, and has sufficient RAM & CPU for the migration.

Metadata:
- D4 First Gen Instance (~5GB) [europe-west]
- Largest table is around 4GB, the rest are rather small
- n1-standard-1 Compute Engine Machine [europe-west]
- Second Gen Instance also located in europe west, but I didn't even get to the point of importing the data to it (export was taking too long I had to halt the migration)
- It seems like the dumping process starts up pretty fast (14MB/s) and then slows down to 300KB/s

Any advice? I can't have such a long downtime for this migration

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/f5705df4-d4f0-4181-9f2f-588ac9d85db7%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

No comments:

Post a Comment