Tuesday, April 23, 2013

R package JDBC dbWriteTable painfully slow

Hello, i am on ubunto 64-bit R package and have connected to the google mysql cloud with the RJDBC package.  This creates a java based mysql connection to the google cloud db.   I am on fios internet.  db reads from the cloud are fantasticly fast.   dbWriteTable is painfully slow - like 10 minutes per table creation.   The ubunto system monitor is showing about 90kib/s sending and 16.1 kib/s receiving during the app connection to cloud while the app is creating a writing data to the new table.    Verizon speed test is showing 8 mbps send and 16 mb receive on the ethernet connection. 

Why is the dbWriteTable command so painfully slow?   Is there a buffer setting/cache/replication setting i need to change.   I appears to me that the cloud db is creating the latency which is crushing the write speed.

Once establishing the core dataset - updates will be much smaller.  So this is a one time thing - like turn off replication while i create the table? 

 

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

No comments:

Post a Comment