Friday, March 8, 2013

denormalizing in google cloud sql prior to uploading to bigquery

I need to denormalize a db and I have a sql dump of the db as well as corresponding csv files for the tables in the dump.  I need to denormalize the data and eventually upload into bigquery.  bigquery doesn't look like the platform to denormalize the data.  I was considering using google cloud sql to denormalize, running a number of join scripts on the tables.  I have tables with the following number of rows:

T1: 400M rows
T2: 2M    rows
T3: 800K rows
+ about 10 other tables with between 10K - 300K rows

Is google cloud sql a possible solution?  Suggestions?  Thank you

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

No comments:

Post a Comment