Re: denormalizing in google cloud sql prior to uploading to bigquery

Unsure if it's one time.  We're going to receive the weekly delta on each table, but those may be too large to join to the existing denormalized table.  Will approach the problem at this point as if it's one-off, but start planning for the alternative scenario.  Thanks.

On Friday, March 8, 2013 11:38:24 AM UTC-5, Razvan Musaloiu-E. wrote:

Is this a one time thing or a continuous one? If it's a one time it might be easier to just do it on a local MySQL server. Keep in mind that joins that create temporary files will not be fast.

-- Razvan ME

On Fri, Mar 8, 2013 at 12:59 AM, ethan <elmo...@gmail.com> wrote:

I need to denormalize a db and I have a sql dump of the db as well as corresponding csv files for the tables in the dump.  I need to denormalize the data and eventually upload into bigquery.  bigquery doesn't look like the platform to denormalize the data.  I was considering using google cloud sql to denormalize, running a number of join scripts on the tables.  I have tables with the following number of rows:

T1: 400M rows

T2: 2M    rows

T3: 800K rows

+ about 10 other tables with between 10K - 300K rows

Is google cloud sql a possible solution?  Suggestions?  Thank you

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.