It is recommended to look at the Stackdriver logs for your job to investigate why it is taking so long. Since you increased the data, this is most likely a memory issue where the workers performing the job do not have enough memory resources to handle your increased data. If you see 'GC (Allocation Failure)' in your logs this is a sign of not enough memory.
-- - The solution is to either audit your code to ensure that you do not have a memory leak, and/or to increase the machine type to an machine with more memory. Also ensure that your work and data can be properly split so that Dataflow can scale up more workers to complete a job instead of tasking a single worker to do it all (which would be limited to machine type resources).
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/113130a3-5c46-4bd7-9031-640953676a02%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
No comments:
Post a Comment