Monday, July 19, 2021

[google-cloud-sql-discuss] Re: Point in time recovery for CloudSQL migration database (PostgreSQL)?

I've also created an issue to track this feature request.

On Monday, July 19, 2021 at 6:17:49 PM UTC+3 Slava Fomin II wrote:

Hello!

I have a PostgreSQL replica database created in Cloud SQL using the Database Migration tool. Effectively, it's a streaming logical replication of the existing production PostgreSQL database implemented using pglogical extension.

I'm using this replica as a means for backup, archiving and analytics. In order to use it effectively, I need a way to create a separate copy of the replica, probably using point in time recovery to be able to time-travel to the specific point in the past in order to analyze the state of the data or to restore the database from the backup.

However, I can't find a way to actually do this in GCP. There is no option to clone the existing replica database, I can only promote the replica to the stand-alone instance, but this will stop the replication process and I don't want that.

Why does such limitations exist for migration replicas and is there an option to somehow overcome this? Right now, the solution provided by Cloud SQL Migrations are just not suitable for my use case it seams.

Thanks!

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/b784ecc1-d604-4351-a852-6fa8cf8e6880n%40googlegroups.com.

[google-cloud-sql-discuss] Point in time recovery for CloudSQL migration database (PostgreSQL)?

Hello!

I have a PostgreSQL replica database created in Cloud SQL using the Database Migration tool. Effectively, it's a streaming logical replication of the existing production PostgreSQL database implemented using pglogical extension.

I'm using this replica as a means for backup, archiving and analytics. In order to use it effectively, I need a way to create a separate copy of the replica, probably using point in time recovery to be able to time-travel to the specific point in the past in order to analyze the state of the data or to restore the database from the backup.

However, I can't find a way to actually do this in GCP. There is no option to clone the existing replica database, I can only promote the replica to the stand-alone instance, but this will stop the replication process and I don't want that.

Why does such limitations exist for migration replicas and is there an option to somehow overcome this? Right now, the solution provided by Cloud SQL Migrations are just not suitable for my use case it seams.

Thanks!

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/e4e6fdf1-b7cb-4036-b4a6-498790dd2b6en%40googlegroups.com.

[google-cloud-sql-discuss] Re: "too many connections for database" in Postgres.

Hello, 

Can you provide us with the full exact error message.

Thank you.

On Friday, July 16, 2021 at 9:25:27 AM UTC-4 ja...@theclub.tv wrote:
Hey all,

I've been having an issue where the postgres database in Cloud SQL won't allow connections from anything outside the `psql` command line client - there's always a "too many connections for database 'postgres'" error. I've tried multiple things - increasing machine CPU/memory, restarting, even deleting the database instance and setting up a new one (which solved the problem for a few hours, but after a while the problem came back...).

Querying `pg_stat_activity` tells me there's only 9 connections (see attached image), and only 1 of which is from us and not Google Cloud. Screenshot from 2021-07-16 09-58-45.png

The database instance is Postgres 13, db-g1-small with 1.7GB memory, 10GB HDD storage. Public IP is enabled and our IP addresses are definitely whitelisted. The zone is a single zone eu-west2 (London).

Another coworker said he can't even connect with the `psql` cli either, and DBeaver, PGAdmin, or our backend (in node using typeorm/pg modules) are all getting the same "too many connections for database" error.

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/0e30e295-f486-47fe-862a-b59f6ce17451n%40googlegroups.com.

Friday, July 16, 2021

[google-cloud-sql-discuss] "too many connections for database" in Postgres.

Hey all,

I've been having an issue where the postgres database in Cloud SQL won't allow connections from anything outside the `psql` command line client - there's always a "too many connections for database 'postgres'" error. I've tried multiple things - increasing machine CPU/memory, restarting, even deleting the database instance and setting up a new one (which solved the problem for a few hours, but after a while the problem came back...).

Querying `pg_stat_activity` tells me there's only 9 connections (see attached image), and only 1 of which is from us and not Google Cloud. Screenshot from 2021-07-16 09-58-45.png

The database instance is Postgres 13, db-g1-small with 1.7GB memory, 10GB HDD storage. Public IP is enabled and our IP addresses are definitely whitelisted. The zone is a single zone eu-west2 (London).

Another coworker said he can't even connect with the `psql` cli either, and DBeaver, PGAdmin, or our backend (in node using typeorm/pg modules) are all getting the same "too many connections for database" error.

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/cb92e3d9-2aeb-4180-84b7-f79f809c3455n%40googlegroups.com.

Thursday, July 15, 2021

[google-cloud-sql-discuss] Re: Cloud SQL Import API Issue

Is there any error message you are seeing while completing the process? As this may have multiple causes, any information displayed while the behavior is occurring may guide us in identifying the cause.

In the meantime, you can read about Cloud SQL quotas and limits [1] and best practices [2].

[1] https://cloud.google.com/sql/docs/quotas

[2] https://cloud.google.com/sql/docs/mysql/import-export



On Wednesday, July 14, 2021 at 2:15:21 PM UTC-4 devendrab...@gmail.com wrote:
Hi Team,

I have used sql import api for importing data from csv to mysql table.

Issue which I am facing that is it is inserting only  2609397 records. after this it is skipping rest of the records.

Could you please help me here.




Thanks
Devendra 

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/86c3a77b-8e33-447c-ac97-1aaa34cc1af1n%40googlegroups.com.

Re: [google-cloud-sql-discuss] Service temporarily unavailable

It looks like a transient issue. Quota limit exceeded is reported in a different way according to the documentation.

On Tuesday, July 13, 2021 at 8:36:32 PM UTC+2 mikeb...@firesidechat.com wrote:
Could this be triggered by service limits (was testing an automation script)?

On Tue, Jul 13, 2021 at 10:46 AM 'David (Cloud Platform Support)' via Google Cloud SQL discuss <google-cloud...@googlegroups.com> wrote:

Hello,

Nothing has been reported in the Dashboard. Please make sure your source/target instances meet the requirements, specifically the storage requirement for the target instance. Otherwise, I would contact GCP support so they can inspect your instances and see what's wrong.
On Tuesday, July 13, 2021 at 11:31:19 AM UTC-4 mikeb...@firesidechat.com wrote:
Few more details... saw similar issues in this post: https://groups.google.com/g/google-cloud-sql-discuss/c/SHOClbHNVqg

Also for context restoring from Cloud SQL Postgres 13 instance to another Cloud SQL Postgres 13 instance in the same project. Again, everything worked as expected until yesterday.

On Tue, Jul 13, 2021 at 8:28 AM 'Mike Berman' via Google Cloud SQL discuss <google-cloud...@googlegroups.com> wrote:

Seeing errors when trying to restore via the Cloud API. This has been happening last 24 hours. Was working previously. Is this a known issue?


"error": {

    "code": 503,

    "message": "Service temporarily unavailable.",

    "errors": [

      {

        "message": "Service temporarily unavailable.",

        "domain": "global",

        "reason": "serverException"

      }

    ]

  }

}




--
You received this message because you are subscribed to a topic in the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-cloud-sql-discuss/D_zUMBFUixY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-cloud-sql-d...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/2b26f6fb-1d83-441e-81e8-5c60d77fde7bn%40googlegroups.com.

--
You received this message because you are subscribed to a topic in the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-cloud-sql-discuss/D_zUMBFUixY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-cloud-sql-d...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/d5fb35c1-a6cf-4dc1-813d-5b603553c772n%40googlegroups.com.

Re: [google-cloud-sql-discuss] Often get "database system is in recovery mode"

Hi,

This might indicate and issue with the Cloud SQL instance or with the usage that is being done. I recommend you to open a ticket to Google Cloud support as they have tools dig into your issue and help you to solve it.

On Thursday, July 15, 2021 at 4:58:12 AM UTC+2 Ramon Tayag wrote:
Forgot to say: this is on Postgres 9.6

On Thu, Jul 15, 2021 at 10:56 AM Ramon Tayag <ra...@bloom.solutions> wrote:

I see this almost every day. Looking at the logs, it sometimes happens during the window that maintenance is done, which is fine and potentially expected. However, through out the day, I see these errors appear as well. What could be causing this, and how do I avoid it?

--
You received this message because you are subscribed to a topic in the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-cloud-sql-discuss/Qsd8VZO2hME/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-cloud-sql-d...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/8c7ea7c7-0f81-4683-8513-3d00d9ed07ban%40googlegroups.com.


--

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/c6fd33b2-9581-4470-9cad-c3d617ac8af1n%40googlegroups.com.

Wednesday, July 14, 2021

Re: [google-cloud-sql-discuss] Often get "database system is in recovery mode"

Forgot to say: this is on Postgres 9.6

On Thu, Jul 15, 2021 at 10:56 AM Ramon Tayag <ramon@bloom.solutions> wrote:

I see this almost every day. Looking at the logs, it sometimes happens during the window that maintenance is done, which is fine and potentially expected. However, through out the day, I see these errors appear as well. What could be causing this, and how do I avoid it?

--
You received this message because you are subscribed to a topic in the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-cloud-sql-discuss/Qsd8VZO2hME/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/8c7ea7c7-0f81-4683-8513-3d00d9ed07ban%40googlegroups.com.


--
Ramon Tayag
CTO
+639999935105

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/CACRsCFF8VyK5wfxdSzxYPmP_wbZ4qpTtSt4VwxYwyi2c4z4KYQ%40mail.gmail.com.

[google-cloud-sql-discuss] Often get "database system is in recovery mode"


I see this almost every day. Looking at the logs, it sometimes happens during the window that maintenance is done, which is fine and potentially expected. However, through out the day, I see these errors appear as well. What could be causing this, and how do I avoid it?

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/8c7ea7c7-0f81-4683-8513-3d00d9ed07ban%40googlegroups.com.

[google-cloud-sql-discuss] Cloud SQL Import API Issue

Hi Team,

I have used sql import api for importing data from csv to mysql table.

Issue which I am facing that is it is inserting only  2609397 records. after this it is skipping rest of the records.

Could you please help me here.




Thanks
Devendra 

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/2c9bbc64-1c01-4296-a86a-8528649f80fbn%40googlegroups.com.

Tuesday, July 13, 2021

Re: [google-cloud-sql-discuss] Service temporarily unavailable

Could this be triggered by service limits (was testing an automation script)?

On Tue, Jul 13, 2021 at 10:46 AM 'David (Cloud Platform Support)' via Google Cloud SQL discuss <google-cloud-sql-discuss@googlegroups.com> wrote:

Hello,

Nothing has been reported in the Dashboard. Please make sure your source/target instances meet the requirements, specifically the storage requirement for the target instance. Otherwise, I would contact GCP support so they can inspect your instances and see what's wrong.
On Tuesday, July 13, 2021 at 11:31:19 AM UTC-4 mikeb...@firesidechat.com wrote:
Few more details... saw similar issues in this post: https://groups.google.com/g/google-cloud-sql-discuss/c/SHOClbHNVqg

Also for context restoring from Cloud SQL Postgres 13 instance to another Cloud SQL Postgres 13 instance in the same project. Again, everything worked as expected until yesterday.

On Tue, Jul 13, 2021 at 8:28 AM 'Mike Berman' via Google Cloud SQL discuss <google-cloud...@googlegroups.com> wrote:

Seeing errors when trying to restore via the Cloud API. This has been happening last 24 hours. Was working previously. Is this a known issue?


"error": {

    "code": 503,

    "message": "Service temporarily unavailable.",

    "errors": [

      {

        "message": "Service temporarily unavailable.",

        "domain": "global",

        "reason": "serverException"

      }

    ]

  }

}




--
You received this message because you are subscribed to a topic in the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-cloud-sql-discuss/D_zUMBFUixY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-cloud-sql-d...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/2b26f6fb-1d83-441e-81e8-5c60d77fde7bn%40googlegroups.com.

--
You received this message because you are subscribed to a topic in the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-cloud-sql-discuss/D_zUMBFUixY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/8de6665e-66ca-4c56-8206-cabfc1a30eb9n%40googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/CAE-pz2KNew9PE%3DHeS4budRmfH1NmF_7RcVmDNvQum8HBE7od0A%40mail.gmail.com.

Re: [google-cloud-sql-discuss] Service temporarily unavailable

Hello,

Nothing has been reported in the Dashboard. Please make sure your source/target instances meet the requirements, specifically the storage requirement for the target instance. Otherwise, I would contact GCP support so they can inspect your instances and see what's wrong.
On Tuesday, July 13, 2021 at 11:31:19 AM UTC-4 mikeb...@firesidechat.com wrote:
Few more details... saw similar issues in this post: https://groups.google.com/g/google-cloud-sql-discuss/c/SHOClbHNVqg

Also for context restoring from Cloud SQL Postgres 13 instance to another Cloud SQL Postgres 13 instance in the same project. Again, everything worked as expected until yesterday.

On Tue, Jul 13, 2021 at 8:28 AM 'Mike Berman' via Google Cloud SQL discuss <google-cloud...@googlegroups.com> wrote:

Seeing errors when trying to restore via the Cloud API. This has been happening last 24 hours. Was working previously. Is this a known issue?


"error": {

    "code": 503,

    "message": "Service temporarily unavailable.",

    "errors": [

      {

        "message": "Service temporarily unavailable.",

        "domain": "global",

        "reason": "serverException"

      }

    ]

  }

}




--
You received this message because you are subscribed to a topic in the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-cloud-sql-discuss/D_zUMBFUixY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-cloud-sql-d...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/2b26f6fb-1d83-441e-81e8-5c60d77fde7bn%40googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/8de6665e-66ca-4c56-8206-cabfc1a30eb9n%40googlegroups.com.

Re: [google-cloud-sql-discuss] Service temporarily unavailable

Few more details... saw similar issues in this post: https://groups.google.com/g/google-cloud-sql-discuss/c/SHOClbHNVqg

Also for context restoring from Cloud SQL Postgres 13 instance to another Cloud SQL Postgres 13 instance in the same project. Again, everything worked as expected until yesterday.

On Tue, Jul 13, 2021 at 8:28 AM 'Mike Berman' via Google Cloud SQL discuss <google-cloud-sql-discuss@googlegroups.com> wrote:

Seeing errors when trying to restore via the Cloud API. This has been happening last 24 hours. Was working previously. Is this a known issue?


"error": {

    "code": 503,

    "message": "Service temporarily unavailable.",

    "errors": [

      {

        "message": "Service temporarily unavailable.",

        "domain": "global",

        "reason": "serverException"

      }

    ]

  }

}




--
You received this message because you are subscribed to a topic in the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-cloud-sql-discuss/D_zUMBFUixY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/2b26f6fb-1d83-441e-81e8-5c60d77fde7bn%40googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/CAE-pz2%2BK1jfVp%2BPDuyMA8%3DN6O6G7ysx0Pd_bvoHtGye0qStivw%40mail.gmail.com.

[google-cloud-sql-discuss] Service temporarily unavailable

Seeing errors when trying to restore via the Cloud API. This has been happening last 24 hours. Was working previously. Is this a known issue?


"error": {

    "code": 503,

    "message": "Service temporarily unavailable.",

    "errors": [

      {

        "message": "Service temporarily unavailable.",

        "domain": "global",

        "reason": "serverException"

      }

    ]

  }

}




--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/2b26f6fb-1d83-441e-81e8-5c60d77fde7bn%40googlegroups.com.

Monday, July 5, 2021

[google-cloud-sql-discuss] Re: Options for Querying from MSSQL Databases to Cloud SQL PostgreSQL

Hello, 

Looking at the definition of postgres_fdw, we notice a comment: "The functionality provided by this module overlaps substantially with the functionality of the older dblink module". It is meant to access a foreign table from PostgreSQL in general, while tdw_fdw appears to be specific to MS SQL Server. Both access data from a PostgreSQL server, while you want to access a PostgreSQL instance from MS SQL Server. To this purpose, you may consider other solutions, for instance Connecting SQL Server Management Studio to PostgreSQL via ODBC Driver

This discussion group is oriented more towards general opinions, trends, and issues of general nature touching App Engine and Cloud SQL. For coding and programming architecture, as well as setting up MySQL instances, you may be better served in dedicated forums such as stackoverflow, where experienced programmers are within reach and ready to help.

On Friday, 02 July 2021 at 12:49:34 UTC-4 vishnu...@bmg.com wrote:
Hello Team,

I wanted to query from the Microsoft SQL Server database to Cloud SQL PostgreSQL.
We don't have the support for the extension tds_fdw in GCP Cloud SQL.

Is there any other option for achieving the same? Will postgres_fdw will be any kind of useful?

Thanks,
Vishnu Mohan

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/00ed272c-25ec-4657-9fdf-ec0524dba9bdn%40googlegroups.com.

[google-cloud-sql-discuss] Re: Consistent "Segmentation fault" error in logs when running a query


Currently, The fix for this issue has been rolled out to >99% of instances. The team will provide further updates once this has been rolled out to 100% of instances on this link(https://b.corp.google.com/issues/183108383)


On Wednesday, June 30, 2021 at 4:40:56 PM UTC-4 mikeb...@firesidechat.com wrote:
Quick bump. @google what is the status of this? We are seeing similar behavior where the only fix was disabling insights in production. Any movement here?

On Wednesday, April 14, 2021 at 10:11:30 PM UTC-7 Andrew K. wrote:
After prolonged testing, I have an update: to completely stop segfaults, Query Insights must be disabled after all. Merely disabling application tags makes them less frequent, but doesn't prevent them entirely.
On Thursday, April 15, 2021 at 2:39:51 AM UTC+12 e...@contractbook.dk wrote:
Hi

> Would you be able to confirm if you are still able to see the segmentation fault errors? 

Yes, I confirm this. The last one per our logs happened today at 2021-04-13 08:11:32.469 UTC. The segmentation errors are not extremely common (due to low traffic on staging environment), but happen every day, once or twice. This may become a deal breaker should be plan to move our production DB to Google Cloud though.

> does the query involve a LEFT JOIN?

The query definition itself has two JOINs, although not LEFT JOINs. However, one of the joined relations is a view that is defined to have LEFT JOINs in it.

Noted on the SO question. I am not sure what to take from it though...

Noted on the issue tracker too. I'll gather up the info I have so far and will publish there. Thank you!
On Monday, April 12, 2021 at 12:24:55 PM UTC+3 jli...@google.com wrote:
Hello, 

Would you be able to confirm if you are still able to see the segmentation fault errors? If so, would you be able to please provide the most recent timestamp of the occurrence. 

Also, would you be able to provide a little more details regarding the query? As per Andrew's question, does the query involve a LEFT JOIN? According to the post presented here [1], this may be due to a PostgreSQL bug. Would you be able to verify this and get back to use with this information? 

Better yet, I would suggest you bring this issue up via public issue tracker [2], as this will allow for a more in depth investigation into the segmentation fault; at the same time bring the issue closer to the Cloud SQL team for further inspection.


On Tuesday, March 30, 2021 at 1:10:32 PM UTC-4 Andrew K. wrote:
Does this query involve either a LEFT JOIN or aggregate functions? We have a very similar issue with Cloud SQL Postgres 12.5, with four different queries causing segmentation faults, and these are the only similarities between then. So far we were not able to reproduce the segfaults on a local PG instance running the same DB and queries, and unfortunately it's not possible to attach a debugger to Cloud SQL (as far as we know).

On Tuesday, March 30, 2021 at 3:23:04 AM UTC+13 e...@contractbook.dk wrote:
We're seeing a "Segmentation fault" error in logs for our staging environment, caused by a single specific DB query.

I am unable to replicate the problem consistently by running the same query manually, but we see the issue in logs basically every day now.

Our environment is: PostgreSQL 13.1, the DB tier is "db-custom-1-3840".

In the 1st half of February, we were seeing "Segmentation fault" in relation to another DB query & different DB instance. That issue somehow got self-resolved around Feb 15.

I'd love to provide more info to diagnose this – is there any other info I could provide that would help solve this case? Otherwise, would it be possible for a Google Cloud SQL engineer look into this for us?

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/4cfc3e15-139e-4d67-827e-c078b9e73ac6n%40googlegroups.com.

[google-cloud-sql-discuss] Re: Cloud SQL storage pricing

Keep in mind that stopping an instance will not stop all costs generated by it: it stops the costs associated with the instance itself, but the storage used and any IPs continue to be charged [1]. 

Regarding the storage usage increase:
· If you have storage auto increase enabled, the disk could have increased during a time in which the available amount of storage was not enough
· Binary logs can also impact the amount of storage used [2], so if this option is not necessary for your use case you can disable it
· Also keep in mind that you get charged by storage capacity and not by storage used. 

If this is a billing related question I suggest you to try the billing troubleshooter [3] or contact the Billing team [4]

___________
[1]: https://cloud.google.com/sql/docs/mysql/start-stop-restart-instance#stop 
[2]: https://cloud.google.com/sql/docs/mysql/backup-recovery/pitr#disk-usage 

[3]: https://support.google.com/cloud/troubleshooter/7279311
[4]: https://cloud.google.com/support/billing/ 

On Thursday, July 1, 2021 at 10:04:16 AM UTC+2 sergey.s...@gmail.com wrote:
Why do I get increasing storage usage even though my db instance is shut down most of the time, I use it only for a few hours a week, and it has data that takes less than 20mb in size.

There was initial usage of ~1GB, but why did it increased to 3GBs?

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/cb5c5eec-af33-4858-9faf-064f03ae969bn%40googlegroups.com.

Friday, July 2, 2021

[google-cloud-sql-discuss] Options for Querying from MSSQL Databases to Cloud SQL PostgreSQL

Hello Team,

I wanted to query from the Microsoft SQL Server database to Cloud SQL PostgreSQL.
We don't have the support for the extension tds_fdw in GCP Cloud SQL.

Is there any other option for achieving the same? Will postgres_fdw will be any kind of useful?

Thanks,
Vishnu Mohan

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/dea5199c-5f0b-477e-930b-4e17022218adn%40googlegroups.com.

Thursday, July 1, 2021

[google-cloud-sql-discuss] Cloud SQL storage pricing

Why do I get increasing storage usage even though my db instance is shut down most of the time, I use it only for a few hours a week, and it has data that takes less than 20mb in size.

There was initial usage of ~1GB, but why did it increased to 3GBs?

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/890bad7f-aee3-41e4-afbf-be17b92c1ae1n%40googlegroups.com.