Re: [google-cloud-sql-discuss] gz file import problem

Hello Taeyeol,

You'll have to give us the exact command or the exact steps from the official article. Also, the picture you initially posted is from what system? You say you are "importing FROM Cloud Storage", but shouldn't that be an export? To what system? You're importing from Cloud Storage to where?  And is that the GUI console or command-line console that is not working? The best way to add context and clarity to your question is by writing the steps to replicate your workflow. Thank you.

Sincerely.

On Thursday, September 24, 2020 at 9:56:44 AM UTC-4 taeye...@widerplanet.com wrote:

Hello,

I tried using the import command through the Python google-api-python-client library and executed it through the import command from the console.

Both produced the same results.

김태열 | Taeyeol Kim

CTO Staff, Manager / Development Engineer T. M. 82.10.9799.8756 E-mail. taeye...@widerplanet.com 서울시 강남구 테헤란로 211 한국고등교육재단 8층 | KFAS Building 8F, 211, Teheran-ro, Gangnam-Gu, Seoul, Korea

Wider Planet Inc. http://www.widerplanet.com Big data analytics-based targeted marketing platform : DSP, DMP, SSP, Adex

회사소개서 Download This e-mail and any attachments hereto may contain information that is privileged or confidential, and is intended for use only by the individual or entity to which it is addressed. Any disclosure, copying or distribution of the information by anyone else is prohibited. If you have received this document in error, please notify us promptly by responding to this e-mail. Thank you.

2020. 9. 24. 08:06, 'Amit Sinha' via Google Cloud SQL discuss <google-cloud...@googlegroups.com> 작성:

How do you importing files from Cloud Storage?

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/155171d7-6da7-4909-bee0-b6af22fac575n%40googlegroups.com.

[google-cloud-sql-discuss] Re: Installing MySQL on Linux VM

Hello, did you follow the steps mention here? Also Cloud Marketplace offers several options for MySQL installations, including a standalone MySQL installation, LAMP stacks, LEMP stacks, Nginx Stacks, a Percona MySQL Cluster installation, and several other options.

On Thursday, September 24, 2020 at 9:56:44 AM UTC-4 matka...@gmail.com wrote:

Hello I am trying to install MySQL on Linux vm that i created but it gives lot of dependencies error, could someone please help

net-tools is needed by mysql-community-server-8.0.21-1.el7.x86_64

        perl(Getopt::Long) is needed by mysql-community-server-8.0.21-1.el7.x86_64

        perl(strict) is needed by mysql-community-server-8.0.21-1.el7.x86_64

        procps is needed by mysql-community-server-8.0.21-1.el7.x86_64

        rtld(GNU_HASH) is needed by mysql-community-server-8.0.21-1.el7.x86_64

        shadow-utils is needed by mysql-community-server-8.0.21-1.el7.x86_64

        systemd is needed by mysql-community-server-8.0.21-1.el7.x86_64

When i try to install dependencies it says dependency already install and nothing to do...

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/bd8b5110-1421-4094-be11-43d22fe59e2bn%40googlegroups.com.

[google-cloud-sql-discuss] Installing MySQL on Linux VM

Hello I am trying to install MySQL on Linux vm that i created but it gives lot of dependencies error, could someone please help

net-tools is needed by mysql-community-server-8.0.21-1.el7.x86_64

        perl(Getopt::Long) is needed by mysql-community-server-8.0.21-1.el7.x86_64

        perl(strict) is needed by mysql-community-server-8.0.21-1.el7.x86_64

        procps is needed by mysql-community-server-8.0.21-1.el7.x86_64

        rtld(GNU_HASH) is needed by mysql-community-server-8.0.21-1.el7.x86_64

        shadow-utils is needed by mysql-community-server-8.0.21-1.el7.x86_64

        systemd is needed by mysql-community-server-8.0.21-1.el7.x86_64

When i try to install dependencies it says dependency already install and nothing to do...

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/7eadab51-8fc1-41b1-ad8e-d3def861a75bn%40googlegroups.com.

Re: [google-cloud-sql-discuss] gz file import problem

Hello,

I tried using the import command through the Python google-api-python-client library and executed it through the import command from the console.

Both produced the same results.

김태열 | Taeyeol Kim

CTO Staff, Manager / Development Engineer T. M. 82.10.9799.8756 E-mail. taeyeol.kim@widerplanet.com 서울시 강남구 테헤란로 211 한국고등교육재단 8층 | KFAS Building 8F, 211, Teheran-ro, Gangnam-Gu, Seoul, Korea

Wider Planet Inc. http://www.widerplanet.com Big data analytics-based targeted marketing platform : DSP, DMP, SSP, Adex

회사소개서 Download This e-mail and any attachments hereto may contain information that is privileged or confidential, and is intended for use only by the individual or entity to which it is addressed. Any disclosure, copying or distribution of the information by anyone else is prohibited. If you have received this document in error, please notify us promptly by responding to this e-mail. Thank you.

2020. 9. 24. 08:06, 'Amit Sinha' via Google Cloud SQL discuss <google-cloud-sql-discuss@googlegroups.com> 작성:

How do you importing files from Cloud Storage?

[google-cloud-sql-discuss] Re: gz file import problem

Hello, 

How do you importing files from Cloud Storage?

On Wednesday, September 23, 2020 at 9:14:47 AM UTC-4 taeye...@widerplanet.com wrote:

Hi,

When you import a gz file from cloud storage, the file name is overwritten on the first data.

Is there a solution?

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/f4c02dbf-15d4-44b7-8622-a73113ca4f27n%40googlegroups.com.

[google-cloud-sql-discuss] Re: CloudSQL SqlServer user not able to access database

Hi, 

Regarding the "Login failed for user" error. The Cloud SQL product team have been made aware of this issue and we are currently waiting on a roll out of the fix from Microsoft. Microsoft seems have released an update in which the Customer Experience Improvement Program [1] (CEIP) has been removed from the product (more information through this link [2]).

Currently, the workaround for this issue is to grant CONNECT permission on your Cloud SQL Endpoint (localhost)[3] endpoint to public. However, this wouldn't be recommended for production instance. Disabling CEIP only disables the upload to Microsoft and not the collection of data which is what results in the error.

[1] https://docs.microsoft.com/en-us/mem/configmgr/core/plan-design/diagnostics/diagnostics-and-usage-data

[2] https://docs.microsoft.com/en-us/mem/configmgr/core/plan-design/changes/whats-new-in-version-1802

[3] https://docs.microsoft.com/en-us/sql/t-sql/statements/grant-endpoint-permissions-transact-sql?view=sql-server-ver15

On Friday, September 18, 2020 at 12:55:21 PM UTC-4 nara.ram...@ditoweb.com wrote:

I managed to enable the connectivity for the app user ....and now they are able to connect and access  the database using SSMS  ...however now we seem to have another issue when the application is trying to connect .....here is what I see in the db logs

Login failed for user 'a4a5747f1dc7123\a4a5747f1dc7123$'. Reason: Token-based server access validation failed with an infrastructure error. Login lacks connect endpoint permission. [CLIENT: 127.0.0.1]

On Thursday, September 17, 2020 at 6:57:44 PM UTC-4 Elliott (Google Cloud Platform Support) wrote:

Hello,

When did this behavior begin? Were you able to connect to it before? Has anything changed?

On Wednesday, September 16, 2020 at 8:53:57 PM UTC-4 nara.ram...@ditoweb.com wrote:

 hav an application running on Compute Engine which was created with a specific userid thats used to access database services.  Earlier the database was on SQLServer Express edition hosted on the same CE.  migrated the express edition database to CloudSQL SqlServer 2017 standard edition.  

In addition to the default "sqlserver" user created by CloudSQL,  created a new user with the same credentials as the user used by the application. 

able to connect from the VM using Microsoft SQL Server Management Studio to the CloudSQL instance and can see the System Databases and the new DB that was crated. However when opening the new DB keep getting the following error message

"The database ******* is not accessible. (ObjectExplorer)"

we definitely need to t get connectivity to the database with the user  that the app uses since the app user can't be modified at the application level

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/af6d290e-defb-4de4-9cbf-ef5a12718b7cn%40googlegroups.com.

[google-cloud-sql-discuss] gz file import problem

Hi,

When you import a gz file from cloud storage, the file name is overwritten on the first data.

Is there a solution?

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/8366b41b-30e3-4136-b87a-5f686d2fba5en%40googlegroups.com.

[google-cloud-sql-discuss] Re: Importing data from a BAK file in Cloud Storage

Hi Alfio,

Issue is resolved now. I think it was space issue. 

I created new instance with higher space and then import the .bak file it got imported successfully.

I'm little confuse that was it space issue or was it instance issue.

It's working now.

Thanks!

On Tuesday, September 22, 2020 at 6:11:02 AM UTC+5 alfio wrote:

Hello, 

Theoritically, all SQL Servers that have the ability to export database to a .bak file are compatbile with the Google Cloud SQL Database. The important thing to note, which is stipulated in the documentation you previously linked [1], is that you cannot import a database that was exported from a higher version or edition of SQL Server or import from a higher compatibility level into a lower one. Cloud SQL also only supports importing a full backup with a single backup set. Given the screenshots that you posted, I am unable to determine which one would best work for your current use case. If I misunderstood in any way or if you have any other questions, please feel free to let us know.

Kind Regards,

Alfio.

[1] https://cloud.google.com/sql/docs/sqlserver/import-export/importing#importing_data_from_a_bak_file_in

On Monday, September 21, 2020 at 12:29:14 PM UTC-4 sulman....@gmail.com wrote:

Hi Alexis,

Can you just mention which SQL Server should I use to export/create .bak file which can be easily imported on  Google Cloud SQL Database version "SQL Server 2017 Standard" ?

Thanks!

On Friday, September 18, 2020 at 5:52:38 PM UTC+5 Sulman A. wrote:

Hi Alexis,

Google Cloud SQL Database version is "SQL Server 2017 Standard"

Below are attached screenshots of SQL Servers which I'm using to create `.bak` file.

I don't know about these limits.

Thanks for the reply. :)

On Friday, September 18, 2020 at 2:56:37 AM UTC+5 Alexis (Google Cloud Support) wrote:

Hello,

I will try to assist the best I can. 

I investigated internally and noticed that Google has had a few cases with this error and it appears that it may be due to a limitation issue in product versions. Even though the error is not very descriptive, one of these[1] limits may be causing the issue with the delta between your environment and ours. It's a vague error and hard to tell, but ensuring these limitations should be our first step, especially if it worked before.

Please check the version/features your are exporting[1] and importing from. For the import, it's here[2] under "database version" (to see which one you have in GCP).

Let us know if this helps.

[1] https://docs.microsoft.com/en-us/sql/sql-server/editions-and-components-of-sql-server-2016?view=sql-server-2017#Cross-BoxScaleLimits

[2] https://cloud.google.com/sql/docs/sqlserver/instance-settings?_ga=2.151003833.-1442300237.1583515247#settings-sqlserver

On Tuesday, September 15, 2020 at 3:50:00 PM UTC-4 sulman....@gmail.com wrote:

[An unknown error occurred] message during import [.bak] file

I was able to import SQL Server db by Importing data from SQL files into Cloud SQL but that was time consuming because [.sql] files contain insert statements and it took time.

Now I'm trying to import a [.bak] but getting this message [An unknown error occurred] no other details? 

Before I was getting these errors while trying to import [.bak] file which I've resolved.

1) Multiple databases detected in BAK file. Only importing a single database is supported.

2) 80 is not a supported compatibility level. Supported: [140, 130, 120, 110, 100]

But now error message is [An unknown error occurred] with no other details?

I'm following this documentation:

https://cloud.google.com/sql/docs/sqlserver/import-export/importing#importing_data_from_a_bak_file_in

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/153a5685-ab08-44fe-b8ab-b2409bc01202n%40googlegroups.com.

[google-cloud-sql-discuss] Re: Importing data from a BAK file in Cloud Storage

Hello, 

Theoritically, all SQL Servers that have the ability to export database to a .bak file are compatbile with the Google Cloud SQL Database. The important thing to note, which is stipulated in the documentation you previously linked [1], is that you cannot import a database that was exported from a higher version or edition of SQL Server or import from a higher compatibility level into a lower one. Cloud SQL also only supports importing a full backup with a single backup set. Given the screenshots that you posted, I am unable to determine which one would best work for your current use case. If I misunderstood in any way or if you have any other questions, please feel free to let us know.

Kind Regards,

Alfio.

[1] https://cloud.google.com/sql/docs/sqlserver/import-export/importing#importing_data_from_a_bak_file_in

On Monday, September 21, 2020 at 12:29:14 PM UTC-4 sulman....@gmail.com wrote:

Hi Alexis,

Can you just mention which SQL Server should I use to export/create .bak file which can be easily imported on  Google Cloud SQL Database version "SQL Server 2017 Standard" ?

Thanks!

On Friday, September 18, 2020 at 5:52:38 PM UTC+5 Sulman A. wrote:

Hi Alexis,

Google Cloud SQL Database version is "SQL Server 2017 Standard"

Below are attached screenshots of SQL Servers which I'm using to create `.bak` file.

I don't know about these limits.

Thanks for the reply. :)

On Friday, September 18, 2020 at 2:56:37 AM UTC+5 Alexis (Google Cloud Support) wrote:

Hello,

I will try to assist the best I can. 

I investigated internally and noticed that Google has had a few cases with this error and it appears that it may be due to a limitation issue in product versions. Even though the error is not very descriptive, one of these[1] limits may be causing the issue with the delta between your environment and ours. It's a vague error and hard to tell, but ensuring these limitations should be our first step, especially if it worked before.

Please check the version/features your are exporting[1] and importing from. For the import, it's here[2] under "database version" (to see which one you have in GCP).

Let us know if this helps.

[1] https://docs.microsoft.com/en-us/sql/sql-server/editions-and-components-of-sql-server-2016?view=sql-server-2017#Cross-BoxScaleLimits

[2] https://cloud.google.com/sql/docs/sqlserver/instance-settings?_ga=2.151003833.-1442300237.1583515247#settings-sqlserver

On Tuesday, September 15, 2020 at 3:50:00 PM UTC-4 sulman....@gmail.com wrote:

[An unknown error occurred] message during import [.bak] file

I was able to import SQL Server db by Importing data from SQL files into Cloud SQL but that was time consuming because [.sql] files contain insert statements and it took time.

Now I'm trying to import a [.bak] but getting this message [An unknown error occurred] no other details? 

Before I was getting these errors while trying to import [.bak] file which I've resolved.

1) Multiple databases detected in BAK file. Only importing a single database is supported.

2) 80 is not a supported compatibility level. Supported: [140, 130, 120, 110, 100]

But now error message is [An unknown error occurred] with no other details?

I'm following this documentation:

https://cloud.google.com/sql/docs/sqlserver/import-export/importing#importing_data_from_a_bak_file_in

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/fbcde9f6-ce9f-4f6e-9098-96cf5b30480dn%40googlegroups.com.

[google-cloud-sql-discuss] Re: Importing data from a BAK file in Cloud Storage

Hi Alexis,

Can you just mention which SQL Server should I use to export/create .bak file which can be easily imported on  Google Cloud SQL Database version "SQL Server 2017 Standard" ?

Thanks!

On Friday, September 18, 2020 at 5:52:38 PM UTC+5 Sulman A. wrote:

Hi Alexis,

Google Cloud SQL Database version is "SQL Server 2017 Standard"

Below are attached screenshots of SQL Servers which I'm using to create `.bak` file.

I don't know about these limits.

Thanks for the reply. :)

On Friday, September 18, 2020 at 2:56:37 AM UTC+5 Alexis (Google Cloud Support) wrote:

Hello,

I will try to assist the best I can. 

I investigated internally and noticed that Google has had a few cases with this error and it appears that it may be due to a limitation issue in product versions. Even though the error is not very descriptive, one of these[1] limits may be causing the issue with the delta between your environment and ours. It's a vague error and hard to tell, but ensuring these limitations should be our first step, especially if it worked before.

Please check the version/features your are exporting[1] and importing from. For the import, it's here[2] under "database version" (to see which one you have in GCP).

Let us know if this helps.

[1] https://docs.microsoft.com/en-us/sql/sql-server/editions-and-components-of-sql-server-2016?view=sql-server-2017#Cross-BoxScaleLimits

[2] https://cloud.google.com/sql/docs/sqlserver/instance-settings?_ga=2.151003833.-1442300237.1583515247#settings-sqlserver

On Tuesday, September 15, 2020 at 3:50:00 PM UTC-4 sulman....@gmail.com wrote:

[An unknown error occurred] message during import [.bak] file

I was able to import SQL Server db by Importing data from SQL files into Cloud SQL but that was time consuming because [.sql] files contain insert statements and it took time.

Now I'm trying to import a [.bak] but getting this message [An unknown error occurred] no other details? 

Before I was getting these errors while trying to import [.bak] file which I've resolved.

1) Multiple databases detected in BAK file. Only importing a single database is supported.

2) 80 is not a supported compatibility level. Supported: [140, 130, 120, 110, 100]

But now error message is [An unknown error occurred] with no other details?

I'm following this documentation:

https://cloud.google.com/sql/docs/sqlserver/import-export/importing#importing_data_from_a_bak_file_in

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/406f766d-7056-4921-bdcc-b94e6d6a8129n%40googlegroups.com.

[google-cloud-sql-discuss] Re: Cloud SQL (Postgres) stuck at restarting

Hi,

I recommend to create a ticket with your support package if you have, or raise a PRIVATE ticket via the issue tracker and provide us with your project id, instance id and the timestamp the issue started happening so that we would be able to dig into the issue. 

On Sunday, September 20, 2020 at 1:01:03 PM UTC-4 ad...@uitheory.com wrote:

I have a Postgres instance that wasn't responding to connections.  I restarted it and now it is stuck restarting for about an hour.  There doesn't seem to be any action I can take on it.

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/d285e937-0f53-498c-82bc-3f160c5836d0n%40googlegroups.com.

[google-cloud-sql-discuss] Cloud SQL (Postgres) stuck at restarting

I have a Postgres instance that wasn't responding to connections.  I restarted it and now it is stuck restarting for about an hour.  There doesn't seem to be any action I can take on it.

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/0952b22d-0a6e-4360-ae4c-6e7681e4bef9n%40googlegroups.com.

Re: [google-cloud-sql-discuss] CloudSQL PostgreSQL change data capture (CDC)

Hello,

From this documentation, CDC features are not yet available. However, I have found some feature requests related to this [1,2]. If you want any specific feature that could be helpful, you can create another feature request here.

Workaround for now, manually deploy SQL cluster on GCE VMs; you could deploy a self-managed SQL cluster on GCE VMs and monitor the activity through there. This would require additional effort for manual engineering and operations unfortunately. 

Another alternative would be to grab the analytics information out of a read replica via exporting [3].

[1]  https://issuetracker.google.com/70756171

[2] https://issuetracker.google.com/120720131

[3] https://cloud.google.com/sql/docs/mysql/import-export/exporting

On Friday, September 18, 2020 at 3:52:19 PM UTC-4 gor...@bairdpartnersltd.com wrote:

Any thoughts on how then to design a trigger or event that kicks of down stream services that is key'd off a write to a SQL ACID dbase?  other designs include periodic polling or cloud functions , but ideally looking for something more native or lower level in one of the cloud housed dbase services.. 

On Friday, September 18, 2020 at 12:55:21 PM UTC-4 geert.van...@tree53.com wrote:

CloudSQL PostgreSQL does not support CDC at this time, nor is it known to be on the roadmap to ever be enabled.

You can host your own PostgreSQL database (eg using Kubernetes and Docker) and use CDC there.

CloudSQL Sql Server also does not support CDC at this moment.

Currently,CloudSQL MySQL is the only database that offers CDC using its binlog.

On Fri, Sep 18, 2020 at 2:52 PM Gordon Baird <gor...@bairdpartnersltd.com> wrote:

Does GCP CloudSQL support CDC or any other type of record mutation/change event triggering?  If not, is this in the roadmap?     If not, is there any other way to trigger events (functions, pub/sub) by changes to records in the database?  If not CloudSQL, do any other GCP ACID compliant dbases support them?   Thanks

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-d...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/d79e20b0-234e-4fb6-8e7b-b10139874985n%40googlegroups.com.

--

kind regards,

--

Geert Van Landeghem

Training & Operations & Co-Founder

T R E E 5 3

Connect. Transform. Grow. 

T  +32 (0) 477 75 95 33

E  geert.van...@tree53.com

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/e3d6fe80-9405-4325-a405-985d6ffde3b1n%40googlegroups.com.

Re: [google-cloud-sql-discuss] CloudSQL PostgreSQL change data capture (CDC)

Gordon, what's your use case?

I don't know what kind of permissions you need to configure triggers in postgreSQL, I saw messages in a forum that people were able to use that.

Your application could emit events when data is inserted, updated, deleted to pub/sub or kafka.

You could use kafka's JDBC source connector which polls the database but then you need to work with

• polling for changes in the database
• using timestamps (of insert, update & delete) & key fields
  
• logically delete records (flag record as deleted but don't physically delete the records)
  

On Fri, Sep 18, 2020 at 9:52 PM Gordon Baird <gordon@bairdpartnersltd.com> wrote:

Any thoughts on how then to design a trigger or event that kicks of down stream services that is key'd off a write to a SQL ACID dbase?  other designs include periodic polling or cloud functions , but ideally looking for something more native or lower level in one of the cloud housed dbase services.. 

On Friday, September 18, 2020 at 12:55:21 PM UTC-4 geert.van...@tree53.com wrote:

CloudSQL PostgreSQL does not support CDC at this time, nor is it known to be on the roadmap to ever be enabled.

You can host your own PostgreSQL database (eg using Kubernetes and Docker) and use CDC there.

CloudSQL Sql Server also does not support CDC at this moment.

Currently,CloudSQL MySQL is the only database that offers CDC using its binlog.

On Fri, Sep 18, 2020 at 2:52 PM Gordon Baird <gor...@bairdpartnersltd.com> wrote:

Does GCP CloudSQL support CDC or any other type of record mutation/change event triggering?  If not, is this in the roadmap?     If not, is there any other way to trigger events (functions, pub/sub) by changes to records in the database?  If not CloudSQL, do any other GCP ACID compliant dbases support them?   Thanks

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-d...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/d79e20b0-234e-4fb6-8e7b-b10139874985n%40googlegroups.com.

--

kind regards,

--

Geert Van Landeghem

Training & Operations & Co-Founder

T R E E 5 3

Connect. Transform. Grow. 

T  +32 (0) 477 75 95 33

E  geert.van...@tree53.com

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/e5d590b9-0257-4858-9105-498cf4e8312fn%40googlegroups.com.

--

kind regards,

--

Geert Van Landeghem

Training & Operations & Co-Founder

T R E E 5 3

Connect. Transform. Grow. 

T  +32 (0) 477 75 95 33

E  geert.vanlandeghem@tree53.com

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/CAJOxV8xFCXEx4YZ4o98RYpHBmuGzy%2BOyYd44Pm-8iq0GG1vLFA%40mail.gmail.com.

Re: [google-cloud-sql-discuss] CloudSQL PostgreSQL change data capture (CDC)

Any thoughts on how then to design a trigger or event that kicks of down stream services that is key'd off a write to a SQL ACID dbase?  other designs include periodic polling or cloud functions , but ideally looking for something more native or lower level in one of the cloud housed dbase services.. 

On Friday, September 18, 2020 at 12:55:21 PM UTC-4 geert.van...@tree53.com wrote:

CloudSQL PostgreSQL does not support CDC at this time, nor is it known to be on the roadmap to ever be enabled.

You can host your own PostgreSQL database (eg using Kubernetes and Docker) and use CDC there.

CloudSQL Sql Server also does not support CDC at this moment.

Currently,CloudSQL MySQL is the only database that offers CDC using its binlog.

On Fri, Sep 18, 2020 at 2:52 PM Gordon Baird <gor...@bairdpartnersltd.com> wrote:

Does GCP CloudSQL support CDC or any other type of record mutation/change event triggering?  If not, is this in the roadmap?     If not, is there any other way to trigger events (functions, pub/sub) by changes to records in the database?  If not CloudSQL, do any other GCP ACID compliant dbases support them?   Thanks

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-d...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/d79e20b0-234e-4fb6-8e7b-b10139874985n%40googlegroups.com.

--

kind regards,

--

Geert Van Landeghem

Training & Operations & Co-Founder

T R E E 5 3

Connect. Transform. Grow. 

T  +32 (0) 477 75 95 33

E  geert.van...@tree53.com

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/e5d590b9-0257-4858-9105-498cf4e8312fn%40googlegroups.com.

[google-cloud-sql-discuss] Re: CloudSQL SqlServer user not able to access database

I managed to enable the connectivity for the app user ....and now they are able to connect and access  the database using SSMS  ...however now we seem to have another issue when the application is trying to connect .....here is what I see in the db logs

Login failed for user 'a4a5747f1dc7123\a4a5747f1dc7123$'. Reason: Token-based server access validation failed with an infrastructure error. Login lacks connect endpoint permission. [CLIENT: 127.0.0.1]

On Thursday, September 17, 2020 at 6:57:44 PM UTC-4 Elliott (Google Cloud Platform Support) wrote:

Hello,

When did this behavior begin? Were you able to connect to it before? Has anything changed?

On Wednesday, September 16, 2020 at 8:53:57 PM UTC-4 nara.ram...@ditoweb.com wrote:

 hav an application running on Compute Engine which was created with a specific userid thats used to access database services.  Earlier the database was on SQLServer Express edition hosted on the same CE.  migrated the express edition database to CloudSQL SqlServer 2017 standard edition.  

In addition to the default "sqlserver" user created by CloudSQL,  created a new user with the same credentials as the user used by the application. 

able to connect from the VM using Microsoft SQL Server Management Studio to the CloudSQL instance and can see the System Databases and the new DB that was crated. However when opening the new DB keep getting the following error message

"The database ******* is not accessible. (ObjectExplorer)"

we definitely need to t get connectivity to the database with the user  that the app uses since the app user can't be modified at the application level

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/b0c968e6-bf90-4e52-916c-c882b1a66de8n%40googlegroups.com.

Re: [google-cloud-sql-discuss] CloudSQL PostgreSQL change data capture (CDC)

CloudSQL PostgreSQL does not support CDC at this time, nor is it known to be on the roadmap to ever be enabled.

You can host your own PostgreSQL database (eg using Kubernetes and Docker) and use CDC there.

CloudSQL Sql Server also does not support CDC at this moment.

Currently,CloudSQL MySQL is the only database that offers CDC using its binlog.

On Fri, Sep 18, 2020 at 2:52 PM Gordon Baird <gordon@bairdpartnersltd.com> wrote:

Does GCP CloudSQL support CDC or any other type of record mutation/change event triggering?  If not, is this in the roadmap?     If not, is there any other way to trigger events (functions, pub/sub) by changes to records in the database?  If not CloudSQL, do any other GCP ACID compliant dbases support them?   Thanks

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/d79e20b0-234e-4fb6-8e7b-b10139874985n%40googlegroups.com.

--

kind regards,

--

Geert Van Landeghem

Training & Operations & Co-Founder

T R E E 5 3

Connect. Transform. Grow. 

T  +32 (0) 477 75 95 33

E  geert.vanlandeghem@tree53.com

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/CAJOxV8zogYrHe%2Bre_q_egtO%2B0anMxVvO3ZQNKAWYMouLxRAa-g%40mail.gmail.com.

[google-cloud-sql-discuss] CloudSQL PostgreSQL change data capture (CDC)

Does GCP CloudSQL support CDC or any other type of record mutation/change event triggering?  If not, is this in the roadmap?     If not, is there any other way to trigger events (functions, pub/sub) by changes to records in the database?  If not CloudSQL, do any other GCP ACID compliant dbases support them?   Thanks

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/d79e20b0-234e-4fb6-8e7b-b10139874985n%40googlegroups.com.

[google-cloud-sql-discuss] Re: CloudSQL SqlServer user not able to access database

Hello,

When did this behavior begin? Were you able to connect to it before? Has anything changed?

On Wednesday, September 16, 2020 at 8:53:57 PM UTC-4 nara.ram...@ditoweb.com wrote:

 hav an application running on Compute Engine which was created with a specific userid thats used to access database services.  Earlier the database was on SQLServer Express edition hosted on the same CE.  migrated the express edition database to CloudSQL SqlServer 2017 standard edition.  

In addition to the default "sqlserver" user created by CloudSQL,  created a new user with the same credentials as the user used by the application. 

able to connect from the VM using Microsoft SQL Server Management Studio to the CloudSQL instance and can see the System Databases and the new DB that was crated. However when opening the new DB keep getting the following error message

"The database ******* is not accessible. (ObjectExplorer)"

we definitely need to t get connectivity to the database with the user  that the app uses since the app user can't be modified at the application level

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/c6f589f2-316a-4453-9eee-e2f07f9b66a9n%40googlegroups.com.

[google-cloud-sql-discuss] Re: Importing data from a BAK file in Cloud Storage

Hi Alexis,

Google Cloud SQL Database version is "SQL Server 2017 Standard"

Below are attached screenshots of SQL Servers which I'm using to create `.bak` file.

I don't know about these limits.

Thanks for the reply. :)

On Friday, September 18, 2020 at 2:56:37 AM UTC+5 Alexis (Google Cloud Support) wrote:

Hello,

I will try to assist the best I can. 

I investigated internally and noticed that Google has had a few cases with this error and it appears that it may be due to a limitation issue in product versions. Even though the error is not very descriptive, one of these[1] limits may be causing the issue with the delta between your environment and ours. It's a vague error and hard to tell, but ensuring these limitations should be our first step, especially if it worked before.

Please check the version/features your are exporting[1] and importing from. For the import, it's here[2] under "database version" (to see which one you have in GCP).

Let us know if this helps.

[1] https://docs.microsoft.com/en-us/sql/sql-server/editions-and-components-of-sql-server-2016?view=sql-server-2017#Cross-BoxScaleLimits

[2] https://cloud.google.com/sql/docs/sqlserver/instance-settings?_ga=2.151003833.-1442300237.1583515247#settings-sqlserver

On Tuesday, September 15, 2020 at 3:50:00 PM UTC-4 sulman....@gmail.com wrote:

[An unknown error occurred] message during import [.bak] file

I was able to import SQL Server db by Importing data from SQL files into Cloud SQL but that was time consuming because [.sql] files contain insert statements and it took time.

Now I'm trying to import a [.bak] but getting this message [An unknown error occurred] no other details? 

Before I was getting these errors while trying to import [.bak] file which I've resolved.

1) Multiple databases detected in BAK file. Only importing a single database is supported.

2) 80 is not a supported compatibility level. Supported: [140, 130, 120, 110, 100]

But now error message is [An unknown error occurred] with no other details?

I'm following this documentation:

https://cloud.google.com/sql/docs/sqlserver/import-export/importing#importing_data_from_a_bak_file_in

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/9e992ed7-b38b-48cf-b594-f86aeaef0600n%40googlegroups.com.

[google-cloud-sql-discuss] Re: What is the closest role I could get as sysadmin on GCP sqlserver

Aref thanks a lot I've created the ticket on issue tracker.

On Friday, September 18, 2020 at 12:27:34 AM UTC+5 Aref Amiri (Cloud Platform Support) wrote:

I'd suggest creating a Private Issue Tracker and provide your project ID, instance name and steps to reproduce as this requires further investigation.

On Wednesday, September 16, 2020 at 6:20:51 PM UTC-4 sulman....@gmail.com wrote:

Actually, I do read this article but getting error.

I followed the steps mentioned on it.

After selecting the [.bak] file when click on Import button got this error message attached screenshot. And error message is only showing this text [ An unknown error occurred ].

Error message contains no other details so getting difficult to debug.

On Thursday, September 17, 2020 at 12:53:20 AM UTC+5 Olu wrote:

Did you see this article[1]? I think it is interesting as it explains how to import data from BAK files into Cloud SQL. 

[1]https://cloud.google.com/sql/docs/sqlserver/import-export/importing#bak

On Tuesday, September 15, 2020 at 6:36:27 PM UTC-4 sulman....@gmail.com wrote:

Hi Zayar,

Were you able to restored .bak from local disk?

Can you guide on it?

Thanks!

On Wednesday, June 24, 2020 at 12:16:09 AM UTC+5 Zayar Wai Lin wrote:

Hello Guys,

I am a newbie mssql database administrator. I am practicing my lessons on GCP.

I am aware that GCP doesn't support sysadmin role at sqlserver level.

What I am curious is how can I get the closest role as sysadmin on GCP?

I was trying to restored .bak from my local disk drive and its throwing me this error. Appreciate if anyone can enlighten me on this.

Cheers

Zayar.

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/cc99cf1c-3fff-4521-b50f-06149c377814n%40googlegroups.com.

[google-cloud-sql-discuss] Re: Importing data from a BAK file in Cloud Storage

Hello,

I will try to assist the best I can. 

I investigated internally and noticed that Google has had a few cases with this error and it appears that it may be due to a limitation issue in product versions. Even though the error is not very descriptive, one of these[1] limits may be causing the issue with the delta between your environment and ours. It's a vague error and hard to tell, but ensuring these limitations should be our first step, especially if it worked before.

Please check the version/features your are exporting[1] and importing from. For the import, it's here[2] under "database version" (to see which one you have in GCP).

Let us know if this helps.

[1] https://docs.microsoft.com/en-us/sql/sql-server/editions-and-components-of-sql-server-2016?view=sql-server-2017#Cross-BoxScaleLimits

[2] https://cloud.google.com/sql/docs/sqlserver/instance-settings?_ga=2.151003833.-1442300237.1583515247#settings-sqlserver

On Tuesday, September 15, 2020 at 3:50:00 PM UTC-4 sulman....@gmail.com wrote:

[An unknown error occurred] message during import [.bak] file

I was able to import SQL Server db by Importing data from SQL files into Cloud SQL but that was time consuming because [.sql] files contain insert statements and it took time.

Now I'm trying to import a [.bak] but getting this message [An unknown error occurred] no other details? 

Before I was getting these errors while trying to import [.bak] file which I've resolved.

1) Multiple databases detected in BAK file. Only importing a single database is supported.

2) 80 is not a supported compatibility level. Supported: [140, 130, 120, 110, 100]

But now error message is [An unknown error occurred] with no other details?

I'm following this documentation:

https://cloud.google.com/sql/docs/sqlserver/import-export/importing#importing_data_from_a_bak_file_in

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/2b6c0bad-34cc-4f85-a05b-70a040ce3409n%40googlegroups.com.

[google-cloud-sql-discuss] Re: What is the closest role I could get as sysadmin on GCP sqlserver

I'd suggest creating a Private Issue Tracker and provide your project ID, instance name and steps to reproduce as this requires further investigation.

On Wednesday, September 16, 2020 at 6:20:51 PM UTC-4 sulman....@gmail.com wrote:

Actually, I do read this article but getting error.

I followed the steps mentioned on it.

After selecting the [.bak] file when click on Import button got this error message attached screenshot. And error message is only showing this text [ An unknown error occurred ].

Error message contains no other details so getting difficult to debug.

On Thursday, September 17, 2020 at 12:53:20 AM UTC+5 Olu wrote:

Did you see this article[1]? I think it is interesting as it explains how to import data from BAK files into Cloud SQL. 

[1]https://cloud.google.com/sql/docs/sqlserver/import-export/importing#bak

On Tuesday, September 15, 2020 at 6:36:27 PM UTC-4 sulman....@gmail.com wrote:

Hi Zayar,

Were you able to restored .bak from local disk?

Can you guide on it?

Thanks!

On Wednesday, June 24, 2020 at 12:16:09 AM UTC+5 Zayar Wai Lin wrote:

Hello Guys,

I am a newbie mssql database administrator. I am practicing my lessons on GCP.

I am aware that GCP doesn't support sysadmin role at sqlserver level.

What I am curious is how can I get the closest role as sysadmin on GCP?

I was trying to restored .bak from my local disk drive and its throwing me this error. Appreciate if anyone can enlighten me on this.

Cheers

Zayar.

--
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/d909b172-3e45-4625-9534-5e8f0691fe7fn%40googlegroups.com.