Hi,
We resolved this by deleting the pod, and after 30mins we restarted the first pod with this issue, another pod reported the same errors. and the end, we have restarted all pods. it seems gone now, but dont know if it will occur again.
-- We are using cloud-sql-proxy together with kubernetes to deploy our app, it works fine since Nov. 2016. For the first time, today, 2 of our 5 pods reported bad connection when trying to connect to google-cloud-sql with cloud-sql-proxy. here are parts the logs:
2017/05/30 16:42:44 New connection for "teak-clarity-132123:us-central1:diningzoodatabase"2017/05/30 16:42:44 New connection for "teak-clarity-132123:us-central1:diningzoodatabase"2017/05/30 16:42:44 Client closed local connection on 127.0.0.1:33062017/05/30 16:42:44 Client closed local connection on 127.0.0.1:33062017/05/30 16:42:45 New connection for "teak-clarity-132123:us-central1:diningzoodatabase"2017/05/30 16:42:45 New connection for "teak-clarity-132123:us-central1:diningzoodatabase"2017/05/30 16:42:45 New connection for "teak-clarity-132123:us-central1:diningzoodatabase"2017/05/30 16:42:45 New connection for "teak-clarity-132123:us-central1:diningzoodatabase"2017/05/30 16:42:45 New connection for "teak-clarity-132123:us-central1:diningzoodatabase"2017/05/30 16:42:45 Client closed local connection on 127.0.0.1:33062017/05/30 16:42:45 Client closed local connection on 127.0.0.1:33062017/05/30 16:42:45 Client closed local connection on 127.0.0.1:33062017/05/30 16:42:45 New connection for "teak-clarity-132123:us-central1:diningzoodatabase"2017/05/30 16:42:45 Client closed local connection on 127.0.0.1:33062017/05/30 16:42:45 Client closed local connection on 127.0.0.1:33062017/05/30 16:42:45 Client closed local connection on 127.0.0.1:33062017/05/30 16:42:46 New connection for "teak-clarity-132123:us-central1:diningzoodatabase"2017/05/30 16:42:46 New connection for "teak-clarity-132123:us-central1:diningzoodatabase"2017/05/30 16:42:46 couldn't connect to "teak-clarity-132123:us-central1:diningzoodatabase": Post https://www.googleapis.com/sql/v1beta4/projects/teak-clarity-132123/instances/diningzoodatabase/createEphemeral?alt=json: stream error: stream ID 1; PROTOCOL_ERROR2017/05/30 16:42:46 Thottling refreshCfg(teak-clarity-132123:us-central1:diningzoodatabase): it was only called 277.184µs ago2017/05/30 16:42:46 couldn't connect to "teak-clarity-132123:us-central1:diningzoodatabase": Post https://www.googleapis.com/sql/v1beta4/projects/teak-clarity-132123/instances/diningzoodatabase/createEphemeral?alt=json: stream error: stream ID 1; PROTOCOL_ERROR2017/05/30 16:42:46 New connection for "teak-clarity-132123:us-central1:diningzoodatabase"2017/05/30 16:42:46 Thottling refreshCfg(teak-clarity-132123:us-central1:diningzoodatabase): it was only called 1.194005ms ago2017/05/30 16:42:46 couldn't connect to "teak-clarity-132123:us-central1:diningzoodatabase": Post https://www.googleapis.com/sql/v1beta4/projects/teak-clarity-132123/instances/diningzoodatabase/createEphemeral?alt=json: stream error: stream ID 1; PROTOCOL_ERROR2017/05/30 16:42:46 New connection for "teak-clarity-132123:us-central1:diningzoodatabase"2017/05/30 16:42:46 Thottling refreshCfg(teak-clarity-132123:us-central1:diningzoodatabase): it was only called 1.644907ms ago2017/05/30 16:42:46 couldn't connect to "teak-clarity-132123:us-central1:diningzoodatabase": Post https://www.googleapis.com/sql/v1beta4/projects/teak-clarity-132123/instances/diningzoodatabase/createEphemeral?alt=json: stream error: stream ID 1; PROTOCOL_ERROR2017/05/30 16:42:46 New connection for "teak-clarity-132123:us-central1:diningzoodatabase"2017/05/30 16:42:46 Thottling refreshCfg(teak-clarity-132123:us-central1:diningzoodatabase): it was only called 382.94776ms ago2017/05/30 16:42:46 couldn't connect to "teak-clarity-132123:us-central1:diningzoodatabase": Post https://www.googleapis.com/sql/v1beta4/projects/teak-clarity-132123/instances/diningzoodatabase/createEphemeral?alt=json: stream error: stream ID 1; PROTOCOL_ERROR2017/05/30 16:42:46 New connection for "teak-clarity-132123:us-central1:diningzoodatabase"2017/05/30 16:42:46 Thottling refreshCfg(teak-clarity-132123:us-central1:diningzoodatabase): it was only called 383.939371ms ago2017/05/30 16:42:46 couldn't connect to "teak-clarity-132123:us-central1:diningzoodatabase": Post https://www.googleapis.com/sql/v1beta4/projects/teak-clarity-132123/instances/diningzoodatabase/createEphemeral?alt=json: stream error: stream ID 1; PROTOCOL_ERROR2017/05/30 16:42:46 New connection for "teak-clarity-132123:us-central1:diningzoodatabase"2017/05/30 16:42:46 New connection for "teak-clarity-132123:us-central1:diningzoodatabase"2017/05/30 16:42:46 Thottling refreshCfg(teak-clarity-132123:us-central1:diningzoodatabase): it was only called 384.954228ms ago2017/05/30 16:42:46 couldn't connect to "teak-clarity-132123:us-central1:diningzoodatabase": Post https://www.googleapis.com/sql/v1beta4/projects/teak-clarity-132123/instances/diningzoodatabase/createEphemeral?alt=json: stream error: stream ID 1; PROTOCOL_ERROR2017/05/30 16:42:46 Thottling refreshCfg(teak-clarity-132123:us-central1:diningzoodatabase): it was only called 385.11944ms ago2017/05/30 16:42:46 couldn't connect to "teak-clarity-132123:us-central1:diningzoodatabase": Post https://www.googleapis.com/sql/v1beta4/projects/teak-clarity-132123/instances/diningzoodatabase/createEphemeral?alt=json: stream error: stream ID 1; PROTOCOL_ERROR2017/05/30 16:42:46 New connection for "teak-clarity-132123:us-central1:diningzoodatabase"2017/05/30 16:42:46 Thottling refreshCfg(teak-clarity-132123:us-central1:diningzoodatabase): it was only called 388.399746ms ago2017/05/30 16:42:46 couldn't connect to "teak-clarity-132123:us-central1:diningzoodatabase": Post https://www.googleapis.com/sql/v1beta4/projects/teak-clarity-132123/instances/diningzoodatabase/createEphemeral?alt=json: stream error: stream ID 1; PROTOCOL_ERROR2017/05/30 16:42:46 New connection for "teak-clarity-132123:us-central1:diningzoodatabase"2017/05/30 16:42:46 Thottling refreshCfg(teak-clarity-132123:us-central1:diningzoodatabase): it was only called 389.191251ms ago2017/05/30 16:42:46 couldn't connect to "teak-clarity-132123:us-central1:diningzoodatabase": Post https://www.googleapis.com/sql/v1beta4/projects/teak-clarity-132123/instances/diningzoodatabase/createEphemeral?alt=json: stream error: stream ID 1; PROTOCOL_ERROR2017/05/30 16:42:46 New connection for "teak-clarity-132123:us-central1:diningzoodatabase"2017/05/30 16:42:46 Thottling refreshCfg(teak-clarity-132123:us-central1:diningzoodatabase): it was only called 497.448221ms ago
You received this message because you are subscribed to the Google Groups "Google Cloud SQL discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-cloud-sql-discuss+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-cloud-sql-discuss/764f6e59-bb16-4d72-b483-4933721addb3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
No comments:
Post a Comment