Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CouchbaseHealthIndicator can hang when Couchbase goes away #13879

Closed
HarryEMartland opened this issue Jul 24, 2018 · 4 comments
Closed

CouchbaseHealthIndicator can hang when Couchbase goes away #13879

HarryEMartland opened this issue Jul 24, 2018 · 4 comments
Assignees
@snicoll
Labels
type: bug A general bug
Milestone
2.0.5

Comments

@HarryEMartland
Copy link

HarryEMartland commented Jul 24, 2018 •
edited by snicoll

When couchbase is stoped completely the health endpoint does not return and the below logs continuously spew out.

Steps to reproduce:

  • Start couchbase
  • Boot up spring boot app with couchbase and couchbase health indicator enabled
  • Kill couchbase
  • Request health endpoint /actuator/health

Versions:
spring-data-couchbase:3.0.8.RELEASE
spring-boot-gradle-plugin:2.0.3.RELEASE

2018-07-24 22:52:14.877  WARN 5945 --- [      cb-io-1-7] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:14.877  WARN 5945 --- [      cb-io-1-8] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:14.877  WARN 5945 --- [      cb-io-1-8] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:14.980  WARN 5945 --- [      cb-io-1-1] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:14.980  WARN 5945 --- [      cb-io-1-2] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:14.980  WARN 5945 --- [      cb-io-1-3] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:14.980  WARN 5945 --- [      cb-io-1-3] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:14.980  WARN 5945 --- [      cb-io-1-4] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:14.980  WARN 5945 --- [      cb-io-1-4] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.083  WARN 5945 --- [      cb-io-1-5] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.083  WARN 5945 --- [      cb-io-1-6] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.084  WARN 5945 --- [      cb-io-1-7] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.084  WARN 5945 --- [      cb-io-1-8] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.084  WARN 5945 --- [      cb-io-1-7] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.084  WARN 5945 --- [      cb-io-1-8] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.185  WARN 5945 --- [      cb-io-1-1] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.186  WARN 5945 --- [      cb-io-1-2] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.186  WARN 5945 --- [      cb-io-1-2] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.189  WARN 5945 --- [      cb-io-1-3] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.190  WARN 5945 --- [      cb-io-1-4] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.190  WARN 5945 --- [      cb-io-1-4] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.286  WARN 5945 --- [      cb-io-1-5] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.286  WARN 5945 --- [      cb-io-1-6] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.286  WARN 5945 --- [      cb-io-1-6] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.294  WARN 5945 --- [      cb-io-1-7] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.295  WARN 5945 --- [      cb-io-1-8] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.295  WARN 5945 --- [      cb-io-1-8] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.392  WARN 5945 --- [      cb-io-1-1] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.393  WARN 5945 --- [      cb-io-1-2] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.394  WARN 5945 --- [      cb-io-1-2] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.395  WARN 5945 --- [      cb-io-1-3] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.395  WARN 5945 --- [      cb-io-1-4] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.395  WARN 5945 --- [      cb-io-1-4] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.498  WARN 5945 --- [      cb-io-1-5] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.498  WARN 5945 --- [      cb-io-1-6] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.499  WARN 5945 --- [      cb-io-1-7] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.499  WARN 5945 --- [      cb-io-1-7] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.499  WARN 5945 --- [      cb-io-1-8] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.499  WARN 5945 --- [      cb-io-1-8] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.603  WARN 5945 --- [      cb-io-1-1] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.603  WARN 5945 --- [      cb-io-1-2] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.604  WARN 5945 --- [      cb-io-1-4] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.604  WARN 5945 --- [      cb-io-1-3] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.604  WARN 5945 --- [      cb-io-1-4] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.604  WARN 5945 --- [      cb-io-1-3] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.705  WARN 5945 --- [      cb-io-1-6] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.705  WARN 5945 --- [      cb-io-1-5] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.706  WARN 5945 --- [      cb-io-1-8] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.706  WARN 5945 --- [      cb-io-1-7] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.706  WARN 5945 --- [      cb-io-1-8] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.706  WARN 5945 --- [      cb-io-1-7] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.809  WARN 5945 --- [      cb-io-1-1] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.809  WARN 5945 --- [      cb-io-1-2] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.810  WARN 5945 --- [      cb-io-1-4] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.810  WARN 5945 --- [      cb-io-1-3] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.810  WARN 5945 --- [      cb-io-1-4] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.810  WARN 5945 --- [      cb-io-1-3] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.913  WARN 5945 --- [      cb-io-1-6] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.913  WARN 5945 --- [      cb-io-1-5] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.913  WARN 5945 --- [      cb-io-1-7] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.913  WARN 5945 --- [      cb-io-1-8] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.913  WARN 5945 --- [      cb-io-1-7] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:15.913  WARN 5945 --- [      cb-io-1-8] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.017  WARN 5945 --- [      cb-io-1-2] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.017  WARN 5945 --- [      cb-io-1-1] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.018  WARN 5945 --- [      cb-io-1-4] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.018  WARN 5945 --- [      cb-io-1-3] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.018  WARN 5945 --- [      cb-io-1-4] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.018  WARN 5945 --- [      cb-io-1-3] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.119  WARN 5945 --- [      cb-io-1-5] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.119  WARN 5945 --- [      cb-io-1-6] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.120  WARN 5945 --- [      cb-io-1-8] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.120  WARN 5945 --- [      cb-io-1-7] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.120  WARN 5945 --- [      cb-io-1-8] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.120  WARN 5945 --- [      cb-io-1-7] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.221  WARN 5945 --- [      cb-io-1-1] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.221  WARN 5945 --- [      cb-io-1-2] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.222  WARN 5945 --- [      cb-io-1-3] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.222  WARN 5945 --- [      cb-io-1-4] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.222  WARN 5945 --- [      cb-io-1-3] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.222  WARN 5945 --- [      cb-io-1-4] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.325  WARN 5945 --- [      cb-io-1-5] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.325  WARN 5945 --- [      cb-io-1-6] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.327  WARN 5945 --- [      cb-io-1-7] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.327  WARN 5945 --- [      cb-io-1-8] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.327  WARN 5945 --- [      cb-io-1-7] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.327  WARN 5945 --- [      cb-io-1-8] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.430  WARN 5945 --- [      cb-io-1-1] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.430  WARN 5945 --- [      cb-io-1-2] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.431  WARN 5945 --- [      cb-io-1-4] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.431  WARN 5945 --- [      cb-io-1-3] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.431  WARN 5945 --- [      cb-io-1-4] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.431  WARN 5945 --- [      cb-io-1-3] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.532  WARN 5945 --- [      cb-io-1-5] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.532  WARN 5945 --- [      cb-io-1-6] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.533  WARN 5945 --- [      cb-io-1-7] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.533  WARN 5945 --- [      cb-io-1-8] c.c.client.core.endpoint.Endpoint        : [localhost:8091][ConfigEndpoint]: Could not connect to remote socket: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.533  WARN 5945 --- [      cb-io-1-7] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
2018-07-24 22:52:16.533  WARN 5945 --- [      cb-io-1-8] c.c.client.core.endpoint.Endpoint        : Error during reconnect: com.couchbase.client.deps.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:8091
@spring-projects-issues spring-projects-issues added the status: waiting-for-triage An issue we've not yet triaged label Jul 24, 2018
@snicoll
Copy link
Member

snicoll commented Jul 25, 2018 •
edited

Similar to #10809 with hopefully a way to configure the client not to do that.

@snicoll snicoll added type: bug A general bug and removed status: waiting-for-triage An issue we've not yet triaged labels Jul 25, 2018
@snicoll snicoll added this to the 2.0.x milestone Jul 25, 2018
@snicoll snicoll changed the title Couchbase CouchbaseHealthIndicator does not return when Couchbase goes away CouchbaseHealthIndicator can hang when Couchbase goes away Jul 25, 2018
@dnl50
Copy link

dnl50 commented Jul 31, 2018 •
edited

I digged a bit into it and the reason why this happens is because the CouchBaseHealthIndicator invokes
the info(timeout, timeUnit) method of the DefaultBucketManager of couchbase, which in return retries sending a BucketConfigRequest to the couchbase server. It returns after the request was successfor or the given timeout threshold is exceeded.

The default timeout is set to 75 seconds (specified in DefaultCouchbaseEnvironment by the MANAGEMENT_TIMEOUT field), which is why it takes forever for the health actuator to return when the server is not online.

I will try to find a way to make the timeout configurable, because 75 seconds seems a bit much :P

Edit:

So the configuration class creating the DefaultCouchbaseEnvironment is AbstractCouchbaseConfiguration of spring data couchbase.

Edit 2:

Calling DefaultBucketManager#info(timeout, timeunit) with a configurable timeout will solve this problem.

@snicoll
Copy link
Member

snicoll commented Aug 8, 2018 •
edited

so this issue can be closed I think.

@dnl50 what makes you think this issue can be closed? As you've indicated we should call info with a configurable timeout probably

@snicoll snicoll self-assigned this Aug 8, 2018
@dnl50
Copy link

dnl50 commented Aug 8, 2018

I thought the info(timeout, timeunit) method was protected, so yeah it can be called with a configurable timeout of course.

@snicoll snicoll closed this as completed in a023bd0 Aug 8, 2018
@snicoll snicoll modified the milestones: 2.0.x, 2.0.5 Aug 8, 2018
@wilkinsona wilkinsona mentioned this issue Oct 4, 2018
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@snicoll snicoll

Labels
type: bug A general bug
Projects
None yet
Milestone
2.0.5
Development

No branches or pull requests
4 participants
@snicoll @HarryEMartland @spring-projects-issues @dnl50