Azure Event Hubs Error: Disconnected while requesting ApiVersion

[craifiskerinc]

Description

We are trying to connect to azure eventhubs and we're seeing these ApiVersion errors. We're using broker version >1.0.0 and have tried a variety of properties including these:

How to reproduce

Connect to azure eventhubs with this library

Checklist

Please provide the following information:

• confluent-kafka-go and librdkafka version (LibraryVersion()): tried 2.0.0,2.1.0,2.2.0,2.3.0
• Apache Kafka broker version: > 1.0.0
• Client configuration: ConfigMap{...}
  config.txt

    KAFKA_HOSTS: "xxx.servicebus.windows.net:9093"
    KAFKA_METADATA_BROKER_LIST: "xxx.servicebus.windows.net:9093"
    KAFKA_SECURITY_PROTOCOL: "sasl_ssl"
    KAFKA_SASL_MECHANISMS: "PLAIN"
    KAFKA_SSL_VERIFY: "false"
    KAFKA_PARTITION_ASSIGNMENT_STRATEGY: "cooperative-sticky"
    KAFKA_GO_BATCH_CONSUMER: "true"
    KAFKA_BATCH_NUM_MESSAGES: "50000"
    KAFKA_BATCH_SIZE: "1000000"
    KAFKA_LINGER_MS: "50"
    KAFKA_QUEUE_BUFFERING_MAX_MESSAGES: "10000000"
    KAFKA_QUEUE_BUFFERING_MAX_TYPE: "10000000"
    KAFKA_COMPRESSION_TYPE: none
    KAFKA_SOCKET_KEEPALIVE_ENABLE: "true"
    KAFKA_METADATA_MAX_AGE_MS: "180000"
    KAFKA_CONNECTIONS_MAX_IDLE_MS: "180000"
    KAFKA_MESSAGE_SEND_MAX_RETRIES: "2"
    KAFKA_COMPRESSION_CODEC: "none"
    KAFKA_HEARTBEAT_INTERVAL_MS: "3000"
    KAFKA_SESSION_TIMEOUT_MS: "30000"
    KAFKA_MAX_POLL_INTERVAL_MS: "300000"
    KAFKA_API_VERSION_REQUEST: "false"
    KAFKA_BROKER_VERSION_FALLBACK: "1.0.0"
    KAFKA_API_VERSION_FALLBACK_MS: "0"
    KAFKA_LOG_LEVEL: "3"

• Operating system: linux
• Provide client logs (with "debug": ".." as necessary)
• Provide broker log excerpts

19:16:43 UTC | env:xxx,service:xxx
%6|1708111002.798|FAIL|rdkafka#producer-1| [thrd:[xxx.servicebus.windows.net:9093/bootstrap](http://xxx.servicebus.windows.net:9093/bootstrap)]: [xxx.servicebus.windows.net:9093/bootstrap](http://xxx.servicebus.windows.net:9093/bootstrap): Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 1ms in state APIVERSION_QUERY, 4 identical error(s) suppressed)

• Critical issue

[rafi-fisker]

We are also seeing these errors

Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 1ms in state APIVERSION_QUERY, 4 identical error(s) suppressed)