Keda-operator cannot create KafkaScaledObject due to Kafka client error "client has run out of available brokers to talk to (Is your cluster reachable?)"

[yeskiran]

Hi experts,
I'm trying to setup HPA on my Azure AKS cluster using Keda with Kafka, I'm getting the below error
" error creating Kafka client: kafka: the client has run out of available brokers to talk to (Is your cluster reachable?)"
Keda version: keda:2.2.0
AKS version : 1.19.7
Kafka brokers verion 10

My other consumer pods are able to successfully publish and consume messages with the Kafka cluster brokers.

Not sure how to debug this? Only notable difference in my cluster is that Kafka brokers are on 9094 instead of port 9092. Not sure if this the reason why it's failing.

Any help is appreciated.

Thanks
Kiran

[zroubalik]

Could you please share your ScaledObject spec?

[yeskiran]

apiVersion: keda.sh/v1alpha1
kind: ScaledObject
metadata:
name: kafka-scaledobject
namespace: cde
spec:
scaleTargetRef:
name: cde-order-manager
pollingInterval: 30
triggers:

• type: kafka
  metadata:
  bootstrapServers: rvkyropkhfka.healthnation.local:9094,rvkyropkhfka02.healthnation.local:9094,rvkyropkhfka03.healthnation.local:9094
  consumerGroup: CDE.OrderManager.Consumer-1 # Make sure that this consumer group name is the same one as the one that is consuming topics
  topic: cdeaas-az.order-manager.accepted-targets-keda

  Optional

  lagThreshold: "100"
  offsetResetPolicy: earliest

[yeskiran]

[yeskiran]

Hello,
After lot of troubleshooting, found that the config version property in the sarama client needs to be 0.10.2.0 and only then the client is able to talk to the brokers. I was able to build a sample go app with the same version of sarama client. I just tweaked the version and it was able to connect to kafka brokers (v.0.8) . Is there a way in keda to pass this value as a environment variable?

Thanks

[Dorn-]

Hello, I coded a feature to be able to specify your kafka version.
I'll test it soon and submit a PR asap.

[deveshbajaj59]

Any update on this issue.

I am trying the same to connect kafka via sasl_scram_sha512 and getting the same error

[Dorn-]

#1866 has been merged, waiting for the new release of Keda (2.4.0 I guess)