Depending on your original version, you may have to consult the upgrade
guide.
https://kafka.apache.org/27/documentation.html#upgrade

Didn't see important compatibility settings like:
[image: image.png]


Perhaps you are not doing it correctly.


[image: Confluent] <https://www.confluent.io>
Wu Shilin
Solution Architect
+6581007012
Follow us: [image: Blog]
<https://www.confluent.io/blog?utm_source=footer&utm_medium=email&utm_campaign=ch.email-signature_type.community_content.blog>[image:
Twitter] <https://twitter.com/ConfluentInc>[image: LinkedIn]
<https://www.linkedin.com/company/confluent/>[image: Slack]
<https://slackpass.io/confluentcommunity>[image: YouTube]
<https://youtube.com/confluent>
[image: Kafka Summit] <https://www.kafka-summit.org/>


On Wed, Jul 14, 2021 at 7:21 PM Tony John <tonyjohnant...@gmail.com> wrote:

> Can someone help me on this.
>
> Thanks,
> Tony
>
> On Fri, Jul 9, 2021 at 8:15 PM Tony John <tonyjohnant...@gmail.com> wrote:
>
> > Hi All,
> >
> > I am trying to upgrade my Kafka streams application to 2.7.1 version of
> > Kafka. The brokers are upgraded to 2.7.1 and kafka dependencies are also
> on
> > 2.7.1. But when I start the application, rebalance is failing with the
> > following message
> >
> > Rebalance failed. org.apache.kafka.common.errors.DisconnectException
> >
> > I am also seeing Group coordinator broker102:9092 (id: 2147483645 rack:
> > null) is unavailable or invalid due to cause: coordinator
> > unavailable.isDisconnected: false. Rediscovery will be attempted.
> >
> > The full set of logs (which gets printed every 30 seconds) is given below
> >
> > INFO  2021-07-09 09:33:20.229 | internals.AbstractCoordinator [Consumer
> > clientId=consumer-my-app-v1-task-coordinator-consumer-app-node100-9,
> > groupId=my-app-v1-task-coordinator-consumer-app-node100] Group
> coordinator
> > broker102:9092 (id: 2147483645 rack: null) is unavailable or invalid due
> to
> > cause: null.isDisconnected: true. Rediscovery will be attempted.
> > INFO  2021-07-09 09:33:20.230 | internals.AbstractCoordinator [Consumer
> > clientId=consumer-my-app-v1-task-coordinator-consumer-app-node100-9,
> > groupId=my-app-v1-task-coordinator-consumer-app-node100] Discovered group
> > coordinator broker102:9092 (id: 2147483645 rack: null)
> > INFO  2021-07-09 09:33:20.230 | internals.AbstractCoordinator [Consumer
> > clientId=consumer-my-app-v1-task-coordinator-consumer-app-node100-9,
> > groupId=my-app-v1-task-coordinator-consumer-app-node100] Group
> coordinator
> > broker102:9092 (id: 2147483645 rack: null) is unavailable or invalid due
> to
> > cause: coordinator unavailable.isDisconnected: false. Rediscovery will be
> > attempted.
> > INFO  2021-07-09 09:33:20.330 | internals.AbstractCoordinator [Consumer
> > clientId=consumer-my-app-v1-task-coordinator-consumer-app-node100-9,
> > groupId=my-app-v1-task-coordinator-consumer-app-node100] Discovered group
> > coordinator broker102:9092 (id: 2147483645 rack: null)
> > INFO  2021-07-09 09:33:20.331 | internals.AbstractCoordinator [Consumer
> > clientId=consumer-my-app-v1-task-coordinator-consumer-app-node100-9,
> > groupId=my-app-v1-task-coordinator-consumer-app-node100] Rebalance
> failed.
> > org.apache.kafka.common.errors.DisconnectException
> > INFO  2021-07-09 09:33:20.331 | internals.AbstractCoordinator [Consumer
> > clientId=consumer-my-app-v1-task-coordinator-consumer-app-node100-9,
> > groupId=my-app-v1-task-coordinator-consumer-app-node100] (Re-)joining
> group
> > INFO  2021-07-09 09:33:20.333 | internals.AbstractCoordinator [Consumer
> > clientId=consumer-my-app-v1-task-coordinator-consumer-app-node100-9,
> > groupId=my-app-v1-task-coordinator-consumer-app-node100] (Re-)joining
> group
> > INFO  2021-07-09 09:33:20.419 | internals.AbstractCoordinator [Consumer
> > clientId=consumer-my-app-v1-master-coordinator-consumer-8,
> > groupId=my-app-v1-master-coordinator-consumer] Group coordinator
> > broker101:9092 (id: 2147483646 rack: null) is unavailable or invalid due
> to
> > cause: null.isDisconnected: true. Rediscovery will be attempted.
> > INFO  2021-07-09 09:33:20.420 | internals.AbstractCoordinator [Consumer
> > clientId=consumer-my-app-v1-master-coordinator-consumer-8,
> > groupId=my-app-v1-master-coordinator-consumer] Discovered group
> coordinator
> > broker101:9092 (id: 2147483646 rack: null)
> > INFO  2021-07-09 09:33:20.420 | internals.AbstractCoordinator [Consumer
> > clientId=consumer-my-app-v1-master-coordinator-consumer-8,
> > groupId=my-app-v1-master-coordinator-consumer] Group coordinator
> > broker101:9092 (id: 2147483646 rack: null) is unavailable or invalid due
> to
> > cause: coordinator unavailable.isDisconnected: false. Rediscovery will be
> > attempted.
> > INFO  2021-07-09 09:33:20.521 | internals.AbstractCoordinator [Consumer
> > clientId=consumer-my-app-v1-master-coordinator-consumer-8,
> > groupId=my-app-v1-master-coordinator-consumer] Discovered group
> coordinator
> > broker101:9092 (id: 2147483646 rack: null)
> > INFO  2021-07-09 09:33:20.522 | internals.AbstractCoordinator [Consumer
> > clientId=consumer-my-app-v1-master-coordinator-consumer-8,
> > groupId=my-app-v1-master-coordinator-consumer] Rebalance failed.
> > org.apache.kafka.common.errors.DisconnectException
> > INFO  2021-07-09 09:33:20.523 | internals.AbstractCoordinator [Consumer
> > clientId=consumer-my-app-v1-master-coordinator-consumer-8,
> > groupId=my-app-v1-master-coordinator-consumer] (Re-)joining group
> > INFO  2021-07-09 09:33:20.524 | internals.AbstractCoordinator [Consumer
> > clientId=consumer-my-app-v1-master-coordinator-consumer-8,
> > groupId=my-app-v1-master-coordinator-consumer] (Re-)joining group
> >
> > The application was working fine on 2.5.1. Please note with 2.5.1 the
> > build used was kafka_*2.12*-2.5.1, but with 2.7.1 I used kafka_*2.13*
> > -2.7.1
> >
> > *The broker config is *
> >
> > broker.id=2
> > listeners=PLAINTEXT://broker102:9092
> > advertised.listeners=PLAINTEXT://broker102:9092
> > num.network.threads=4
> > num.io.threads=4
> > socket.send.buffer.bytes=102400
> > socket.receive.buffer.bytes=102400
> > socket.request.max.bytes=104857600
> > log.dirs=/mnt/store/kafka/kafka-logs
> > num.partitions=1
> > num.recovery.threads.per.data.dir=4
> > offsets.topic.replication.factor=2
> > transaction.state.log.replication.factor=2
> > transaction.state.log.min.isr=2
> > log.retention.hours=1
> > log.segment.bytes=1073741824
> > log.retention.check.interval.ms=300000
> >
> >
> zookeeper.connect=broker100:2181,broker101:2181,broker102:2181,broker103:2181,broker104:2181
> > zookeeper.connection.timeout.ms=30000
> > group.initial.rebalance.delay.ms=120000
> > offsets.retention.minutes=10080
> > message.max.bytes=31457280
> > replica.fetch.max.bytes=31457280
> > group.max.session.timeout.ms=1200000
> > request.timeout.ms=600000
> > connections.max.idle.ms=1080000
> >
> > What could be wrong? Should I switch to kafka_*2.12*-2.7.1 ?
> >
> > Thanks,
> > Tony
> >
> >
>

Reply via email to