After a while all nodes seemed stable, but the producer errors because of min isr not attained. I had to restore our VM and didn't keep the logs... stupid me. What i'm really confused is the topicIds in zk here
Le mar. 25 janv. 2022 à 15:13, <manoj.agraw...@cognizant.com> a écrit : > Are u getting error at kafka log or server.log ? > ________________________________ > From: Nicolas Carlot <nicolas.car...@chronopost.fr.INVALID> > Sent: Tuesday, January 25, 2022 6:20 AM > To: users@kafka.apache.org <users@kafka.apache.org> > Subject: Upgrade from 2.0 to 2.8.1 failed > > [External] > > > Hello everyone, > > I just had a major failure while upgrading a kafka cluster from 2.0 to > 2.8.1 following the provided migration process. > I understand that a topicId is now given to each topic within zookeeper and > meta.properties of each partition. > While describing the topic, it seems I have different topicId depending on > the zk node i'm querying: > > [kafkaadm@lyn3e154(PFI):~ 13:16:28]$ > /opt/java/j2ee/kafka/bin/kafka-topics.sh --zookeeper satezookeeperi1:62181 > --describe --topic PARCEL360.LT > Topic: PARCEL360.LT TopicId: XjIuCqy2TcKu-M5smrz9iA PartitionCount: 10 > ReplicationFactor: 3 Configs: compression.type=lz4 > Topic: PARCEL360.LT Partition: 0 Leader: 3 Replicas: > 1,2,3 Isr: 3 > Topic: PARCEL360.LT Partition: 1 Leader: 3 Replicas: > 2,3,1 Isr: 3 > Topic: PARCEL360.LT Partition: 2 Leader: 3 Replicas: > 3,1,2 Isr: 3 > Topic: PARCEL360.LT Partition: 3 Leader: 3 Replicas: > 1,2,3 Isr: 3 > Topic: PARCEL360.LT Partition: 4 Leader: 3 Replicas: > 2,3,1 Isr: 3 > Topic: PARCEL360.LT Partition: 5 Leader: 3 Replicas: > 3,1,2 Isr: 3 > Topic: PARCEL360.LT Partition: 6 Leader: 3 Replicas: > 1,2,3 Isr: 3 > Topic: PARCEL360.LT Partition: 7 Leader: 3 Replicas: > 2,3,1 Isr: 3 > Topic: PARCEL360.LT Partition: 8 Leader: 3 Replicas: > 3,1,2 Isr: 3 > Topic: PARCEL360.LT Partition: 9 Leader: 3 Replicas: > 1,2,3 Isr: 3 > [kafkaadm@lyn3e154(PFI):~ 13:17:06]$ > /opt/java/j2ee/kafka/bin/kafka-topics.sh --zookeeper satezookeeperi2:62181 > --describe --topic PARCEL360.LT > Topic: PARCEL360.LT TopicId: zwbQDd9NRjGwq-v2twHfIQ PartitionCount: 10 > ReplicationFactor: 3 Configs: compression.type=lz4 > Topic: PARCEL360.LT Partition: 0 Leader: 3 Replicas: > 1,2,3 Isr: 3 > Topic: PARCEL360.LT Partition: 1 Leader: 3 Replicas: > 2,3,1 Isr: 3 > Topic: PARCEL360.LT Partition: 2 Leader: 3 Replicas: > 3,1,2 Isr: 3 > Topic: PARCEL360.LT Partition: 3 Leader: 3 Replicas: > 1,2,3 Isr: 3 > Topic: PARCEL360.LT Partition: 4 Leader: 3 Replicas: > 2,3,1 Isr: 3 > Topic: PARCEL360.LT Partition: 5 Leader: 3 Replicas: > 3,1,2 Isr: 3 > Topic: PARCEL360.LT Partition: 6 Leader: 3 Replicas: > 1,2,3 Isr: 3 > Topic: PARCEL360.LT Partition: 7 Leader: 3 Replicas: > 2,3,1 Isr: 3 > Topic: PARCEL360.LT Partition: 8 Leader: 3 Replicas: > 3,1,2 Isr: 3 > Topic: PARCEL360.LT Partition: 9 Leader: 3 Replicas: > 1,2,3 Isr: 3 > [kafkaadm@lyn3e154(PFI):~ 13:17:11]$ > /opt/java/j2ee/kafka/bin/kafka-topics.sh --zookeeper satezookeeperi3:62181 > --describe --topic PARCEL360.LT > Topic: PARCEL360.LT TopicId: XjIuCqy2TcKu-M5smrz9iA PartitionCount: 10 > ReplicationFactor: 3 Configs: compression.type=lz4 > Topic: PARCEL360.LT Partition: 0 Leader: 3 Replicas: > 1,2,3 Isr: 3 > Topic: PARCEL360.LT Partition: 1 Leader: 3 Replicas: > 2,3,1 Isr: 3 > Topic: PARCEL360.LT Partition: 2 Leader: 3 Replicas: > 3,1,2 Isr: 3 > Topic: PARCEL360.LT Partition: 3 Leader: 3 Replicas: > 1,2,3 Isr: 3 > Topic: PARCEL360.LT Partition: 4 Leader: 3 Replicas: > 2,3,1 Isr: 3 > Topic: PARCEL360.LT Partition: 5 Leader: 3 Replicas: > 3,1,2 Isr: 3 > Topic: PARCEL360.LT Partition: 6 Leader: 3 Replicas: > 1,2,3 Isr: 3 > Topic: PARCEL360.LT Partition: 7 Leader: 3 Replicas: > 2,3,1 Isr: 3 > Topic: PARCEL360.LT Partition: 8 Leader: 3 Replicas: > 3,1,2 Isr: 3 > Topic: PARCEL360.LT Partition: 9 Leader: 3 Replicas: > 1,2,3 Isr: 3 > > > Any idea what's happening here ? > > > > > -- > < > https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.chronopost.fr%2Ffr%3Fxtatc%3DINT-149&data=04%7C01%7CManoj.Agrawal2%40cognizant.com%7Cf6ea870a782b4b9991ba08d9dffd4535%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637787101567140181%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=aCg2JBxBJqr8s18UU82ID4f8UwLBh4IUouEpB4iVtHQ%3D&reserved=0 > > > > > *Nicolas Carlot* > *Lead dev*Direction des Systèmes d'Information > > > 3 boulevard Romain Rolland > 75014 Paris > < > https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmailsign.chronopost.fr%2Flinkc%2FK0ppSHlnPT0-L3A4PQ&data=04%7C01%7CManoj.Agrawal2%40cognizant.com%7Cf6ea870a782b4b9991ba08d9dffd4535%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637787101567140181%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=bzoRg%2BN4Bdq8weVQisMvfRLY8VuynUeIRJIun4bkaog%3D&reserved=0 > > > < > https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmailsign.chronopost.fr%2Flinkc%2FK0ppSHlnPT0-L1pzPQ&data=04%7C01%7CManoj.Agrawal2%40cognizant.com%7Cf6ea870a782b4b9991ba08d9dffd4535%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637787101567140181%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=oz2gD3tJwAyhtb3afcMdryQvUB00Za7miJoaGZNwtpA%3D&reserved=0 > > > < > https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmailsign.chronopost.fr%2Flinkc%2FK0ppSHlnPT0-L1pRPQ&data=04%7C01%7CManoj.Agrawal2%40cognizant.com%7Cf6ea870a782b4b9991ba08d9dffd4535%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637787101567140181%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=KNCopWYpLRZvMoP1kxe6%2BpALKEvljnEi2LfDQxSI7bc%3D&reserved=0 > > > < > https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmailsign.chronopost.fr%2Flinkc%2FK0ppSHlnPT0-L1pVPQ&data=04%7C01%7CManoj.Agrawal2%40cognizant.com%7Cf6ea870a782b4b9991ba08d9dffd4535%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637787101567140181%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=f3Brx78KYlwk5M3eRbjgJcPnfMOAhop4wSUx8%2BPXgG0%3D&reserved=0 > > > This e-mail and any files transmitted with it are for the sole use of the > intended recipient(s) and may contain confidential and privileged > information. If you are not the intended recipient(s), please reply to the > sender and destroy all copies of the original message. Any unauthorized > review, use, disclosure, dissemination, forwarding, printing or copying of > this email, and/or any action taken in reliance on the contents of this > e-mail is strictly prohibited and may be unlawful. Where permitted by > applicable law, this e-mail and other e-mail communications sent to and > from Cognizant e-mail addresses may be monitored. > -- <https://www.chronopost.fr/fr?xtatc=INT-149> *Nicolas Carlot* *Lead dev*Direction des Systèmes d'Information 3 boulevard Romain Rolland 75014 Paris <https://mailsign.chronopost.fr/linkc/K0ppSHlnPT0-L3A4PQ> <https://mailsign.chronopost.fr/linkc/K0ppSHlnPT0-L1pzPQ> <https://mailsign.chronopost.fr/linkc/K0ppSHlnPT0-L1pRPQ> <https://mailsign.chronopost.fr/linkc/K0ppSHlnPT0-L1pVPQ>
