Re: Log cleaner is marking the partition as uncleanable

2021-11-15 Thread Luke Chen
Hi Dhirendra, The error message said that the log cleaner believed your log file is corrupted because there's a record with 0 Byte, but the minimum record size is 14 Bytes (including CRC, Key, Value,...). I don't think it's good to fix the corrupted file manually. Thank you. Luke On Mon, Nov 15,

Re: Log cleaner is marking the partition as uncleanable

2021-11-15 Thread Dhirendra Singh
Hi Luke, What could be the reason for log corruption ? There is no abnormal broker shutdown or the machine where broker is running has any failure. we see this error in the log while broker is up. Moreover when i delete the topic and recreate it log cleaner do not remove the topic from uncleanable

KTable updates by non-key field

2021-11-15 Thread Claudia Kesslau
Hi Kafka community, I'm new to using KTable functionality in KafkaStreams and I'm struggling with updating KTable values by a non-key field. I've got a stream of BoxData that I want to enrich with BoxInfo objects. For those BoxInfo objects I created a compacted topic `boxInfo` and read this top

question: kafka connect mm2 curl command

2021-11-15 Thread Men Lim
I am running AWS MSK v2.7.0 with SASL/SCRAM. I have an ec2 instance running the kafka connector and mirror maker 2 (MM2). I was able to start up the distributor w/o any issue but when I run the curl command to start the worker, the output look fine but no data are replicating. curl -s -X POST -H '

Re: EOL clarification

2021-11-15 Thread Luke Chen
Hi Piyush, Usually, Kafka only produces releases for the 2 most recent branches. Ex: We're going to release V3.1, and some fix will also back port to V3.0 branch. So, from the download page, you can see most minor version is only up to 1, ex: 2.3.1, 2.5.1... But that's not a strict rule, so you'll

Re: EOL clarification

2021-11-15 Thread Piyush Mittal
Hi Luke, >Kafka only produces releases for the 2 most recent branches. EOL policy on wiki says three releases. Can we correct wiki? >you'll also find some releases have minor versi