kafka offset disappear

2021-02-02 Thread javenjiangfsof
Hi guys, Version: Kafka_2.11-1.10 my Kafka consumer offset was disappeared, in ‘__consumer_offset’, that topic’s message is empty. the consumer hasn’t commit at least 15 days, i think the configuration ‘offsets.retention.minutes’ effects i want to test this, i set offsets.retention.minut

Unable to run unit tests inside a docker container

2021-02-02 Thread Stephin Thomas
Hi, I have cloned the apache-Kafka repo inside a docker container that has java 11 installed on it and on running the ./gradlew uniTest command I'm getting build failure with failing network tests. The logs from the container are uploaded here https://gist.github.com/STEPHINRACHEL/9fbce12db303eb02

Re: Unable to run unit tests inside a docker container

2021-02-02 Thread Martin Gainty
there are 2 things you will notice from your stacktrace consumerClient = new ConsumerNetworkClient(client, metadata, time, 100, 1000); your 10k request timeout is too short so why not increase 1ms to something more reasonable the specific testcase (which i do not have) is trying to decompres

Unable to run unit tests inside docker container

2021-02-02 Thread Stephin Thomas
Hi, I have cloned the apache-kafka repo inside a docker container which has java 11 installed on it and on running the ./gradlew unitTest command I'm getting build failure with failing network issues. The logs are uploaded here https://gist.github.com/STEPHINRACHEL/9fbce12db303eb0285d14ff322dbd15d

Re: Clarify “the order of execution for the subtractor and adder is not defined”

2021-02-02 Thread Fq Public
Ahh okay I see (re: producer config), I didn't think about that yet. I'm using StreamsConfig.EXACTLY_ONCE processing for my Kafka Streams app so I should be protected against re-ordering of messages in case of retries (since `enable.idempotent` is automatically set to true in StreamsConfig.EXACTLY_

Re: Unable to run unit tests inside a docker container

2021-02-02 Thread Stephin Thomas
Hi, @Martin Thank you for your response. I do not have much knowledge of the code base for Kafka. I was trying to use the upstream code as it is. As you suggested I tried to increase the timeout, and it got worked and network tests got passed. Still, the build got failed with some other error. (Pro