Re: [VOTE] 0.10.2.2 RC1

+1 (binding). I checked release notes, documentation, and went through the quickstart. Thanks Matthias! On Fri, Jun 22, 2018 at 6:43 PM, Matthias J. Sax wrote: > Hello Kafka users, developers and client-developers, > > This is the second candidate for release of Apache Kafka 0.10.2.2. > > Note,

Partitions reassignment is failing in Kafka 1.1.0

Hi I altered a topic like below in kafka 1.1.0 /home/ubuntu/deploy/kafka/bin/kafka-topics.sh --zookeeper 127.0.0.1:2181 --alter --topic Topic3 --config min.insync.replicas=2 But whenever I am trying to verify the reassignment it is showing the below exception /home/ubuntu/deploy/kafka/bin/kafka

Subscribe to mailing list

RE: [VOTE] 0.10.2.2 RC1

Hey Everyone, I have been experiencing some problems and have not been able to find sufficient documentation online to help me figure out the root cuase. I have a 3 node kafka cluster set up on 3 different Windows 2012 servers. The cluster runs perfectly fine, ingesting data that is being sent

[VOTE] 2.0.0 RC1

Hello Kafka users, developers and client-developers, This is the second candidate for release of Apache Kafka 2.0.0. This is a major version release of Apache Kafka. It includes 40 new KIPs and several critical bug fixes. Please see the 2.0.0 release plan for more details: https://cwiki.apac

Possible bug? Duplicates when searching kafka stream state store with caching

Hi all, I'll first describe a simplified view of relevant parts of our setup (which should be enough to repro), describe the behavior we're seeing, and then note some information I've come across after digging in a bit. We have a kafka stream application, and one of our transform steps keeps a st

Re: [VOTE] 0.10.2.2 RC1

+1 (binding). Verified java docs, and ran the unit tests with the source tgz. Guozhang On Fri, Jun 29, 2018 at 10:22 AM Jason Gustafson wrote: > +1 (binding). I checked release notes, documentation, and went through the > quickstart. > > Thanks Matthias! > > On Fri, Jun 22, 2018 at 6:43 PM, Ma

RE: [VOTE] 0.10.2.2 RC1

Sorry everyone, I meant to change the subject of this email but forgot to before I sent it. I did not mean to hijack this thread. I apologize for the interruption. -Steve -Original Message- From: Coluccio, Stephen Sent: Friday, June 29, 2018 2:05 PM To: Kafka Users Cc: dev ; kafka-clie

Kafka cannot connect to broker

Hey Everyone, I have been experiencing some problems and have not been able to find sufficient documentation online to help me figure out the root cuase. I have a 3 node kafka cluster set up on 3 different Windows 2012 servers. The cluster runs perfectly fine, ingesting data that is being sent

Rebalance group issue

Hi All, I have a cluster of 3 nodes. Everything was good when started. When we deleted a topic(including folders in kafka brokers and zookeeper) restarted brokers and create topics. Now I see below error on 2 of the leaders which keeps coming every other second on server.logs. I have 1 partition

Visible intermediate state for KGroupedTable aggregation

Hello everyone, I have implemented a Kafka Streams service using the Streams DSL. Within the topology I am using A KGroupedTable, on which I perform an aggregate using an adder and subtractor. AFAICS (at least when using TopologyTestDriver) the intermediate state created by the subtractor is pushe

Re: [VOTE] 0.10.2.2 RC1

+1 Ran test suite. Checked signatures. On Fri, Jun 29, 2018 at 10:21 AM, Jason Gustafson wrote: > +1 (binding). I checked release notes, documentation, and went through the > quickstart. > > Thanks Matthias! > > On Fri, Jun 22, 2018 at 6:43 PM, Matthias J. Sax > wrote: > > > Hello Kafka users

Re: Subscribe to mailing list

Please see https://kafka.apache.org/contact On Fri, Jun 29, 2018 at 10:54 AM, chinchu chinchu wrote: > >

Re: [VOTE] 1.0.2 RC0

Thanks for pointing out Jason. I double checked and there was a bug in the release script. The artifact were not built. I'll roll a new RC. -Matthias On 6/29/18 2:01 PM, Jason Gustafson wrote: > Hey Matthias, > > I don't see the artifacts for scala 2.12. Did they not get uploaded? > > Thanks

Re: [kafka-clients] [VOTE] 0.10.2.2 RC1

Hi, Matthias, Thanks for running the release. Verified quickstart on scala 2.12 binary. +1 Jun On Fri, Jun 22, 2018 at 6:43 PM, Matthias J. Sax wrote: > Hello Kafka users, developers and client-developers, > > This is the second candidate for release of Apache Kafka 0.10.2.2. > > Note, that RC

Re: [kafka-clients] [VOTE] 0.11.0.3 RC0

Hi, Matthias, Thanks for running the release. Verified quickstart on scala 2.12 binary. +1 Jun On Fri, Jun 22, 2018 at 3:14 PM, Matthias J. Sax wrote: > Hello Kafka users, developers and client-developers, > > This is the first candidate for release of Apache Kafka 0.11.0.3. > > This is a bug

Re: [kafka-clients] [VOTE] 1.1.1 RC2

Hi, Dong, Thanks for running the release. Verified quickstart on scala 2.12 binary. +1 Jun On Thu, Jun 28, 2018 at 6:12 PM, Dong Lin wrote: > Hello Kafka users, developers and client-developers, > > This is the second candidate for release of Apache Kafka 1.1.1. > > Apache Kafka 1.1.1 is a bug

Re: Visible intermediate state for KGroupedTable aggregation

Hi, You cannot suppress those records, because both are required for correctness. Note, that each event might go to a different instance in the downstream aggregation -- that's why both records are required. Not sure what the problem for your business logic is. Note, that Kafka Streams provides e

Re: Visible intermediate state for KGroupedTable aggregation

On Sat, Jun 30, 2018 at 12:16 AM Matthias J. Sax wrote: > You cannot suppress those records, because both are required for > correctness. Note, that each event might go to a different instance in > the downstream aggregation -- that's why both records are required. > > Not sure what the problem fo

Re: [kafka-clients] [VOTE] 1.1.1 RC2

Hi Dong, +1 (binding) Verified binary using quick start, ran tests from source, checked release notes. Thanks for running the release! Regards, Rajini On Fri, Jun 29, 2018 at 11:11 PM, Jun Rao wrote: > Hi, Dong, > > Thanks for running the release. Verified quickstart on scala 2.12 binary. >

Re: Possible bug? Duplicates when searching kafka stream state store with caching

Hello Christian, Since you are calling fetch(key, start, end) I'm assuming that duplicateStore is a WindowedStore. With a windowed store, it is possible that a single key can fall into multiple windows, and hence be returned from the WindowStoreIterator, note its type is , V> So I'd first want to

Re: [kafka-clients] [VOTE] 0.11.0.3 RC0

Hi Matthias, +1 (binding) Verified binary using quick start, verified source by building and running tests, checked release notes. Thanks for running the release! Regards, Rajini On Fri, Jun 29, 2018 at 11:07 PM, Jun Rao wrote: > Hi, Matthias, > > Thanks for running the release. Verified q

Re: Visible intermediate state for KGroupedTable aggregation

I see what you are saying -- this is what I meant by eventual consistency guarantee. What is unclear to me is, why you need to re-group the KTable? The issue you describe only occurs for this operation. -Matthias On 6/29/18 3:44 PM, Thilo-Alexander Ginkel wrote: > On Sat, Jun 30, 2018 at 12:16 A

Re: Partitions reassignment is failing in Kafka 1.1.0

Hi Anyone any thoughts? On Fri 29 Jun, 2018, 11:07 PM Debraj Manna, wrote: > Hi > > I altered a topic like below in kafka 1.1.0 > > /home/ubuntu/deploy/kafka/bin/kafka-topics.sh --zookeeper 127.0.0.1:2181 > --alter --topic Topic3 --config min.insync.replicas=2 > > But whenever I am trying to ve

Re: Partitions reassignment is failing in Kafka 1.1.0

Seems to be related to KIP-113. server.properties didn't go thru. Do you mind pastebin'ing its content ? If you can pastebin logs from broker, that should help. Thanks On Fri, Jun 29, 2018 at 10:37 AM, Debraj Manna wrote: > Hi > > I altered a topic like below in kafka 1.1.0 > > /home/ubuntu/d

Re: Partitions reassignment is failing in Kafka 1.1.0

Please find the server.properties from one of the broker. broker.id=0 port=9092 num.network.threads=3 num.io.threads=8 socket.send.buffer.bytes=102400 socket.receive.buffer.bytes=102400 socket.request.max.bytes=104857600 log.dirs=/var/lib/kafka/kafka-logs num.recovery.threads.per.data.dir=1 log.re

[VOTE] 1.0.2 RC1

Hello Kafka users, developers and client-developers, This is the second candidate for release of Apache Kafka 1.0.2. This is a bug fix release addressing 27 tickets: https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+1.0.2 Release notes for the 1.0.2 release: http://home.apache.org/~

Re: [kafka-clients] [VOTE] 1.1.1 RC2

Hi Dong, it seems that the kafka-streams-quickstart artifacts are missing. Is it just me or is the RC incomplete? -Matthias On 6/29/18 4:07 PM, Rajini Sivaram wrote: > Hi Dong, > > +1 (binding) > > Verified binary using quick start, ran tests from source, checked > release notes. > > Thanks

Re: Partitions reassignment is failing in Kafka 1.1.0

I am generating the reassignent.json like below /home/ubuntu/deploy/kafka/bin/kafka-reassign-partitions.sh --zookeeper 127.0.0.1:2181 --generate --topics-to-move-json-file /home/ubuntu/deploy/kafka/topics_to_move.json --broker-list '%s' |tail -1 > /home/ubuntu/deploy/kafka/reassignment.json" Then

Re: Partitions reassignment is failing in Kafka 1.1.0

It is problem on my side. The code was changing the replicas count but not the log_dirs. Since I am migrating from 0.10 this part of the code was not changed. I have a follow up question what is the default value of log_dirs if I don't specify it in reassignment.json ? On Sat, Jun 30, 2018 at 11:

Re: [kafka-clients] [VOTE] 2.0.0 RC1

looks like maven artifacts are not updated in the staging repo. They are still at old timestamp. https://repository.apache.org/content/groups/staging/org/apache/kafka/kafka_2.11/2.0.0/ On Sat, Jun 30, 2018 at 12:06 AM Rajini Sivaram wrote: > Hello Kafka users, developers and client-developers, >