Rolling Upgrade failed after bumping version to 2.1 from 1.1

2019-01-29 Thread M. Manna
Hello, I have recently upgraded to 2.12-2.1.0 from 2.11-1.1.0. After bumping inter.broker.protocol.version to 2.1 (and doing 2 bleed-and-restart from 1.1), my services are all failing to start. Slightly clueless at this stage regarding what to do other than reverting. I followed the steps in main

Re: Rolling Upgrade failed after bumping version to 2.1 from 1.1

2019-01-29 Thread M. Manna
By investigating journalctl logs - I see that it says version 2.1 is not a valid version? So what is a valid version, does anyone know? Thanks, On Tue, 29 Jan 2019 at 11:37, M. Manna wrote: > Hello, > > I have recently upgraded to 2.12-2.1.0 from 2.11-1.1.0. After bumping > inter.broker.protoco

Interaction between transactions, CreateTime topics and offsetsForTimes

2019-01-29 Thread Mattia Barbon
Hi, tl;dr: transaction markers are added to the time index with the timestamp of the broker, and this makes offsetsForTimes confusing/unreliable for topics set up with CreateTime timestamp Longer version I am working on a system where we are taking multiple streams of messages from Kafka, applyi

Hopping Window

2019-01-29 Thread Rene Richard
Hello, I’ve been struggling for a while now with Kafka windows. I want to calculate an average heart rate on a 5 minute window. I have three apps : 1)- A heart beat generator. It starts at the top of the minute (second 0). Sends between 60 to 70 beats using a producer. The event time is set wi

c++ kafka

2019-01-29 Thread Dor Ben Dov
Hi, Can one tell me what is the best c++ library or approach if I have a c++ process in which I want it to write to kafka? Thanks in advanced, Dor This email and the information contained herein is proprietary and confidential and subject to the Amdocs Email Terms of Service, which yo

Re: c++ kafka

2019-01-29 Thread Emmett Butler
Check out librdkafka https://github.com/edenhill/librdkafka On Tue, Jan 29, 2019 at 07:02 Dor Ben Dov wrote: > Hi, > Can one tell me what is the best c++ library or approach if I have > a c++ process in which I want it to write to kafka? > > > Thanks in advanced, > Dor > > This email and

Re: Client doesn't reconnect to the kafka-server after failover

2019-01-29 Thread Harper Henn
Hi Daniele, Is it possible that the IP addresses of your brokers change after you start your server instances again, and the producers can't connect because the new IPs are not in their configuration? That could also be an explanation for why the new broker is in the ISR list - I think the brokers

Re: Hopping Window

2019-01-29 Thread Rene Richard
I think I figured out my problem!!! 19/01/29 12:40:01 INFO HBProcessor: - 19/01/29 12:40:01 INFO HBProcessor: Heart Rate -> K : [1], V : [{"userId":"1","beatCount":60,"addTime":154878652}] 19/01/29 12:40:01 INFO HBProcessor: -

Issues with KTable to KTable leftJoin

2019-01-29 Thread Murilo Tavares
Hi I am trying to understand why a KTable to KTable left join is being called twice when I receive a message on the right table. Here is my Topology: Serde authorSerde = ... Serde> bSetSerde = ... Serde> apSetSerde = ... KTable authorTable = builder.table(AUTHOR_TOPIC, Consumed.with(Serdes.String(

Re: Issues with KTable to KTable leftJoin

2019-01-29 Thread Murilo Tavares
Adding a bit more to this, it looks like an issue with cascading leftJoins... I can see that internally, the ValueJoiner is being called by a KTableKTableRightJoin$KTableKTableRightJoinProcessor, with sendOldValues = true. Not quite sure, but it looks to me that when we create "tmp = A.leftJoin(B)"

RE: c++ kafka

2019-01-29 Thread Dor Ben Dov
Thanks Emmett, Does this c++ lib is the only one or does this the most common uses one with Kafka / recommended one? Regards, Dor -Original Message- From: Emmett Butler Sent: Tuesday, January 29, 2019 5:21 PM To: users@kafka.apache.org Subject: Re: c++ kafka Check out librdkafka https