RE: Re: MirrorMaker 2 Reload Configuration

2022-01-13 Thread Praveen Sinha
Hi Peter, I am running into a similar issue, did you create a JIRA ticket for this? Or is there any workaround you have found for the same? Thanks and regards, Praveen On 2020/11/13 14:45:23 Péter Sinóros-Szabó wrote: > Hi, > > I tried as well to stop all instances of MM2, but it di

Re: Client session timed out

2020-10-28 Thread Praveen Kumar K S
Hello All, Please provide some inputs and help to resolve this issue. I have cross verified and it is not a DNS issue. Not sure why we are facing this issue. Should I report a bug for this ? Please let me know. Regards, Praveen Kumar K S On Tue, Oct 27, 2020 at 8:41 PM Sabina Marx wrote

Re: Client session timed out

2020-10-23 Thread Praveen Kumar K S
Hello, Can someone please help me to understand what is the issue ? Regards, Praveen Kumar K S +91-9986855625 On Thu, Oct 22, 2020 at 6:52 AM Praveen Kumar K S wrote: > Hello Experts, > > Any help to debug and resolve this issue is highly appreciated. > > Regards, > Prav

Re: Client session timed out

2020-10-21 Thread Praveen Kumar K S
Hello Experts, Any help to debug and resolve this issue is highly appreciated. Regards, Praveen On Wed, 21 Oct, 2020, 11:26 Sabina Marx, wrote: > Hi Praveen, > > it seems to be the same problem, your log looks quite similar to mine. But > I have no solution until now. > >

Re: Client session timed out

2020-10-20 Thread Praveen Kumar K S
* *docker stack deploy -c cluster-kafka.yml one* Now, all the services are healthy. I'm not sure why kafka deployment is failing only during update. There is no change in the configuration in either zookeeper or kafka. Please help me resolve this issue and let me know if you need any additional de

Kafka Zookeeper Compatibility Matrix

2020-09-06 Thread Praveen Kumar K S
Hello, May I know if kafka 2.5.1 is compatible with zk 3.5.8 ? Please help where can I find the compatibility matrix. Thanks! Regards, Praveen Kumar K S

Re: Kafka upgrade from 0.10 to 2.3.x

2020-05-18 Thread Praveen
o have had the documentation say downtime upgrade is ok. maybe its widely understood that downtime upgrade is ok? But it was a bit confusing when it was mentioned on some upgrade versions but not others. Praveen On Wed, May 13, 2020 at 8:51 AM Israel Ekpo wrote: > It would be a good idea to

Kafka upgrade from 0.10 to 2.3.x

2020-05-11 Thread Praveen
Hi folks, I'd like to take downtime to upgrade to 2.3.x from 10.2.1. But I can't find it in the doc for 2.3.x upgrade that I can take downtime to do this. The instructions are for rolling upgrade only. Has anyone tried this? Praveen

Re: Flink vs Kafka streams

2019-11-11 Thread Praveen
10M notifications per day. Just to give you an example of a non-deterministic traffic pattern. - Praveen On Fri, Nov 8, 2019 at 10:43 PM Navneeth Krishnan wrote: > Thanks Peter, even with ECS we have autoscaling enabled but the issue is > during autoscaling we need to stop the job and star

Low level kafka consumer API to KafkaStreams App.

2018-09-13 Thread Praveen
e end up wanting to send out millions of messages per second, is increasing the partitions the only way? Best, Praveen

Ksql

2018-07-09 Thread Praveen Joshi
Has anybody used ksql? What are limitations of this and what it’s best for. Would appreciate if you can share some information on this. Best Regards, Praveen Joshi Sent from my iPhone

Kafka Consumer Committing Offset Even After Re-Assignment

2017-12-07 Thread Praveen
s the partition, it is still able to commit the offset t4 - Box 2, Consumer 1 - Commits offsets as well, overwriting offset committed by Box 1, Consumer 1. Is this expected? Should I be using the ConsumerRebalanceListener to prevent commits to partitions not owned by the consumer? - Praveen

Re: Writing streams to kafka topic

2017-09-02 Thread Praveen
Thanks. I was able to quickly build a simple example out of this. Also saw the issue with punctuate and your “tick” feed recommendation for now. - Praveen On Fri, Sep 1, 2017 at 9:48 AM, Matthias J. Sax wrote: > Hi, > > this is not supported by the DSL layer. What you would need to

Writing streams to kafka topic

2017-08-31 Thread Praveen
r-guide.html#writing-streams-back-to-kafka> says that streams may only be written "continuously" to the kafka topic. Is that the case? - Praveen

Fat partition - Kafka Spark streaming

2017-06-14 Thread GURU PRAVEEN
Hi, We have a Kafka spark streaming integrated app that listens to twitter and pushes the tweets to Kafka and which is later consumed by spark app. We are constantly seeing one of the Kafka partitions always having more data than the other partitions. Not able to zero in on the root cause. We

Re: Where is offset recorded?

2017-02-20 Thread Praveen
Kafka used to use zookeeper for managing offsets. But I believe it has since changed to storing offset in a separate topic called __consumer_offsets. This info is there in the documentation. See here: https://kafka.apache.org/090/documentation.html#impl_offsettracking On Mon, Feb 20, 2017 at 5:02

Re: How does one deploy to consumers without causing re-balancing for real time use case?

2017-02-17 Thread Praveen
h of these coupled together is why the cluster restart takes > 1hr. I'm curious how linkedin does clean cluster restarts? How do you handle the scenario described above? Praveen On Wed, Feb 15, 2017 at 10:22 AM, Praveen wrote: > I still think a clean cluster start should not take

Re: How does one deploy to consumers without causing re-balancing for real time use case?

2017-02-15 Thread Praveen
I still think a clean cluster start should not take > 1 hr for balancing though. Is this expected or am i doing something different? I thought this would be a common use case. Praveen On Fri, Feb 10, 2017 at 10:26 AM, Onur Karaman < okara...@linkedin.com.invalid> wrote: > Prad

Re: How does one deploy to consumers without causing re-balancing for real time use case?

2017-02-10 Thread Praveen
t 4:28 AM, Krzysztof Lesniewski, Nexiot AG < > krzysztof.lesniew...@nexiot.ch> wrote: > > > Would be great to get some input on it. > > > > - Krzysztof Lesniewski > > > > > > On 06.02.2017 08:27, Praveen wrote: > > > >> I have a 16 broke

How does one deploy to consumers without causing re-balancing for real time use case?

2017-02-05 Thread Praveen
alancing (or triggering one that doesn't affect your SLA) when doing real time processing? Thanks, Praveen

Re: Is it a bad idea to use periods within a consumer group name? "my-service.topic1_consumer_group"

2016-12-13 Thread Praveen
Not that I know of. We at Flurry have been using periods in our group names for a while now and haven't encountered any issues b/c of that. On Tue, Dec 13, 2016 at 5:13 PM, Jeff Widman wrote: > I vaguely remember reading somewhere that it's a bad idea to use periods > within Kafka consumer gro

KafkaProducer 0.9.0.1 Client - Async `send` stops sending

2016-10-13 Thread Praveen
lso attached my thread dump and producer configs. Thanks, Praveen

Re: How to move a broker out of rotation?

2016-09-29 Thread Praveen
Nice. That has some nice set of functionality. Thanks. I'll take a look. Praveen On Thu, Sep 29, 2016 at 4:07 PM, Todd Palino wrote: > There’s not a good answer for this with just the Kafka tools. We opened > sourced the tool that we use for removing brokers and rebalancing > p

How to move a broker out of rotation?

2016-09-29 Thread Praveen
I have 16 brokers. Now one of the brokers (B-16) got completely messed up and is sent for repair. But I can still see some partitions including the B-16 in its replicas, thereby becoming under-replicated. Is there a proper way to take broker out of rotation? Praveen

Kafka 0.9.1 - Uneven Partition to Consumer assignment

2016-09-26 Thread Praveen
hange with RoundRobinAssigner since I only have 1 topic. (Feel free to correct me if I am wrong about the round robin assigner) How can I ensure that partitions to consumer assignment is always uniform? Would appreciate if you have any insights. Thanks, Praveen

Communication between Kafka clients & Kafka

2016-01-22 Thread praveen S
Do Kafka clients(producers & consumers) use rpc to communicate with the Kafka cluster.? Regards, Praveen