Re: colocating zookeeper on the kafka broker nodes

2017-07-26 Thread Srinath C
Hi Robert, By colocating the zookeeper servers on the same VM we could have a downtime if the VM happened to go down. Having the servers on different VMs will reduce the risk factor. For example, if the zookeeper cluster has 5 servers you can tolerate upto 2 servers going down and still have no d

RE: colocating zookeeper on the kafka broker nodes

2017-07-26 Thread Srinath C
s to have 3 VM cluster and each VM will run both zookeeper and > kafka. > > -- > Robert Friberg > Building OrigoDB at Devrex Labs > +46733839080 > > -Original Message- > From: Srinath C [mailto:srinat...@gmail.com] > Sent: den 26 juli 2017 20:39 > To: users@k

Re: Need broker side property which can restrict a fetch.size

2018-01-09 Thread Srinath C
Hi Shivam, You can configure quotas per user/client. [1] https://kafka.apache.org/documentation/#design_quotas Regards, Srinath On Jan 9, 2018 5:19 PM, "Shivam Sharma" <28shivamsha...@gmail.com> wrote: > Hi, > > We are having Kafka cluster(0.11.0.0) of 3 Machines. When we increase > *max.fetch

Re: Kafka Topic Partition Consumer Lags

2019-06-26 Thread Srinath C
Hi Garvit, Am unable to see the image you attached for some reason and am not able to see if the partitions are in the same topic or in different topics. Check if any of max.partition.fetch.bytes or fetch.max.bytes or max.poll.records configured in your consumer is causing the behaviour. Regards,

Re: Kafka Topic Partition Consumer Lags

2019-06-26 Thread Srinath C
I have not explicitly set > max.partition.fetch.bytes or fetch.max.bytes or max.poll.records so it > should take the default values. > > Let me know. > > Thanks, > > On Thu, Jun 27, 2019 at 7:11 AM Srinath C wrote: > >> Hi Garvit, >> >> Am unable to see t

Re: Kafka Offsets

2019-07-01 Thread Srinath C
Hi Senthil, Yes, I believe the only guarantee is that the offsets will be increasing but not guaranteed to be consecutive. Regards, Srinath. On Mon, Jul 1, 2019 at 4:15 PM SenthilKumar K wrote: > Hello Experts, We are trying to understand *"How Kafka Assign Offset value > to a message?"* > >