Re: Need broker side property which can restrict a fetch.size

2018-01-12 Thread Shivam Sharma
Thanks Srinath, We will try to do quota management. On Wed, Jan 10, 2018 at 1:18 PM, Srinath C wrote: > Hi Shivam, > > You can configure quotas per user/client. > > [1] https://kafka.apache.org/documentation/#design_quotas > > Regards, > Srinath > > On Jan 9, 2018 5:19 PM, "Shivam Sharma" <28shi

Re: Kafka per topic retention.bytes and global log.retention.bytes not working

2018-01-12 Thread Wim Van Leuven
awesome! On Thu, 11 Jan 2018 at 23:48 Thunder Stumpges wrote: > Thanks, yes we upgraded to 1.0.0 and that has indeed fixed the issue. > Thanks for the pointer! > -Thunder > > > On Tue, Jan 9, 2018 at 9:50 PM Wim Van Leuven < > wim.vanleu...@highestpoint.biz> wrote: > > > Upgrade? > > > > On Wed,

log retention and rolling behaviors

2018-01-12 Thread Jay Guo
Dear Kafka gurus, I'm trying to confirm following behaviors in Kafka 0.10.x: - `log.roll.x` and `log.segment.bytes` are checked only when new message comes in. In another word, there's no scheduled job to roll out new segment files - `log.retention.time` is checked by scheduled job, and when in-u

Kafka on kubernetes

2018-01-12 Thread Devendar Rao
Hi, Any one has done work on kafka on kubernetes? Could you share the references/links if you have any? Thanks, Devendar

Re: Kafka on kubernetes

2018-01-12 Thread Paolo Patierno
Hi Devendar, there is the Strimzi project (http://strimzi.io) which is focused on providing a full solution for running Apache Kafka both on Kubernetes and OpenShift. The current first release (0.1.0) provides the Docker images and YAML files (with "templates" for OpenShift as well) for deployi

[ANNOUNCE] New committer: Matthias J. Sax

2018-01-12 Thread Guozhang Wang
Hello everyone, The PMC of Apache Kafka is pleased to announce Matthias J. Sax as our newest Kafka committer. Matthias has made tremendous contributions to Kafka Streams API since early 2016. His footprint has been all over the places in Streams: in the past two years he has been the main driver

Re: [ANNOUNCE] New committer: Matthias J. Sax

2018-01-12 Thread Ted Yu
Congratulations, Matthias. On Fri, Jan 12, 2018 at 2:59 PM, Guozhang Wang wrote: > Hello everyone, > > The PMC of Apache Kafka is pleased to announce Matthias J. Sax as our > newest Kafka committer. > > Matthias has made tremendous contributions to Kafka Streams API since early > 2016. His footp

Re: [ANNOUNCE] New committer: Matthias J. Sax

2018-01-12 Thread Vahid S Hashemian
Congrats Matthias! Well deserved. --Vahid From: Ted Yu To: d...@kafka.apache.org Cc: users@kafka.apache.org Date: 01/12/2018 03:00 PM Subject:Re: [ANNOUNCE] New committer: Matthias J. Sax Congratulations, Matthias. On Fri, Jan 12, 2018 at 2:59 PM, Guozhang Wang wrote:

Re: [ANNOUNCE] New committer: Matthias J. Sax

2018-01-12 Thread Bill Bejeck
Congratulations Matthias! Very well deserved On Fri, Jan 12, 2018 at 6:11 PM Vahid S Hashemian wrote: > Congrats Matthias! Well deserved. > > --Vahid > > > > From: Ted Yu > To: d...@kafka.apache.org > Cc: users@kafka.apache.org > Date: 01/12/2018 03:00 PM > Subject:Re: [ANNO

Re: [ANNOUNCE] New committer: Matthias J. Sax

2018-01-12 Thread James Cheng
Congrats, Matthias!! Well deserved! -James > On Jan 12, 2018, at 2:59 PM, Guozhang Wang wrote: > > Hello everyone, > > The PMC of Apache Kafka is pleased to announce Matthias J. Sax as our > newest Kafka committer. > > Matthias has made tremendous contributions to Kafka Streams API since earl

Re: [ANNOUNCE] New committer: Matthias J. Sax

2018-01-12 Thread Ismael Juma
Congratulations Matthias! On 12 Jan 2018 10:59 pm, "Guozhang Wang" wrote: > Hello everyone, > > The PMC of Apache Kafka is pleased to announce Matthias J. Sax as our > newest Kafka committer. > > Matthias has made tremendous contributions to Kafka Streams API since early > 2016. His footprint ha

Re: [ANNOUNCE] New committer: Matthias J. Sax

2018-01-12 Thread Damian Guy
Can't think of anyone me deserving! Congratulations Matthias! On Sat, 13 Jan 2018 at 00:17, Ismael Juma wrote: > Congratulations Matthias! > > On 12 Jan 2018 10:59 pm, "Guozhang Wang" wrote: > > > Hello everyone, > > > > The PMC of Apache Kafka is pleased to announce Matthias J. Sax as our > > n

Re: [ANNOUNCE] New committer: Matthias J. Sax

2018-01-12 Thread Martin Gainty
Willkommen Matthias! Martin- From: Damian Guy Sent: Friday, January 12, 2018 7:43 PM To: users@kafka.apache.org Cc: dev Subject: Re: [ANNOUNCE] New committer: Matthias J. Sax Can't think of anyone me deserving! Congratulations Matthias! On Sat, 13 Jan 2018 at 00:1

Re: [ANNOUNCE] New committer: Matthias J. Sax

2018-01-12 Thread Manikumar
Congrats. well deserved. On Sat, Jan 13, 2018 at 8:37 AM, Martin Gainty wrote: > Willkommen Matthias! > Martin- > > From: Damian Guy > Sent: Friday, January 12, 2018 7:43 PM > To: users@kafka.apache.org > Cc: dev > Subject: Re: [ANNOUNCE] New committer: Matthia

Re: [ANNOUNCE] New committer: Matthias J. Sax

2018-01-12 Thread Neha Narkhede
Congratulations Matthias. Very well deserved! On Fri, Jan 12, 2018 at 7:11 PM Manikumar wrote: > Congrats. well deserved. > > On Sat, Jan 13, 2018 at 8:37 AM, Martin Gainty > wrote: > > > Willkommen Matthias! > > Martin- > > > > From: Damian Guy > > Sent: Frida

Re: Kafka on kubernetes

2018-01-12 Thread Devendar Rao
Thanks Paolo for the info. On Fri, Jan 12, 2018 at 1:30 PM, Paolo Patierno wrote: > Hi Devendar, > > there is the Strimzi project (http://strimzi.io) which is focused on > providing a full solution for running Apache Kafka both on Kubernetes and > OpenShift. The current first release (0.1.0) pro

Re: [ANNOUNCE] New committer: Matthias J. Sax

2018-01-12 Thread Paolo Patierno
Congratulations Matthias ! Very well deserved ! From: Guozhang Wang Sent: Friday, January 12, 2018 11:59:21 PM To: d...@kafka.apache.org; users@kafka.apache.org Subject: [ANNOUNCE] New committer: Matthias J. Sax Hello everyone, The PMC of Apache Kafka is pleased