Re: [ANNOUNCE] New committer: Rajini Sivaram

Congrats!. Well deserved. On Tue, Apr 25, 2017 at 5:54 AM, Matthias J. Sax wrote: > Congrats! > > On 4/24/17 4:59 PM, Apurva Mehta wrote: > > Congratulations Rajini! > > > > On Mon, Apr 24, 2017 at 2:06 PM, Gwen Shapira wrote: > > > >> The PMC for Apache Kafka has invited Rajini Sivaram as a c

Re: Recording - Storm & Kafka Meetup on April 20th 2017

Hi, In the comments section of the Meetup page you can find links for all the slides. https://www.meetup.com/Apache-Storm-Apache-Kafka/events/238975416/ Thank you for your interest. Hugo On Apr 24, 2017, at 10:19 AM, Aditya Desai mailto:adity...@usc.edu>> wrote: Hi Harsha and others Really

Re: [ANNOUNCE] New committer: Rajini Sivaram

Congrats! On 4/24/17 4:59 PM, Apurva Mehta wrote: > Congratulations Rajini! > > On Mon, Apr 24, 2017 at 2:06 PM, Gwen Shapira wrote: > >> The PMC for Apache Kafka has invited Rajini Sivaram as a committer and we >> are pleased to announce that she has accepted! >> >> Rajini contributed 83 patch

Re: [ANNOUNCE] New committer: Rajini Sivaram

Congratulations Rajini! On Mon, Apr 24, 2017 at 2:06 PM, Gwen Shapira wrote: > The PMC for Apache Kafka has invited Rajini Sivaram as a committer and we > are pleased to announce that she has accepted! > > Rajini contributed 83 patches, 8 KIPs (all security and quota > improvements) and a signif

Re: [ANNOUNCE] New committer: Rajini Sivaram

Congratulations! Rajini! Great work! On Mon, Apr 24, 2017 at 3:33 PM, Jason Gustafson wrote: > Woohoo! Great work, Rajini! > > On Mon, Apr 24, 2017 at 3:27 PM, Jun Rao wrote: > > > Congratulations, Rajini ! Thanks for all your contributions. > > > > Jun > > > > On Mon, Apr 24, 2017 at 2:06 PM,

Re: [ANNOUNCE] New committer: Rajini Sivaram

Woohoo! Great work, Rajini! On Mon, Apr 24, 2017 at 3:27 PM, Jun Rao wrote: > Congratulations, Rajini ! Thanks for all your contributions. > > Jun > > On Mon, Apr 24, 2017 at 2:06 PM, Gwen Shapira wrote: > > > The PMC for Apache Kafka has invited Rajini Sivaram as a committer and we > > are ple

Re: [ANNOUNCE] New committer: Rajini Sivaram

Congratulations, Rajini ! Thanks for all your contributions. Jun On Mon, Apr 24, 2017 at 2:06 PM, Gwen Shapira wrote: > The PMC for Apache Kafka has invited Rajini Sivaram as a committer and we > are pleased to announce that she has accepted! > > Rajini contributed 83 patches, 8 KIPs (all secur

Re: [ANNOUNCE] New committer: Rajini Sivaram

Congratulations, Rajini! On Mon, Apr 24, 2017 at 11:50 PM, Ismael Juma wrote: > Congrats Rajini! Well-deserved. :) > > Ismael > > On Mon, Apr 24, 2017 at 10:06 PM, Gwen Shapira wrote: > > > The PMC for Apache Kafka has invited Rajini Sivaram as a committer and we > > are pleased to announce tha

Re: [ANNOUNCE] New committer: Rajini Sivaram

Congrats Rajini! Well-deserved. :) Ismael On Mon, Apr 24, 2017 at 10:06 PM, Gwen Shapira wrote: > The PMC for Apache Kafka has invited Rajini Sivaram as a committer and we > are pleased to announce that she has accepted! > > Rajini contributed 83 patches, 8 KIPs (all security and quota > improv

Re: [ANNOUNCE] New committer: Rajini Sivaram

Congrats Rajini! On Mon, Apr 24, 2017 at 2:21 PM, Onur Karaman wrote: > Congrats! > > On Mon, Apr 24, 2017 at 2:20 PM, Guozhang Wang wrote: > > > Congrats Rajini! > > > > Guozhang > > > > On Mon, Apr 24, 2017 at 2:08 PM, Vahid S Hashemian < > > vahidhashem...@us.ibm.com> wrote: > > > > > Great

Re: [ANNOUNCE] New committer: Rajini Sivaram

Congrats! On Mon, Apr 24, 2017 at 2:20 PM, Guozhang Wang wrote: > Congrats Rajini! > > Guozhang > > On Mon, Apr 24, 2017 at 2:08 PM, Vahid S Hashemian < > vahidhashem...@us.ibm.com> wrote: > > > Great news. > > > > Congrats Rajini! > > > > --Vahid > > > > > > > > > > From: Gwen Shapira > > To

Re: [ANNOUNCE] New committer: Rajini Sivaram

Congrats Rajini! Guozhang On Mon, Apr 24, 2017 at 2:08 PM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > Great news. > > Congrats Rajini! > > --Vahid > > > > > From: Gwen Shapira > To: d...@kafka.apache.org, Users , > priv...@kafka.apache.org > Date: 04/24/2017 02:06 PM > Subj

Re: [ANNOUNCE] New committer: Rajini Sivaram

Congrats Rajini! On Mon, Apr 24, 2017 at 2:06 PM, Gwen Shapira wrote: > The PMC for Apache Kafka has invited Rajini Sivaram as a committer and we > are pleased to announce that she has accepted! > > Rajini contributed 83 patches, 8 KIPs (all security and quota > improvements) and a significant n

Re: [ANNOUNCE] New committer: Rajini Sivaram

Great news. Congrats Rajini! --Vahid From: Gwen Shapira To: d...@kafka.apache.org, Users , priv...@kafka.apache.org Date: 04/24/2017 02:06 PM Subject:[ANNOUNCE] New committer: Rajini Sivaram The PMC for Apache Kafka has invited Rajini Sivaram as a committer and we are ple

[ANNOUNCE] New committer: Rajini Sivaram

The PMC for Apache Kafka has invited Rajini Sivaram as a committer and we are pleased to announce that she has accepted! Rajini contributed 83 patches, 8 KIPs (all security and quota improvements) and a significant number of reviews. She is also on the conference committee for Kafka Summit, where

Re: Recording - Storm & Kafka Meetup on April 20th 2017

Hi Harsha and others Really thanks a lot for this meetup. I have signed up and will surely attend it from June. I am really new to Apache Storm and Apache Kafka. I am still learning them and these meetups will definitely help people like me. If you have any of you have some good resources/tutorial

Re: Consumer with another group.id conflicts with streams()

Hi, hard to diagnose. The new consumer should not affect the Streams app though -- even if I am wondering why you need it. > KafkaConsumer (with a UUID as group.id) that reads some historical data from > input topic Maybe using GlobalKTable instead might be a better solution? > (i.e. I feed 10

Re: Unable to consume from remote

Can you read/write your topics using > bin/kafka-console-[consumer|producer].sh If no, it's a general configuration problem. If yes, the problem is in your code. I did not open the link for security concerns... Hope you understand that. If you want to share code, pleas c&p __relevant__ parts int

Consumer with another group.id conflicts with streams()

Hi, I have a simple streaming app that copies data from one topic to another, so when I feed 1000 records into source topic I receive 1000 records in the target topic. Also the app contains a transform() step which does nothing, except instantiating a KafkaConsumer (with a UUID as group.id) that

Re: How does replication affect kafka quota?

Replication will not effect the users quota as it is done under a different replication quota (which you can control separately). The user should still see a 50 MBps maximum rate enforced into each broker. -hans > On Apr 23, 2017, at 11:39 PM, Archie wrote: > > So by specifying a kafka quo

Re: Recording - Storm & Kafka Meetup on April 20th 2017

Hi Aditya, Thanks for your interest. We entatively planning one in June 1st week. If you haven't already please register here https://www.meetup.com/Apache-Storm-Apache-Kafka/ . I'll keep the Storm lists updated once we finalize the date & location. Thanks, Harsha On Mon, Apr 24, 201

Re: Stream applications dying on broker ISR change

Hi Sachin, In KIP-62 a background heartbeat thread was introduced to deal with the group protocol arrivals and departures. There is a setting called session.timeout.ms that specifies the timeout of that background thread. So if the thread has died that background thread will also die and the ri

handling failed offsets

We are using kafka for auditing services. We have a scenario where in there is bulk data and one in a list can fail. What we require is, we want to keep a queue of failed offsets and retry only the failed offsets. We tried to revert to the previous offset in case of failure, but that has either

Re: Stream applications dying on broker ISR change

I had a question about this setting ConsumerConfig.MAX_POLL_INTERVAL_MS_CONFIG, Integer.toString(Integer.MAX_ VALUE) How would the broker know if a thread has died or say we simply stopped an instance and needs to be booted out of the group. Thanks Sachin On Mon, Apr 24, 2017 at 5:55 PM, Eno Th

Re: Stream applications dying on broker ISR change

Awesome! Thank you Eno, I had a look over the release notes awhile back and was slightly hoping that would be the answer. Any idea how long it takes for a kafka-connect update to occur after a new kafka-client is released/passed voting? On 24 April 2017 at 13:25, Eno Thereska wrote: > Hi Ian, >

Unable to consume from remote

Hi Guys, I created the setup of Kafka ( kafka_2.12-0.10.2.0.tgz ) as per this document https://kafka.apache.org/quickstart. The setup works when both producer & consumer are in localhost. The moment I deploy con

message encryption on broker side

Hi, I want to know is there any solutions or patches can fix this issue?

the problems of parititons assigned to consumers

Hi, all. There are two problems when we use kafka about partitions assigned to consumers. Problem 1: Partitions will be reassigned to consumers when consumer online or offline, then the messages latency become higher. Problem 2: If we have two partitions, only two consumers can consume messages。H

Re: Stream applications dying on broker ISR change

Hi Ian, This is now fixed in 0.10.2.1. The default configuration need tweaking. If you can't pick that up (it's currently being voted), make sure you have these two parameters set as follows in your streams config: final Properties props = new Properties(); ... props.put(ProducerConfig.RETRIES

Yet another CLI to manage Kafka Connect/SchemaRegistry.

Hi folks, I would like to share with you a CLI that I have developed for a project needs - https://github.com/fhussonnois/kafkacli We use it to executes common tasks on Kafka Connect and the SchemeRegistry during the developments. -- Florian HUSSONNOIS

Stream applications dying on broker ISR change

Hi All, We're running multiple Kafka Stream applications using Kafka client 0.10.2.0 against a 6 node broker cluster running 0.10.1.1 Additionally, we're running Kafka Connect 0.10.2.0 with the ElasticSearch connector by confluent [1] On an ISR change occurring on the brokers, all of the streams

Re: Recording - Storm & Kafka Meetup on April 20th 2017

How about publishing this to Storm site? - Xin 2017-04-22 19:27 GMT+08:00 steve tueno : > great > > Thanks > > > > Cordialement, > > TUENO FOTSO Steve Jeffrey > Ingénieur de conception > Génie Informatique > +237 676 57 17 28 <+237%206%2076%2057%2017%2028> > +237 697 86 36 38 <+237%206%2097%208