Re: [ANNOUNCE] New committer: Onur Karaman

Congrats Onur, Can you also share the document where all known problems are listed; I am assuming these bugs are still valid for the current stable release. Affan - Affan On Mon, Nov 6, 2017 at 10:24 PM, Jun Rao wrote: > Hi, everyone, > > The PMC of Apache Kafka is pleased to announce a new K

Re: Reg. Kafka transactional producer and consumer

Hi Matthis J. Sax, Thank you for your suggestions. I tried the same in kafka 1.0.0 version also. Same issue is coming. I am attaching log segment below please let me know what might be the problem. Regards, Abhishek Verma Dumping .index offset: 0 position: 0 Dumping 0

Re: [ANNOUNCE] New committer: Onur Karaman

Thanks everyone! On Mon, Nov 6, 2017 at 3:31 PM, Becket Qin wrote: > Congrats, Onur! > > On Mon, Nov 6, 2017 at 2:45 PM, James Cheng wrote: > > > Congrats Onur! Well deserved! > > > > -James > > > > > On Nov 6, 2017, at 9:24 AM, Jun Rao wrote: > > > > > > Hi, everyone, > > > > > > The PMC of A

Re: Cannot list topics

I've done it on 0.9, 0.10, 0.11, and 1.0 in the last several days and got expected results. You'll have to share more information. Can you post the command lines you used to start zookeeper, to start kafka, to create the topics, and to list the topics? Dale -Original Message- From:

Cannot list topics

I’m just following Quickstart document from http://kafka.apache.org/ . As instantiated, Tried to list topic that I made but nothing show up. I might be doing something wrong, but it seems to need fix. Thanx :)

Re: [ANNOUNCE] New committer: Onur Karaman

Congrats, Onur! On Mon, Nov 6, 2017 at 2:45 PM, James Cheng wrote: > Congrats Onur! Well deserved! > > -James > > > On Nov 6, 2017, at 9:24 AM, Jun Rao wrote: > > > > Hi, everyone, > > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur > > Karaman. > > > > Onur's most

RE: [EXTERNAL]Re: 0.9.0.0 Log4j appender slow startup

I have found a solution to the problem. To give credit, the fix came from this: https://stackoverflow.com/questions/35628706/kafka-log4j-appender-0-9-does-not-work. I don't think his problem was exactly like mine, maybe it was, but following his solution fixed my issue. The problem appears t

Kafka handle errors when consuming messages

Hi, I have a question about handling errors once a message has been consumed. I have a system where, the consumer consumes messages and tries to write the data to a database. These writes should happen serially. There are scenarios where there could be errors doing the downstream write, which unf

Re: [ANNOUNCE] New committer: Onur Karaman

Congrats Onur! Well deserved! -James > On Nov 6, 2017, at 9:24 AM, Jun Rao wrote: > > Hi, everyone, > > The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur > Karaman. > > Onur's most significant work is the improvement of Kafka controller, which > is the brain of a Kafka

Re: [ANNOUNCE] New committer: Onur Karaman

Congratulations, Onur! On Mon, Nov 6, 2017 at 8:10 PM, Dong Lin wrote: > Congratulations Onur! > > On Mon, Nov 6, 2017 at 9:24 AM, Jun Rao wrote: > > > Hi, everyone, > > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur > > Karaman. > > > > Onur's most significant wo

Re: Kafka Streaming Query

You can add more instances of your application, to allow processing the incoming data in parallel. On 6 November 2017 at 20:11, Ranjit Kumar wrote: > Hi, > > I am using kafka streaming and state store in my application using java but > my application logic is taking more time (around 5 ms) to pi

Re: [ANNOUNCE] New committer: Onur Karaman

Congratulations Onur! On Mon, Nov 6, 2017 at 9:24 AM, Jun Rao wrote: > Hi, everyone, > > The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur > Karaman. > > Onur's most significant work is the improvement of Kafka controller, which > is the brain of a Kafka cluster. Over tim

Re: [ANNOUNCE] New committer: Onur Karaman

Congratulations Onur! On Mon, Nov 6, 2017 at 11:15 AM, Edoardo Comar wrote: > Congratulations Onur ! > > -- > > Edoardo Comar > > IBM Message Hub > > IBM UK Ltd, Hursley Park, SO21 2JN > > > > From: Jun Rao > To: "d...@kafka.apache.org" , >

Re: [ANNOUNCE] New committer: Onur Karaman

Congratulations Onur ! -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Jun Rao To: "d...@kafka.apache.org" , "users@kafka.apache.org" Date: 06/11/2017 17:24 Subject:[ANNOUNCE] New committer: Onur Kar

Re: [ANNOUNCE] New committer: Onur Karaman

Congratulations Onur ! On Mon, Nov 6, 2017 at 7:01 PM, Matthias J. Sax wrote: > Congrats!!! > > > On 11/6/17 7:56 PM, Vahid S Hashemian wrote: >> Congrats Onur! >> >> --Vahid >> >> >> >> From: Ismael Juma >> To: d...@kafka.apache.org >> Cc: "users@kafka.apache.org" >> Date: 11/06/20

Re: [ANNOUNCE] New committer: Onur Karaman

Congrats!!! On 11/6/17 7:56 PM, Vahid S Hashemian wrote: > Congrats Onur! > > --Vahid > > > > From: Ismael Juma > To: d...@kafka.apache.org > Cc: "users@kafka.apache.org" > Date: 11/06/2017 10:13 AM > Subject:Re: [ANNOUNCE] New committer: Onur Karaman > Sent by:i

Re: [ANNOUNCE] New committer: Onur Karaman

Congrats Onur! --Vahid From: Ismael Juma To: d...@kafka.apache.org Cc: "users@kafka.apache.org" Date: 11/06/2017 10:13 AM Subject:Re: [ANNOUNCE] New committer: Onur Karaman Sent by:isma...@gmail.com Congratulations Onur! Ismael On Mon, Nov 6, 2017 at 5:24 PM,

Kafka Streaming Query

Hi, I am using kafka streaming and state store in my application using java but my application logic is taking more time (around 5 ms) to pick up the next packet from que, do to that data is pipe lining in topic que(mean waiting time is increasing to pick the next packet from que). Can you please

Re: [ANNOUNCE] New committer: Onur Karaman

Congratulations Onur! Ismael On Mon, Nov 6, 2017 at 5:24 PM, Jun Rao wrote: > Hi, everyone, > > The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur > Karaman. > > Onur's most significant work is the improvement of Kafka controller, which > is the brain of a Kafka cluster.

Re: [ANNOUNCE] New committer: Onur Karaman

Congrats Onur! On Mon, Nov 6, 2017 at 9:24 AM, Jun Rao wrote: > Hi, everyone, > > The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur > Karaman. > > Onur's most significant work is the improvement of Kafka controller, which > is the brain of a Kafka cluster. Over time, we h

[ANNOUNCE] New committer: Onur Karaman

Hi, everyone, The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur Karaman. Onur's most significant work is the improvement of Kafka controller, which is the brain of a Kafka cluster. Over time, we have accumulated quite a few correctness and performance issues in the control

kafka producer : number of record pushed to topic limited

Hello, Would you please help me, I m trying to create producer that pushs a large number of json records to topic. Topic creation : kafka-topics --create --zookeeper 127.0.0.1:2181 --replication-factor 1 --partitions 100 --topic testkpa Topic producer : props.put(ProducerConfig

RE: [EXTERNAL]Re: 0.9.0.0 Log4j appender slow startup

Thanks, Jaikiran. I will do that today or tonight. Dale -Original Message- From: Jaikiran Pai [mailto:jai.forums2...@gmail.com] Sent: Monday, November 6, 2017 10:43 AM To: users@kafka.apache.org Subject: [EXTERNAL]Re: 0.9.0.0 Log4j appender slow startup Can you take a couple of thread

Re: 0.9.0.0 Log4j appender slow startup

Can you take a couple of thread dumps with an interval of around 5 seconds each when that 60 second delay occurs? You can use a tool like jstack to do that. That might give some hint on what’s going on. -Jaikiran On Monday, November 6, 2017, Preston, Dale wrote: > (Answering now from my work em

Re: Subsccribe

It's self-service: https://kafka.apache.org/contact -Matthias On 11/5/17 6:01 PM, Amit Malhotra wrote: > > signature.asc Description: OpenPGP digital signature

RE: [EXTERNAL]Re: 0.9.0.0 Log4j appender slow startup

(Answering now from my work email so please don't be confused.) The topic is already existing. -Original Message- From: Jaikiran Pai [mailto:jai.forums2...@gmail.com] Sent: Sunday, November 5, 2017 10:56 PM To: users@kafka.apache.org Subject: [EXTERNAL]Re: 0.9.0.0 Log4j appender slow sta

Re: How to Downgrade Kafka from 0.11.0.1 to 0.10.0.1

That trace is buried in request handling code. Are you sure you don’t have a consumer or producer running somewhere with a newer version of Kafka? If you get the startup succeeded message and then get that error later, I would iftop the box and male sure there isn’t anything surprising trying to t

Re: No. of Kafk Instances in Single machine

Hi Jan, Can you also please share your views on JVM heap configuration ? Regards Bhanu On Mon, Nov 6, 2017 at 5:41 PM, Jan Filipiak wrote: > Hi, > > I probably would recommend you to go for 1 instance. You can bump a few > thread configs to match your hardware better. > > Best Jan > > > On 06.11

Re: No. of Kafk Instances in Single machine

Hi, I probably would recommend you to go for 1 instance. You can bump a few thread configs to match your hardware better. Best Jan On 06.11.2017 12:23, chidigam . wrote: Hi All, Let say, I have big machine, which having 120GB RAM, with lot of cores, and very high disk capacity. How many no

Re: No. of Kafk Instances in Single machine

I would say the key thing is that the each Kafka server write to a separate set of 1..n disks and plan accordingly. --John On Mon, Nov 6, 2017 at 6:23 AM, chidigam . wrote: > Hi All, > Let say, I have big machine, which having 120GB RAM, with lot of cores, > and very high disk capacity. > > Ho

Mirroring avro topics with copying schemas between registries

Hi, I would like to mirror a topic with avro messages from a production to staging cluster, each cluster having its own schema registry. I would like messages being copied to use schemas from target cluster registry and those schemas copied from source registry if needed. I guess I could do it wit

No. of Mirroring instances

Hi All, How can I calculate the no. of Mirroring instance required to run, to keep both the cluster nearly in sync ? For example, Cluster1 have 3 node, and Cluster 2 have 3 nodes. Do I have to run 3 mirror instance ? Regards Bhanu

No. of Kafk Instances in Single machine

Hi All, Let say, I have big machine, which having 120GB RAM, with lot of cores, and very high disk capacity. How many no. of kafka instances are recommended? Is there any general principle I can apply, to calculate optimal no. Any help in this regards is highly appreciated. Regards Bhanu

Re: How to Downgrade Kafka from 0.11.0.1 to 0.10.0.1

Hi Matt, We are getting below exception while updating with old Kafka build(0.10.0.1) kafka.network.InvalidRequestException: Error getting request for apiKey: 6 and apiVersion: 3 at kafka.network.RequestChannel$Request.liftedTree2$1(RequestChannel.scala:95) at kafka.network.RequestChannel$Request