Re: data exchange format to use with Apache Kakfa that provides schema validation

Hi Rohit, Use avro. Please refer the link . On Fri, Feb 8, 2019 at 11:14 AM Rohit Sharma wrote: > Hi, > what is the best message format to use with apachhe kafka so that > producers and consumers can define contract and validate data and > s

Re: Doubts regarding kafka-reassign-partitions.sh

I have not changed anything in producer and consumer. I am using the default Kafka config. Regards, Abhimanyu On Tue, Dec 18, 2018 at 12:38 PM Suman B N wrote: > Can you paste the producer and consumer configs as well? > > Thanks, > Suman > > On Tue, Dec 18, 2018 at 11:49 AM

Doubts regarding kafka-reassign-partitions.sh

so we're currently trying to use Kafka 2.1.0 and are pretty much in a proof-of-concept-phase. We've only just started to look into it and are trying to figure out, if it's what we need. The current setup is as follows: - 3 Kafka brokers on different hosts: kafka1,kafka2,kafka3 - 3 Zookeeper

Re: Kafka Cluster Setup

Hi Vahid, I missed one more point. - Can I have two brokers at the same time running at multiple versions just for Kafka version upgrade? Regards, Abhimanyu On Fri, Dec 7, 2018 at 1:03 PM Abhimanyu Nagrath wrote: > Thanks for clarifying all the points . Just a small doubt regarding

Re: Kafka Cluster Setup

/kafka.apache.org/documentation/). > > I hope you find the answers below helpful. > > --Vahid > > On Thu, Dec 6, 2018 at 10:19 PM Abhimanyu Nagrath < > abhimanyunagr...@gmail.com> wrote: > > > Hi, > > > > I have a use case I want to set up a Ka

Kafka Cluster Setup

Hi, I have a use case I want to set up a Kafka cluster initially at the starting I have 1 Kafka Broker(A) and 1 Zookeeper Node. So below mentioned are my queries: - On adding a new Kafka Broker(B) to the cluster. Will all data present on broker A will be distributed automatically? If not wh

Re: [ANNOUNCE] New Committer: Manikumar Reddy

Congratulations Manikumar On Tue, Oct 16, 2018 at 10:09 AM Satish Duggana wrote: > Congratulations Mani! > > > On Fri, Oct 12, 2018 at 9:41 PM Colin McCabe wrote: > > > > Congratulations, Manikumar! Well done. > > > > best, > > Colin > > > > > > On Fri, Oct 12, 2018, at 01:25, Edoardo Comar wr

Re: Anyone interested in helping out a little brother Apache project with their Kafka integration?

Hi Chris, I can help you in writing Kafka connector code. Regards, Abhimanyu On Wed, Aug 15, 2018 at 8:13 PM Christofer Dutz wrote: > Hi all, > > I am one of the Apache PLC4X (incubating) committers and am looking for > people willing to help out with a little thing. > > PLC4X is aiming at ind

Re: [VOTE] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

+1 On Wed, Sep 5, 2018 at 2:39 AM Magesh Nandakumar wrote: > +1 ( non-binding) > > On Tue, Sep 4, 2018 at 3:39 AM M. Manna wrote: > > > Hello, > > > > I have made necessary changes as per the original discussion thread, and > > would like to put it for votes. > > > > Thank you very much for you

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

Congratulations, Dong! On Wed, Aug 22, 2018 at 6:20 AM Dhruvil Shah wrote: > Congratulations, Dong! > > On Tue, Aug 21, 2018 at 4:38 PM Jason Gustafson > wrote: > > > Congrats! > > > > On Tue, Aug 21, 2018 at 10:03 AM, Ray Chiang wrote: > > > > > Congrats Dong! > > > > > > -Ray > > > > > > > >

Re: consumer group offset lag

I am also facing the same issue. On Tue, Jul 25, 2017 at 9:58 PM, Tarun Garg wrote: > I am sending this mail to DEV because i think this is a bug in AdminClient > while getting the group offset. > > Hi, > > I run through a issue. > i am trying to get the status of a consumer group. > > for this

[jira] [Created] (KAFKA-5287) Messages getting repeated in kafka

Abhimanyu Nagrath created KAFKA-5287: Summary: Messages getting repeated in kafka Key: KAFKA-5287 URL: https://issues.apache.org/jira/browse/KAFKA-5287 Project: Kafka Issue Type: Bug

[jira] [Updated] (KAFKA-5222) Kafka Connection error in contoller.logs

[ https://issues.apache.org/jira/browse/KAFKA-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhimanyu Nagrath updated KAFKA-5222: - Priority: Major (was: Critical) > Kafka Connection error in contoller.l

[jira] [Updated] (KAFKA-5222) Kafka Connection error in contoller.logs

[ https://issues.apache.org/jira/browse/KAFKA-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhimanyu Nagrath updated KAFKA-5222: - Priority: Critical (was: Minor) > Kafka Connection error in contoller.l

[jira] [Updated] (KAFKA-5221) Kafka Consumer Attached to partition but not consuming messages

[ https://issues.apache.org/jira/browse/KAFKA-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhimanyu Nagrath updated KAFKA-5221: - Priority: Critical (was: Major) > Kafka Consumer Attached to partition but not consum

[jira] [Commented] (KAFKA-5221) Kafka Consumer Attached to partition but not consuming messages

[ https://issues.apache.org/jira/browse/KAFKA-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16007783#comment-16007783 ] Abhimanyu Nagrath commented on KAFKA-5221: -- [~huxi_2b] that consumer instanc

[jira] [Commented] (KAFKA-5222) Kafka Connection error in contoller.logs

[ https://issues.apache.org/jira/browse/KAFKA-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16007775#comment-16007775 ] Abhimanyu Nagrath commented on KAFKA-5222: -- Yes, I can see Kafka running o

[jira] [Commented] (KAFKA-5222) Kafka Connection error in contoller.logs

[ https://issues.apache.org/jira/browse/KAFKA-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16007763#comment-16007763 ] Abhimanyu Nagrath commented on KAFKA-5222: -- [~huxi_2b] - yes I have

[jira] [Commented] (KAFKA-5221) Kafka Consumer Attached to partition but not consuming messages

[ https://issues.apache.org/jira/browse/KAFKA-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16007759#comment-16007759 ] Abhimanyu Nagrath commented on KAFKA-5221: -- Hi [~huxi_2b] there was some ty

[jira] [Updated] (KAFKA-5221) Kafka Consumer Attached to partition but not consuming messages

[ https://issues.apache.org/jira/browse/KAFKA-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhimanyu Nagrath updated KAFKA-5221: - Description: I have a single node Kafka broker and a single zookeeper (3.4.9). I am using

[jira] [Updated] (KAFKA-5221) Kafka Consumer Attached to partition but not consuming messages

[ https://issues.apache.org/jira/browse/KAFKA-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhimanyu Nagrath updated KAFKA-5221: - Description: I have a single node Kafka broker and a single zookeeper (3.4.9). I am using

[jira] [Created] (KAFKA-5222) Kafka Connection error in contoller.logs

Abhimanyu Nagrath created KAFKA-5222: Summary: Kafka Connection error in contoller.logs Key: KAFKA-5222 URL: https://issues.apache.org/jira/browse/KAFKA-5222 Project: Kafka Issue Type

[jira] [Created] (KAFKA-5221) Kafka Consumer Attached to partition but not consuming messages

Abhimanyu Nagrath created KAFKA-5221: Summary: Kafka Consumer Attached to partition but not consuming messages Key: KAFKA-5221 URL: https://issues.apache.org/jira/browse/KAFKA-5221 Project: Kafka

Error: Executing consumer group command failed due to Request GROUP_COORDINATOR failed on brokers List(localhost:9092 (id: -1 rack: null))

Hi, I am using single node Kafka cluster(version 0.10.2) and single node zookeeper (3.4.9). I am having approx 310 topics with Avg 100 partitions per topic. On Kafka broker when I am running the command to check consumer status in a group > ./kafka-consumer-groups.sh --bootstrap-server localhost:9