Re: trying to tune kafka's internal logging - need help...

2014-08-06 Thread Harsha
ex log4j.appender.kafkaAppender=org.apache.log4j.DailyRollingFileAppender log4j.appender.kafkaAppender.DatePattern='.'-MM-dd-HH log4j.appender.kafkaAppender.File=${kafka.logs.dir}/kafka-tools.log and export LOG_DIR as you did before. -Harsha On Wed, Aug 6, 2014, at 09:43 AM, Shlomi H

kafka contrib/hadoop-consumer,producer

2014-08-18 Thread Harsha
is any interest in the above projects from the community I am hoping to work on documentation and the code as there isn't much activity happened on these projects. Thanks, Harsha

Re: build failes for latest stable source tgz (kafka_2.9.2-0.8.1.1)

2014-09-04 Thread Harsha
Did you tried "gradlew" script in kafka source dir. -Harsha On Thu, Sep 4, 2014, at 07:32 AM, Shlomi Hazan wrote: > what gradle version is used to build kafka_2.9.2-0.8.1.1 ? > > tried with v2 and failed with : > > > > gradle --stacktrace clean > > FA

Re: Error in znode creation after adding SASL digest on server and client

2016-07-08 Thread Harsha Chintalapani
expects all the nodes to have an ACL on it. This could be an issue with ZkClient tha we use or we need to navigate this case differently. Can you file a JIRA for this. Thanks, Harsha On Fri, Jul 8, 2016 at 3:24 PM Harsha Ch wrote: > Hi, > So we specifically kept the consumers to

Re: Error in znode creation after adding SASL digest on server and client

2016-07-08 Thread Harsha Ch
expects all the nodes to have an ACL on it. This could be an issue with ZkClient tha we use or we need to navigate this case differently. Can you file a JIRA for this. Thanks, Harsha On Thu, Jul 7, 2016 at 10:48 PM Vipul Sharma wrote: > I am running zookeeper and kafka on local machine. >

Re: Deleting a topic on the 0.8x brokers

2016-07-14 Thread Harsha Chintalapani
One way to delete is to delete the topic partition directories from disks and delete /broker/topics. If you just shutdown those brokers controller might try to replicate the topic onto brokers and since you don't have any leaders you might replica fetcher errors in the logs. Thanks, Harsha O

Re: TLS based ACL: Does Kafka support multiple CA Certs on broker

2016-07-17 Thread Harsha Chintalapani
Did you make sure both those CA's are imported into Broker's truststore? -Harsha On Fri, Jul 15, 2016 at 5:12 PM Raghavan, Gopal wrote: > Hi, > > Can Kakfa support multiple CA certs on broker. > If yes, can you please point me to an example. > > Producer signed wit

Re: [VOTE] 0.10.0.1 RC0

2016-07-29 Thread Harsha Ch
Hi Ismael, I would like to this JIRA included in the minor release https://issues.apache.org/jira/browse/KAFKA-3950. Thanks, Harsha On Fri, Jul 29, 2016 at 7:46 AM Ismael Juma wrote: > Hello Kafka users, developers and client-developers, > > This is the first candidate for th

Re: [kafka-clients] [VOTE] 0.10.0.1 RC0

2016-07-31 Thread Harsha Ch
Thanks Ismael. On Sat, Jul 30, 2016 at 7:43 PM Ismael Juma wrote: > Hi Dana, > > Thanks for testing releases so promptly. Very much appreciated! > > It's funny, Ewen had suggested something similar with regards to the > release notes a couple of days ago. We now have a Python script for > genera

Re: [kafka-clients] [VOTE] 0.10.0.1 RC2

2016-08-07 Thread Harsha Chintalapani
+1 (binding) 1. Ran 3 node cluser 2. Ran few tests in creating, producing , consuming from secure & non-secure clients. Thanks, Harsha On Fri, Aug 5, 2016 at 8:50 PM Manikumar Reddy wrote: > +1 (non-binding). > verified quick start and artifacts. > > On Sat, Aug 6, 2016 at 5:4

Re: a broker is already registered on path /brokers/ids/1

2016-08-29 Thread Harsha Chintalapani
how many brokers you've in this cluster. Do you try using a stable zookeeper release like 3.4.8? -Harhsa On Mon, Aug 29, 2016 at 5:21 AM Nomar Morado wrote: > we are using kafka 0.9.0.1 and zk 3.5.0-alpha > > On Mon, Aug 29, 2016 at 8:12 AM, Nomar Morado > wrote: > > > we would get this occasio

Re: SSL Kafka 0.9.0.1

2016-10-03 Thread Harsha Chintalapani
Shri, SSL in 0.9.0.1 is not beta and can be used in production. If you want to put authorizer on top of SSL to enable ACLs for clients and topics that's possible too. Thanks, Harsha On Mon, Oct 3, 2016 at 8:30 AM Shrikant Patel wrote: > We are are 0.9.0.1 and want to use SSL for

[VOTE] Add REST Server to Apache Kafka

2016-10-25 Thread Harsha Chintalapani
/%3ccamvt_aymqeudm39znsxgktpdde46sowmqhsxop-+jmbcuv7...@mail.gmail.com%3E This is a VOTE thread to check interest in the community for adding REST Server implementation in Apache Kafka. Thanks, Harsha

Re: [VOTE] Add REST Server to Apache Kafka

2016-10-25 Thread Harsha Chintalapani
Jeff, Thanks for participating. We already have the discussion thread going on. Please add your thoughts there . I'll keep this as interest check vote thread. Thanks, Harsha On Tue, Oct 25, 2016 at 3:12 PM Stevo Slavić wrote: > -1 > > I fully agree with Jay and Jeff. >

Re: [VOTE] Add REST Server to Apache Kafka

2016-10-25 Thread Harsha Chintalapani
I am not able to link the whole thread on REST server discussion thread from dev list properly. But if you go here http://mail-archives.apache.org/mod_mbox/kafka-dev/201610.mbox/thread look for subject "[DISCUSS] KIP-80: Kafka REST Server" Thanks, Harsha On Tue, Oct 25, 2016 at 4

Re: [VOTE] Add REST Server to Apache Kafka

2016-10-29 Thread Harsha Chintalapani
This Vote now closed. There is the majority who are not in favor of including the REST server. Thanks everyone for participating. Vote tally: +1 Votes: Harsha Chintalapani Parth Brahbhatt Ken Jackson Suresh Srinivas Jungtaek Lim Ali Akthar Haohui Mai Shekhar

Re: [ANNOUNCE] New committer: Jiangjie (Becket) Qin

2016-10-31 Thread Harsha Chintalapani
Congrats Becket! -Harsha On Mon, Oct 31, 2016 at 2:13 PM Rajini Sivaram wrote: > Congratulations, Becket! > > On Mon, Oct 31, 2016 at 8:38 PM, Matthias J. Sax > wrote: > > > -BEGIN PGP SIGNED MESSAGE- > > Hash: SHA512 > > > > Congrats! > >

Re: [VOTE] 2.0.0 RC1

2018-07-02 Thread Harsha Ch
+1 . * Ran unit tests * Verified signatures * Ran 3 node cluster with basic operations Thanks, Harsha On Mon, Jul 2nd, 2018 at 11:13 AM, "Vahid S Hashemian" wrote: > > > > +1 (non-binding) > > Built from source and ran quickstart successfully on Ubuntu (wit

Re: [VOTE] 2.0.1 RC0

2018-11-01 Thread Harsha Chintalapani
+1. Ran a 3 node cluster with few simple tests. Thanks, Harsha On Nov 1, 2018, 9:50 AM -0700, Eno Thereska , wrote: > Anything else holding this up? > > Thanks > Eno > > On Thu, Nov 1, 2018 at 10:27 AM Jakub Scholz wrote: > > > +1 (non-binding) ... I used the staged

Re: kafka.consumers Java Package

2018-11-09 Thread Harsha Chintalapani
Chris,         You are upgrading from 0.10.2.2 to 2.0.0 . There will be quite few changes and it looks like you might be using classes other than KafkaConsumer which are not public API? What classes specifically are not available. -Harsha On Nov 9, 2018, 7:47 AM -0800, Chris Barlock , wrote

Re: Broker continuously expand and shrinks to itself

2019-01-24 Thread Harsha Chintalapani
Hi Ashish,            Whats your replica.lag.time.max.ms set to and do you see any network issues between brokers. -Harsha On Jan 22, 2019, 10:09 PM -0800, Ashish Karalkar , wrote: > Hi All, > We just upgraded from 0.10.x to 1.1 and enabled rack awareness on an existing > clusters

Re: Deploying Kafka topics in a kerberized Zookeeper without superuser (in a CI flow)

2019-01-24 Thread Harsha Chintalapani
KafkaAdminClient to createTopics which will send a createTopicRequest through brokers which can be authorized. Your CI can have its own principal and you can create authorization policy which will allow this principal to create topics. -Harsha On Jan 21, 2019, 3:00 AM -0800, Kristjan Peil , wrote

Re: Kafka consumer configuration to minimize rebalance time

2019-01-24 Thread Harsha Chintalapani
-Harsha On Jan 24, 2019, 9:51 AM -0800, Marcos Juarez , wrote: > One of our internal customers is working on a service that spans around 120 > kubernetes pods. Due to design constraints, every one of these pods has a > single kafka consumer, and they're all using the same consumer gro

Re: Broker continuously expand and shrinks to itself

2019-01-28 Thread Harsha Chintalapani
option to try is to lower the socket timeout to be lower and increase the lag.time.max.ms . Thanks, Harsha On Jan 27, 2019, 8:48 AM -0800, Ashish Karalkar , wrote: > Hi Harsha, > Thanks for the reply. > Issue is resolved as of now and the root cause was a runaway application > s

Question related to Kafka Connect

2019-05-06 Thread Mandadi, Harsha
. Thanks, Harsha Mobile: +919440849355

Re: [ANNOUNCE] New committer: Boyang Chen

2020-06-22 Thread Harsha Chintalapani
Congratulations, Boyang -Harsha On Mon, Jun 22, 2020 at 4:32 PM AJ Chen wrote: > Congrats, Boyang! > > -aj > > > > > On Mon, Jun 22, 2020 at 4:26 PM Guozhang Wang wrote: > > > The PMC for Apache Kafka has invited Boyang Chen as a committer and we > are

Re: Kafka SASL and custom LoginModule and Authorizer

2017-02-26 Thread Harsha Chintalapani
splay/KAFKA/KIP-48+Delegation+token+support+for+Kafka . Thanks, Harsha On Sat, Feb 25, 2017 at 6:48 PM Christian wrote: > We have implemented our own LoginModule and Authorizer. The LoginModule > does an authentication on the client side, obtains a token and passes that > token down

Re: Securing Multi-Node single broker kafka instance

2017-03-01 Thread Harsha Chintalapani
For inter broker communication over SSL all you need is to add security.inter.broker.protocol to SSL. "How do i make zookeeper talk to each other and brokers?" Not sure I understand the question. You need to make sure zookeeper hosts and port are reachable from your broker nodes. -Hars

Re: Recording - Storm & Kafka Meetup on April 20th 2017

2017-04-24 Thread Harsha Chintalapani
Hi Aditya, Thanks for your interest. We entatively planning one in June 1st week. If you haven't already please register here https://www.meetup.com/Apache-Storm-Apache-Kafka/ . I'll keep the Storm lists updated once we finalize the date & location. Thanks, Harsha

Performance Impact with Apache Kafka Security

2018-08-22 Thread Sri Harsha Chavali
2339 ms 95th, 2914 ms 99th, 3211 ms 99.9th Thank you, Harsha

Re: Performance Impact with Apache Kafka Security

2018-08-24 Thread Sri Harsha Chavali
Hi Harsha, Given below are all the details. We are using Kafka On CDH. Do you have any suggestion based on the below statistics. CDK - 2.2.0 - 0.10.2.0+kafka2.2.0+110 Apache Kafka - 0.10.2. java version "1.8.0_151" Tried Using Java 9 with not much difference. We need to make a sm

Re: Performance Impact with Apache Kafka Security

2018-08-24 Thread Sri Harsha Chavali
impact in my case? Thank you, Harsha Sent from Outlook<http://aka.ms/weboutlook> From: Eric Azama Sent: Friday, August 24, 2018 2:04 PM To: users@kafka.apache.org Cc: ka...@harsha.io Subject: Re: Performance Impact with Apache Kafka Security I saw a similar

<    1   2