Kafka Monitoring using JMX Mbeans

Hi, Have anyone setup any monitoring using Mbeans ?What kind of command line tools been used? Thanks, Mudit

Kafka To Hadoop

Hi, I have a running kafka setup with 3 brokers.Now i want to sink all kafka to write to hdfs.My hadoop cluster is already up and running. Any blog/doc for configuring the same. Thanks, Mudit

kafka-run-class.sh

How can i get the list for all the class names i can run through ./kafka-run-class.sh [class-name] command? Thanks, Mudit

Re: kafka-run-class.sh

; > > > kafka-run-class.sh basically just sets up the JVM classpath to call any of > the Main classes inside kafka. What exactly are you looking to do? > > On Fri, May 6, 2016 at 9:41 AM, Mudit Kumar wrote: > >> How can i get the list for all the class names i can r

Re: kafka-run-class.sh

ese classes > generically. Hope that helps. > > Dustin > > On Fri, May 6, 2016 at 2:12 PM, Mudit Kumar wrote: > >> Thanks chris but i am specifically looking for all Main Classes. >> >>> On May 6, 2016, at 11:07 PM, Christian Posta >> wrote: >&

gobblin error

Hi, I am getting below error while running my first job. Any leads why this is happening? [hdfs@analytics gobblin-dist]$bin/gobblin-mapreduce.sh --conf job/hadoop.conf WARNING: Use "yarn jar" to launch YARN applications. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in

Re: Kafka 9 version offset storage mechanism changes

so zookeeper not needed anymore? > On May 10, 2016, at 1:46 PM, Spico Florin wrote: > > Hi! > Yes both are possible. The new versions 0.9 and above store the offsets in > a special Kafka topic named __consumers_offsets. > Regards, > florin > > On Tue, May 10, 2016 at 8:33 AM, Gerard Klijs > wr

Re: Kafka encryption

Yes,it does that.What specifically you are looking for? On 5/24/16, 3:52 PM, "Snehalata Nagaje" wrote: >Hi All, > > >We have requirement of encryption in kafka. > >As per docs, we can configure kafka with ssl, for secured communication. > >But does kafka also stores data in encrypted form

Re: 0.10 Kafka with 0.9 brokers

You may face issues if client version is higher than broker version. On 5/24/16, 10:13 PM, "Oleg Zhurakousky" wrote: >With 0.10 Kafka being announced, are there any known compatibility issues with >0.9 brokers? > >Thanks >Oleg

Re: ClosedChannelException when trying to read from remote Kafka in AWS

I donot think you need public hostname.I have a similarsetup and its perfectly fine. What I would suggest you to change the hostname,make it persistent,and use FQDN everywhere with /etc/hosts entry locally and on AWS machines.Your problem will get fixed. On 6/1/16, 8:54 PM, "Marco B." wrote

Re: ClosedChannelException when trying to read from remote Kafka in AWS

e, by default kafka tries >to read the machine's hostname, specifically ip-10-1-83-5.ec2.internal - >now it's "10.1.83.5" (of course, we had to do this for each hostname). > >I hope that all these solutions will help others with the same issue. > >Thanks a lot fo

Re: HDFS Connector configuration

This should point for fs.DefaultFS properity in core-site.xml..basically it should be namespace Do you have HA cluster or single NN? On 6/9/16, 11:18 PM, "Tauzell, Dave" wrote: >What should this point to hdfs.url=hdfs://mdl-clda01:9000 ? Does it reference >the Namenode? > >-Dave > >Dave Ta

Delete Message From topic

Hey, How can I delete particular messages from particular topic?Is that possible? Thanks, Mudit

Re: Delete Message From topic

Thanks Tom! On 6/14/16, 8:55 PM, "Tom Crayford" wrote: >Hi Mudit, > >Sorry this is not possible. The only deletion Kafka offers is retention or >whole topic deletion. > >Thanks > >Tom Crayford >Heroku Kafka > >On Tuesday, 14 June 2016, Mudit Kum

Re: Delete Message From topic

r way >to help you? > >On Tue, Jun 14, 2016 at 5:29 AM, Mudit Kumar wrote: > >> Hey, >> >> How can I delete particular messages from particular topic?Is that >> possible? >> >> Thanks, >> Mudit >> >> > > >-- >*Christian Posta* >twitter: @christianposta >http://www.christianposta.com/blog >http://fabric8.io

Re: Kafka HDFS Connector

I think you can use flume also. Thanks, Mudit On 6/22/16, 12:29 PM, "Pariksheet Barapatre" wrote: >Anybody have any idea on this? > >Thanks >Pari > >On 20 June 2016 at 14:36, Pariksheet Barapatre >wrote: > >> Hello All, >> >> I have data coming from sensors into kafka cluster in text format

Nginx Logs to Kafka

Hi, I want to push all my nginx logs to kafka.Any tool/suggestions for same. Thanks, Mudit

Re: Kerberos Integration Issue

From: Mudit Kumar Date: Sunday, 17 June 2018 at 11:54 AM To: "users-i...@kafka.apache.org" Subject: Re: Kerberos Integration Issue I am able to find issue but still looking for how to fix it. The problem is earlier three brokers were running and I have remove two of them.Now

Kerberos Integration Issue

Hi, I have implement SASL Kerberos on my HDP cluster kafka. Kerberos is working fine. When I am starting producer console I am repetedly getting below messages: [data-ee-dev1@ bin]$ ./kafka-console-consumer.sh --zookeeper --topic kafka-kerberos-test1 --security-protocol PL