Re: Having trouble to connect StreamSets to Kafka with Kerberos authentication

2016-03-03 Thread Jonathan Natkins
Hey Michal, I'm cc'ing the StreamSets user list, which might be able to get you some better StreamSets-specific answers. Thanks! Natty On Thursday, March 3, 2016, Michał Kabocik wrote: > Dears, > > I’m Middleware Engineer and I’m trying to configure secure Kafka Cluster > with SSL and Kerberos

Re: Consuming Kafka Messages Inside of EC2 Instances

2015-01-29 Thread Jonathan Natkins
sense. Just configure your manually-started Zookeeper with different ports. 2181 is the obvious problem port, but there's probably other web UI ports or something. Not sure off the top of my head. > Thanks a lot, really appreciate the help. > > On Thu, Jan 29, 2015 at 12:42 P

Re: Consuming Kafka Messages Inside of EC2 Instances

2015-01-29 Thread Jonathan Natkins
0.0.0.0:* > LISTEN 3544/java > > > *ps 3544* > > PID TTY STAT TIME COMMAND > 3544 ?Sl 0:19 /usr/java/jdk1.7.0_67-cloudera/bin/java - > > > > On Thu, Jan 29, 2015 at 12:31 PM, Jonathan Natkins > wrote: > > > Hey Su, >

Re: Consuming Kafka Messages Inside of EC2 Instances

2015-01-29 Thread Jonathan Natkins
Hey Su, That exception indicates that there's something else already running on the port that you're trying to start up Zookeeper on. The quickest way to figure out what's causing the conflict is to run netstat and look for the port: [root@ip-10-0-0-45 ~]# *netstat -tulpn | grep 2181* tcp

Re: Kafka Out of Memory error

2015-01-19 Thread Jonathan Natkins
am trying with only 1 consumer thread. Does the equation > changes to > (#partitions)*(fetchsize)*(#consumer_threads) in case I try to read with > 1000 threads from from topic2(1000 partitions)? > > -Pranay > > On Mon, Jan 19, 2015 at 2:26 PM, Jonathan Natkins > wrote: > >

Re: Jar files needed to run in Java environment (without Maven)

2015-01-19 Thread Jonathan Natkins
Hi Suhas, Without seeing the actual output of the stacktrace, I'd suspect that spark-submit is doing some classpath magic that is covering some dependencies you may not have included. Depending on your use case, it might be easier to deal with this by just having maven output a pre-built jar-with-

Re: Kafka Out of Memory error

2015-01-19 Thread Jonathan Natkins
Hi Pranay, I think the JIRA you're referencing is a bit orthogonal to the OOME that you're experiencing. Based on the stacktrace, it looks like your OOME is coming from a consumer request, which is attempting to allocate 200MB. There was a thread (relatively recently) that discussed what I think i

Re: Interested in contributing to Kafka?

2014-07-16 Thread Jonathan Natkins
I was actually struggling with this, myself. I'm looking for some relatively easy JIRAs to go after to try to get familiar with the codebase. If you have any little pet JIRAs that you've not had time to get around to, I'd love to try to tackle some of those. Let me know. Thanks! Natty On Wed, Ju