Re: Has anybody successfully integrated Kafka jar for Android app.

2014-07-17 Thread Subodh Nijsure
Just a followup for completeness sake -- for testing purpose I have setup fluentd and fluent-plugin-kafka plugin. Now my android APP now does POST to this fluent instance which forwards the message on to Kafka and then subsequent items in the processing pipeline. Cheers, -Subodh On Wed, Jul 16,

Re: Has anybody successfully integrated Kafka jar for Android app.

2014-07-16 Thread Subodh Nijsure
Thanks Philip, I will certainly take a look. I had not considered the fact that Kafka doesn't have any security/authentication mechanism yet, so using some kind of secure gateway certainly makes sense. -Subodh On Wed, Jul 16, 2014 at 10:03 PM, Philip O'Toole < philip_o_to...@yahoo.com.invalid>

Re: Has anybody successfully integrated Kafka jar for Android app.

2014-07-16 Thread Steve Robenalt
Agreeing with Philip! Our use of Kafka is with a relatively small number of high volume producers and consumers. I'm pretty sure Kafka wasn't designed for large numbers of either Producers or Consumers, as would be necessary for any significant number of mobile clients. Also, while an Android dev

Re: Has anybody successfully integrated Kafka jar for Android app.

2014-07-16 Thread Philip O'Toole
You should find code here that will help you get a HTTP app server together, that writes to Kafka on the back-end. https://cwiki.apache.org/confluence/display/KAFKA/Clients https://cwiki.apache.org/confluence/display/KAFKA/Ecosystem   On Wednesday, July 16, 2014 9:36 PM, Philip O'Toole wrote

Re: Has anybody successfully integrated Kafka jar for Android app.

2014-07-16 Thread Philip O'Toole
FWIW, I happen to know Subodh -- we worked together many years back. We discussed this a little off-the-list, but perhaps my thoughts might be of wider interest. Kafka, in my experience, works best when Producers have a persistent TCP connection to the Broker(s) (and possibly Zookeeper). I gues

Re: Has anybody successfully integrated Kafka jar for Android app.

2014-07-16 Thread Subodh Nijsure
Hello Steven, Thanks for your suggestions, I have certainly seen other stack/presentation where people do forward their messages to their own receiver which forwards the message to kafka -- basically they write their own producer(s). The question I haven't been able to answer for myself- why -- d

Re: Has anybody successfully integrated Kafka jar for Android app.

2014-07-16 Thread Steve Robenalt
Hi Subodh, I would think you'd be better off having an app server of some kind as an intermediary that accepts messages from your android app and posts them to Kafka for you, rather than having your app be a Kafka Producer on its own. Steve On Wed, Jul 16, 2014 at 1:22 PM, Subodh Nijsure < subo

Has anybody successfully integrated Kafka jar for Android app.

2014-07-16 Thread Subodh Nijsure
Hello, I am trying to make my Android application to be the producer of messages that get sent to Kafka server. I am trying to compile my android code using following libraries - kafka_2.9.2-0.8.1.1.jar, scala-library-2.9.2.jar However I am running into issue where it produces too many methods.