Re: Kafka support needed

2016-04-20 Thread todd
online. T Sent from my BlackBerry 10 smartphone   Original Message   From: Yogesh BG Sent: Wednesday, April 20, 2016 12:11 AM To: users@kafka.apache.org Reply To: users@kafka.apache.org Subject: Kafka support needed Hi I have a one scenario ass below, I want to know whether its supported cur

Re: Kafka support needed

2016-04-20 Thread Yogesh BG
Exception in thread "main" java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: Batch Expired at org.apache.kafka.clients.producer.internals.FutureRecordMetadata.valueOrError(FutureRecordMetadata.java:56) at org.apache.kafka.clients.producer.internals.FutureReco

Re: Kafka support needed

2016-04-19 Thread Joe Stein
If you use Go you can use https://github.com/sclasen/event-shuttle which is nice choice in some cases because footprint, it uses boltdb which is like leveldb which is like embedded k/v ok NiFi is cool too https://nifi.apache.org/ So is bruce https://github.com/ifwe/bruce those are more out of th

Re: Kafka support needed

2016-04-19 Thread Sunny Shah
Hi Yogesh, You can even use sqllite/leveldb to buffer the data on client. Thanks, Sunny On Apr 20, 2016 10:31 AM, "Yogesh BG" wrote: > Thank You for the reply. > > I am running producer in very resource constraint device(IOT hub). I doubt > whether i can accommodate local broker. > > > On Wed,

Re: Kafka support needed

2016-04-19 Thread Yogesh BG
Thank You for the reply. I am running producer in very resource constraint device(IOT hub). I doubt whether i can accommodate local broker. On Wed, Apr 20, 2016 at 10:07 AM, Sunny Shah wrote: > Hi Yogesh, > > No, Kafka does not provide this functionality out of the box, Though you > can easily

Re: Kafka support needed

2016-04-19 Thread Sunny Shah
Hi Yogesh, No, Kafka does not provide this functionality out of the box, Though you can easily engineer it by having a localhost Kafka setup. 1. Always write data to the localhost Kafka. 2. When broker connection is available then read data from localhost Kafka and send it to remote Kafk

Kafka support needed

2016-04-19 Thread Yogesh BG
Hi I have a one scenario ass below, I want to know whether its supported currently. If not is there any work around by using existing kafka features. I have kafka producer, currently he doesn’t have connection to the broker. I want to send the messages to kafka broker when the connection is a