Re: Http Kafka producer

ith if each of the requests to HAProxy > >>>only > >>> contains one message). > >>> > >>> -Ewen > >>> > >>> > >>> > >>> On Wed, Aug 26, 2015 at 5:05 PM, Hemanth Abbina > >>> > >>&g

Re: Http Kafka producer

nformation) sent to HAProxy from remote clients using HTTPs. No >>> serialization is used. >>> >>> Currently, we have one log each of the HTTP request. I understood that >>> every request is produced individually without batching. >>> >>> Will th

RE: Http Kafka producer

t batching. > > Will this work with REST proxy, without using schema registry ? > > --regards > Hemanth > > -Original Message- > From: Ewen Cheslack-Postava [mailto:e...@confluent.io] > Sent: Thursday, August 27, 2015 9:14 AM > To: users@kafka.apache.org > Subject

Re: Http Kafka producer

roduced individually without batching. >> >> Will this work with REST proxy, without using schema registry ? >> >> --regards >> Hemanth >> >> -Original Message- >> From: Ewen Cheslack-Postava [mailto:e...@confluent.io] >> Sent: Thursday, August

Re: Http Kafka producer

l this work with REST proxy, without using schema registry ? > > --regards > Hemanth > > -Original Message- > From: Ewen Cheslack-Postava [mailto:e...@confluent.io] > Sent: Thursday, August 27, 2015 9:14 AM > To: users@kafka.apache.org > Subject: Re: Http Kafka produ

RE: Http Kafka producer

, 2015 9:14 AM To: users@kafka.apache.org Subject: Re: Http Kafka producer Hemanth, Can you be a bit more specific about your setup? Do you have control over the format of the request bodies that reach HAProxy or not? If you do, Confluent's REST proxy should work fine and does not requir

Re: Http Kafka producer

lity > seems to be simple - scalability, reliability aspects and maintenance would > be more. > > Thanks > Hemanth > > -Original Message- > From: Marc Bollinger [mailto:m...@lumoslabs.com] > Sent: Thursday, August 27, 2015 4:39 AM > To: users@kafka.apache.org > Cc: d

RE: Http Kafka producer

r [mailto:m...@lumoslabs.com] Sent: Thursday, August 27, 2015 4:39 AM To: users@kafka.apache.org Cc: dev-subscr...@kafka.apache.org Subject: Re: Http Kafka producer I'm actually also really interested in this...I had a chat about this on the distributed systems slack's <http://dist

Re: Http Kafka producer

I'm actually also really interested in this...I had a chat about this on the distributed systems slack's Kafka channel a few days ago, but we're not much further than griping about the problem. We're basically migrating an existing event system, one which packed messages

Http Kafka producer

Hi, Our application receives events through a HAProxy server on HTTPs, which should be forwarded and stored to Kafka cluster. What should be the best option for this ? This layer should receive events from HAProxy & produce them to Kafka cluster, in a reliable and efficient way (and should scal