Re: Sync Producer

2014-06-08 Thread Achanta Vamsi Subhash
- Is setting type in config of the producer to sync the way? - Is the exception thrown a Runtime Exception? My IDE doesn't show that an exception is being thrown? On Sun, Jun 8, 2014 at 12:24 PM, Achanta Vamsi Subhash < achanta.va...@flipkart.com> wrote: > Hi, > > How to use a sync producer wit

Re: Sync Producer

2014-06-08 Thread pushkar priyadarshi
setting the config is the way to use async.it throws an exception when unable to send a message. On Sun, Jun 8, 2014 at 12:46 PM, Achanta Vamsi Subhash < achanta.va...@flipkart.com> wrote: > - Is setting type in config of the producer to sync the way? > - Is the exception thrown a Runtime Except

Re: Kafka producer in CSharp

2014-06-08 Thread Joe Stein
To circle back around this thread there is an available native .net client https://cwiki.apache.org/confluence/display/KAFKA/Clients#Clients-.net now. /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly T

Re: [DISCUSS] Kafka Security Specific Features

2014-06-08 Thread Todd Palino
I’ll agree that perhaps the “absolutely not” is not quite right. There are certainly some uses for a simpler solution, but I would still say it cannot only be encryption at the broker. This would leave many use cases for at-rest encryption out of the loop (most auditing cases for SOX, PCI, HIPAA, a

Re: [DISCUSS] Kafka Security Specific Features

2014-06-08 Thread Rob Withers
I like the use of meta envelopes. We did this recently, on the job, as we have an envelope that specifies the type for decoding. We discussed adding the encodinType and you are suggesting adding encryption metadata for that msg. All good. I don't see your OTP example. Could you delve de

Re: About peculiar scenario in kafka camus consumer

2014-06-08 Thread Jun Rao
Are you saying that the consumer is stuck at fetching data at the same offset again and again w/o returning any message? If so, what's the max message size on the broker? You need to make sure that consumer fetch size is larger than the max message size. Thanks, Jun On Sat, Jun 7, 2014 at 12:17