Re: Kafka encryption

2016-06-06 Thread Bruno Rassaerts
Yes, and if on top of that it would be possible to define an own “compression” algorithm, which actually does compress + encrypt, then this would be a non-issue. > On 06 Jun 2016, at 17:11, Ismael Juma wrote: > > On Mon, Jun 6, 2016 at 3:12 PM, Tom Brown wrote: > >> How would it be possible

Re: Kafka encryption

2016-06-06 Thread Ismael Juma
On Mon, Jun 6, 2016 at 3:12 PM, Tom Brown wrote: > How would it be possible to encrypt an entire batch? My understanding > is that the Kafka server needs to know the boundaries of each message. > (E.g. The server decompresses compressed message sets and re-compresses > individual messages). > Qu

Re: Kafka encryption

2016-06-06 Thread Jim Hoagland
since >> otherwise patterns will be apparent. Also, RSA is more CPU intensive >>than >> AES. >> >> -- Jim >> >> On 6/6/16, 6:17 AM, "Martin Gainty" > >> wrote: >> >> >MG>quick questions for bruno and jim >> > &

Re: Kafka encryption

2016-06-06 Thread Tom Brown
CPU intensive than > AES. > > -- Jim > > On 6/6/16, 6:17 AM, "Martin Gainty" > > wrote: > > >MG>quick questions for bruno and jim > > > >> Subject: Re: Kafka encryption > >> From: bruno.rassae...@novazone.be > >> Date: M

Re: Kafka encryption

2016-06-06 Thread Jim Hoagland
7 AM, "Martin Gainty" wrote: >MG>quick questions for bruno and jim > >> Subject: Re: Kafka encryption >> From: bruno.rassae...@novazone.be >> Date: Mon, 6 Jun 2016 10:51:13 +0200 >> CC: tcrayf...@heroku.com >> To: users@kafka.apache.org >> >

RE: Kafka encryption

2016-06-06 Thread Martin Gainty
MG>quick questions for bruno and jim > Subject: Re: Kafka encryption > From: bruno.rassae...@novazone.be > Date: Mon, 6 Jun 2016 10:51:13 +0200 > CC: tcrayf...@heroku.com > To: users@kafka.apache.org > > Indeed to get proper performance, messages need to be batc

Re: Kafka encryption

2016-06-06 Thread Bruno Rassaerts
ystem >>>>>> administrators do not have access to the data. >>>>>> Any suggestions ? >>>>>> >>>>>>> On 24 May 2016, at 14:40, Tom Crayford >> > wrote: >>>>>>> >>>>>>> Hi, >>

Re: Kafka encryption

2016-06-02 Thread Jim Hoagland
's no encryption at rest. It's recommended to use filesystem >> > >>> encryption, or encryption of each individual message before >>producing >> > it >> > >>> for this. >> > >>> >> > >>> Only the new pro

Re: Kafka encryption

2016-06-02 Thread Tom Crayford
>> > > >>> On Tue, May 24, 2016 at 11:33 AM, Snehalata Nagaje < > > >>> snehalata.nag...@harbingergroup.com > wrote: > > >>> > > >>>> > > >>>> > > >>>> Thanks for quick reply. > > >&

Re: Kafka encryption

2016-06-01 Thread Gerard Klijs
ote: > >>> > >>>> > >>>> > >>>> Thanks for quick reply. > >>>> > >>>> Do you mean If I see messages in kafka, those will not be readable? > >>>> > >>>> And also, we are using n

Re: Kafka encryption

2016-06-01 Thread Snehalata Nagaje
ay, June 2, 2016 10:06:33 AM Subject: Re: Kafka encryption It works indeed but encrypting individual messages really influences the batch compression done by Kafka. Performance drops to about 1/3 of what it is without (even if we prepare the encrypted samples upfront). In the end what we going f

Re: Kafka encryption

2016-06-01 Thread Bruno Rassaerts
afka, those will not be readable? >>>> >>>> And also, we are using new producer but old consumer , does old consumer >>>> have ssl support? >>>> >>>> As mentioned in document, its not there. >>>> >>>&g

Re: Kafka encryption

2016-05-31 Thread Gerard Klijs
gt; > >> Do you mean If I see messages in kafka, those will not be readable? > >> > >> And also, we are using new producer but old consumer , does old consumer > >> have ssl support? > >> > >> As mentioned in document, its not there. > >> >

Re: Kafka encryption

2016-05-31 Thread Bruno Rassaerts
t;> Thanks, >> Snehalata >> >> - Original Message - >> From: "Mudit Kumar" >> To: users@kafka.apache.org >> Sent: Tuesday, May 24, 2016 3:53:26 PM >> Subject: Re: Kafka encryption >> >> Yes,it does that.What specifically yo

Re: Kafka encryption

2016-05-30 Thread eugene miretsky
cryption? > > > > > > we are using aws environment. > > > > > > Thanks, > > > Snehalata > > > > > > - Original Message - > > > From: "Gerard Klijs" > > > > To: "Users" > > &

Re: Kafka encryption

2016-05-26 Thread Jens Rantil
p.com> wrote: > > > > > > > Thanks, > > > > How can we do file system encryption? > > > > we are using aws environment. > > > > Thanks, > > Snehalata > > > > ----- Original Message - > > From: "Gerard Klijs&q

Re: Kafka encryption

2016-05-25 Thread Tom Crayford
gaje < snehalata.nag...@harbingergroup.com> wrote: > > > Thanks, > > How can we do file system encryption? > > we are using aws environment. > > Thanks, > Snehalata > > - Original Message - > From: "Gerard Klijs" > > To: "Use

Re: Kafka encryption

2016-05-24 Thread Snehalata Nagaje
Thanks, How can we do file system encryption? we are using aws environment. Thanks, Snehalata - Original Message - From: "Gerard Klijs" To: "Users" Sent: Tuesday, May 24, 2016 7:26:27 PM Subject: Re: Kafka encryption For both old and new consumers/producers y

Re: Kafka encryption

2016-05-24 Thread Gerard Klijs
gt; > > > As mentioned in document, its not there. > > > > > > Thanks, > > Snehalata > > > > - Original Message - > > From: "Mudit Kumar" > > To: users@kafka.apache.org > > Sent: Tuesday, May 24, 2016 3:53:26 PM > > Subject:

Re: Kafka encryption

2016-05-24 Thread Tom Crayford
; > As mentioned in document, its not there. > > > Thanks, > Snehalata > > - Original Message - > From: "Mudit Kumar" > To: users@kafka.apache.org > Sent: Tuesday, May 24, 2016 3:53:26 PM > Subject: Re: Kafka encryption > > Yes,it does that.What specifica

Re: Kafka encryption

2016-05-24 Thread Snehalata Nagaje
Kumar" To: users@kafka.apache.org Sent: Tuesday, May 24, 2016 3:53:26 PM Subject: Re: Kafka encryption Yes,it does that.What specifically you are looking for? On 5/24/16, 3:52 PM, "Snehalata Nagaje" wrote: >Hi All, > > >We have requirement of encryption i

Re: Kafka encryption

2016-05-24 Thread Mudit Kumar
Yes,it does that.What specifically you are looking for? On 5/24/16, 3:52 PM, "Snehalata Nagaje" wrote: >Hi All, > > >We have requirement of encryption in kafka. > >As per docs, we can configure kafka with ssl, for secured communication. > >But does kafka also stores data in encrypted form