Different Serde for Store and Changelog

2016-07-31 Thread nick xander
Hi Team, We have a requirement where we need to decrypt/encrypt any data coming in/going out to Samza processor (Kafka used as the system stream). It is achievable with the different serde for input/output stream however for Rocksdb key value store backed up by kafka changelog it becomes challe

Re: Kafka 0.9 as part of Samza 0.10?

2016-04-07 Thread nick xander
nd we can find a solution together. Thanks a lot! -Yi On Fri, Apr 1, 2016 at 3:34 PM, nick xander wrote: > Hi Yi, > > Thanks for the clarification, it was helpful. > > > I would also like to know your views on the below issues and if you have >

Re: Kafka 0.9 as part of Samza 0.10?

2016-04-01 Thread nick xander
upgrade to Kafka asap), please correct me if I am wrong here. Thanks, Nick -- Hi, Nick, Let me try to answer in-between the lines: On Thu, Mar 31, 2016 at 12:49 AM, nick xander wrote: > > * Do you guys experience issue with Kafka when it

Kafka 0.9 as part of Samza 0.10?

2016-03-31 Thread nick xander
Hi All, As per this article: http://www.confluent.io/blog/290-reasons-to-upgrade-to-apache-kafka-0.9.0.0 there are some well know bugs and feature improvements around log compaction (state full management in Samza) and Replication. I also saw in Samza issues about this upgrade: https://issues.a