Serialization asymmetry

2016-03-31 Thread Andy Chambers
Hey Folks, It seems like there's some asymmetry in the way serialization works. Unless I'm doing something wrong, samza seems to pick up our custom avro serializer when it reads messages from input topics, but when we tried to write messages to an output topic, it fails to pick up the serializer

Re: Review Request 44920: SAMZA-881

2016-03-31 Thread Yi Pan (Data Infrastructure)
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/44920/#review126385 --- I have some high level questions w/ the current class layout/hiera

Re: Review Request 44920: SAMZA-881

2016-03-31 Thread Jagadish Venkatraman
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/44920/ --- (Updated March 31, 2016, 10:40 p.m.) Review request for samza, Boris Shkolnik,

Re: Review Request 44604: split deployment logic

2016-03-31 Thread Boris Shkolnik
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/44604/ --- (Updated March 31, 2016, 9:21 p.m.) Review request for samza and Yi Pan (Data I

Re: Review Request 44604: split deployment logic

2016-03-31 Thread Boris Shkolnik
> On March 25, 2016, 5:15 p.m., Yi Pan (Data Infrastructure) wrote: > > One more comment: we need open source documentation for the split > > deployment as well. Please add the online documentation for this feature. I will do it as a separate JIRA, cause it will take little bit longer. - Bori

Re: Review Request 44604: split deployment logic

2016-03-31 Thread Boris Shkolnik
> On March 25, 2016, 5:14 p.m., Yi Pan (Data Infrastructure) wrote: > > samza-core/src/main/scala/org/apache/samza/job/local/ProcessJobFactory.scala, > > line 17 > > > > > > One question on this: how about ThreadJobF

Re: Kafka 0.9 as part of Samza 0.10?

2016-03-31 Thread Yi Pan
Hi, Nick, Let me try to answer in-between the lines: On Thu, Mar 31, 2016 at 12:49 AM, nick xander wrote: > > * Do you guys experience issue with Kafka when it is used with log > compaction for Samza's state full management? > The critical issue on log-compaction in Kafka that we care about is

Kafka 0.9 as part of Samza 0.10?

2016-03-31 Thread nick xander
Hi All, As per this article: http://www.confluent.io/blog/290-reasons-to-upgrade-to-apache-kafka-0.9.0.0 there are some well know bugs and feature improvements around log compaction (state full management in Samza) and Replication. I also saw in Samza issues about this upgrade: https://issues.a