Re: How to deal with bootstrapping

2015-04-17 Thread Yan Fang
Hi Jeremy, Benjamin is right, New-Rules-Job will need to know the map of partitions to offsets. Samza's checkpoint stream has the mapping. The doc is here . However, after my second thought, I do not recommend to use

Review Request 33297: [SAMZA-654] Added ElasticsearchSystemProducer and Factory to output messages into Elasticseach indexes.

2015-04-17 Thread Dan Harvey
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33297/ --- Review request for samza. Repository: samza Description --- [SAMZA-654]

Review Request 33305: [SAMZA-655] Add EnvironmentConfigRewriter to samza-api.

2015-04-17 Thread Dan Harvey
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33305/ --- Review request for samza. Repository: samza Description --- [SAMZA-655]

Re: Extra Systems and other extensions.

2015-04-17 Thread Dan
https://issues.apache.org/jira/browse/SAMZA-654 - Elasticsearch Producer Please comment there if you have any opinions on requirements for the clients / configuration / serialization with using this producer. It's currently fit for our use case but I know there will be more. https://issues.apache

Re: How to deal with bootstrapping

2015-04-17 Thread jeremy p
I think that solution will work! Thank you, Yan. And thanks to everybody in this thread! You all were very helpful. I look forward to using Samza and being a part of the community. --Jeremy On Fri, Apr 17, 2015 at 2:06 AM, Yan Fang wrote: > Hi Jeremy, > > Benjamin is right, New-Rules-Job wi

Re: Review Request 33305: [SAMZA-655] Add EnvironmentConfigRewriter to samza-api.

2015-04-17 Thread Jakob Homan
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33305/#review80525 --- samza-api/src/main/java/org/apache/samza/config/EnvironmentConfigRe

Re: Review Request 33297: [SAMZA-654] Added ElasticsearchSystemProducer and Factory to output messages into Elasticseach indexes.

2015-04-17 Thread Jakob Homan
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33297/#review80538 --- samza-elasticsearch/src/main/java/org/apache/samza/config/Elasticse