Re: Input stream partition to task mapping

2015-05-14 Thread Susan
Hi Yan, Thanks for your quick reply. Since we don't need to change our rules, we decided to use the consumer to read the rules in init(), as you suggested. Works great - thanks so much for your help! Susan On Tue, May 12, 2015 at 5:32 PM, Yan Fang wrote: > Hi Susan, > > -- &qu

Re: Input stream partition to task mapping

2015-05-12 Thread Susan Luong
Tasks and then localize it."? Do you mean, loading messages into a changelog stream using a bootstrap job? Thanks in advance for your help! Susan On Tue, May 5, 2015 at 6:02 PM, Yan Fang wrote: > If the rule does not change, we can get the rule when starting up > StreamTasks and

Questions about partitioning

2015-04-24 Thread Susan Luong
at, we'd like for task 'a' to only process messages from stream A and never from stream B, since task 'a' may contain local state that applies specifically to stream A. Would this be possible? Maybe I'm not understanding how Samza works, but I'm hoping someone c