Local state in Samza - sharing data between tasks

2015-05-05 Thread Andreas Simanowski
Hello Samza community: I am very new to Samza and currently looking at how to use Samza and its key-value store. I have run into the following and was hoping someone could point me in the right direction. Say we have an input stream being consumed by more than one task (one task per partition). E

Re: Local state in Samza - sharing data between tasks

2015-05-05 Thread Andreas Simanowski
ges come into the input stream based on the partition key (not totally > random). Why does each task need its own copy of the data? Do you mean the > copy of the data in other partitions? > > Cheers, > > Fang, Yan > yanfang...@gmail.com > > On Tue, May 5, 2015 at 11:47 AM, And

Re: Local state in Samza - sharing data between tasks

2015-05-08 Thread Andreas Simanowski
you need to bootstrap, and whether your "shared" > data can be partitioned to work with a single partition of the input > stream, we can find out different solutions to suite your use case the > best. > > On Tue, May 5, 2015 at 3:38 PM, Andreas Simanowski > wrote: > >