Re: Re: Samza processing reference data

2015-10-28 Thread Chen Song
Thanks Yan & Yi. On Wed, Oct 28, 2015 at 11:00 AM, Yi Pan wrote: > Hi, Chen, > > > > On Wed, Oct 28, 2015 at 4:05 AM, Yan Fang wrote: > > > > > > > * Is there a tentative date for 0.10.0 release? > > I think it's coming out soon. @Yi Pan , he should know more about > that. > > > > There is

Re: Re: Samza processing reference data

2015-10-28 Thread Yi Pan
Hi, Chen, On Wed, Oct 28, 2015 at 4:05 AM, Yan Fang wrote: > > > * Is there a tentative date for 0.10.0 release? > I think it's coming out soon. @Yi Pan , he should know more about that. > There is a bit delay on the release date due to a recent bug we discovered in test. The targeted dat

Re:Re: Samza processing reference data

2015-10-28 Thread Yan Fang
* Is there a tentative date for 0.10.0 release? I think it's coming out soon. @Yi Pan , he should know more about that. * I checked the checkpoint topic for Samza job and it seems the checkpoint topic is created with1 partition by default. Given that each Samza task will need to read from

Re: Samza processing reference data

2015-10-27 Thread Chen Song
Thanks Yan. * Is there a tentative date for 0.10.0 release? * I checked the checkpoint topic for Samza job and it seems the checkpoint topic is created with1 partition by default. Given that each Samza task will need to read from checkpoint topic, it is similar to what I need to read (Each Samza t

Samza processing reference data

2015-10-21 Thread Chen Song
In our samza app, we need to read data from MySQL (reference table) with a stream. So the requirements are * Read data into each Samza task before processing any message. * The Samza task should be able to listen to updates happening in MySQL. I did some research after scanning through some relev