Re: Reprocessing and windowing

2015-02-24 Thread Geoffry Sumter
Roger: That was an extremely clear and helpful talk, the described approach fits my usecase nearly perfectly, thanks! Yi: I'd love to give feedback, I'll add myself to the task. On Mon, Feb 23, 2015 at 6:21 PM, Yi Pan wrote: > Hey, Geoffry, > > We have started some work in SAMZA-552 to create a

Re: Reprocessing and windowing

2015-02-23 Thread Yi Pan
Hey, Geoffry, We have started some work in SAMZA-552 to create a window operator API in samza, as part of effort to implement support for a high-level language. I will probably be able to have something to share in a few days and would love to get feedbacks regarding to the window operator. Thank

Re: Reprocessing and windowing

2015-02-23 Thread Roger Hoover
Hi Geoffry, You might find the Google Millwheel paper and recent talk relevant. That system supports windows based on event time as well as reprocessing. Sent from my iPhone > On Feb 23, 2015, at 4:49 PM, Geoffry Sumter wrote: > > Hey everyone, > > I've been thinking about reprocessing >

Reprocessing and windowing

2015-02-23 Thread Geoffry Sumter
Hey everyone, I've been thinking about reprocessing when my job has windowed state and I have a few questions. Contex