[DISCUSS] Samza 0.9.0 release

Hey all, We haven't done a release in a couple of months, and I think master is getting to the point where it's got enough work to warrant a release. We've (LinkedIn) begun running a couple of our jobs against `master` last week, and will continue to test for stability. Here are the JIRAs that I

Stream-Stream joins - restricting the size of the KV store

Hi all, I just read through this post about implementing streaming joins in Samza using a KV store that Samza provides. Can someone tell me how I can ensure that this KV storage does not grow too

Re: Stream-Stream joins - restricting the size of the KV store

Hey Kishore, Right now, that has to be done by the application code. Our plan is to support a TTL in RocksDB once that feature is available to us in the Java JNI bindings (should be soon). In the meantime, you'll have to implement the WindowableTask.window() method, and call store.all() to periodi

Re: [DISCUSS] Samza 0.9.0 release

What about SAMZA-448 ? Agreed on the release vote date. I think it is a good idea to have a release before the ApacheCon (April 16-3-17), which can help spread the words. Cheers, Fang, Yan yanfang...@gmail.com +1 (206) 849-4108 On Tue, Mar 3, 2015 at 8:01 AM, Chris Riccomini wrote: > Hey all,

Re: [DISCUSS] Samza 0.9.0 release

Hey Yan, I want to hold off on SAMZA-448 until 0.10.0. The reason is that I don't want both a coordinator stream and a checkpoint stream. It just seems ugly. Naveen is currently working on unifying these classes in SAMZA-465. Because these are both big changes, I wanted to burn them in on master b

Re: Handling defaults and windowed aggregates in stream queries

Sorry to show up late to this party. I've had my head down writing a description of streaming SQL which I hoped would answer questions like this. Here is the latest draft: https://github.com/julianhyde/incubator-calcite/blob/chi/doc/STREAM.md I've been avoiding windows for now. They are not nee

Re: [DISCUSS] Samza 0.9.0 release

Yes, it sounds good. I asked was because I saw the "patch available" status. :) Cheers, Fang, Yan yanfang...@gmail.com +1 (206) 849-4108 On Tue, Mar 3, 2015 at 12:18 PM, Chris Riccomini wrote: > Hey Yan, > > I want to hold off on SAMZA-448 until 0.10.0. The reason is that I don't > want both a

Review Request 31718: Samza 465 [Draft]

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31718/ --- Review request for samza. Repository: samza Description --- Samza 465 [D

Re: Review Request 31718: Samza 465 [Draft]

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31718/ --- (Updated March 4, 2015, 1:25 a.m.) Review request for samza. Repository: samz

Re: Review Request 31417: Samza 465 [Draft]

> On March 2, 2015, 12:38 a.m., Chris Riccomini wrote: > > Hey Naveen, could you please re-post this in two stages? First, do an `rbt > > post` with just my changes, then a second with yours? This way, I can diff > > between my changes, and yours, to see just what you've done. I don't want > >

Re: Review Request 31718: Samza 465 [Draft]

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31718/#review75117 --- samza-core/src/main/scala/org/apache/samza/checkpoint/CheckpointToo

Re: Review Request 31718: Samza 465 [Draft]

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31718/ --- (Updated March 4, 2015, 1:39 a.m.) Review request for samza. Repository: samz