Hi, Navina, The 29/30 tickets are to be excluded from 0.10.0 (i.e. moved to 0.11.0), the three tickets are either to be included in 0.10.0, or won't fix.
-Yi On Thu, Jul 30, 2015 at 5:10 PM, Navina Ramesh <nram...@linkedin.com.invalid > wrote: > Hi Yi, > Thanks for summarizing. But why are we excluding SAMZA-723 from the current > release ? Doesn't this break the existing StreamAppender functionality in > 0.9? > > Thanks! > Navina > > On Thu, Jul 30, 2015 at 4:55 PM, Yi Pan <nickpa...@gmail.com> wrote: > > > Sorry, hit the send button too fast. Let me correct the summary section: > > > > 29/32 tickets Status=open/reopen : > > > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20SAMZA%20AND%20status%20in%20(Open%2C%20Reopened)%20AND%20fixVersion%20%3D%200.10.0%20ORDER%20BY%20due%20ASC%2C%20priority%20DESC%2C%20created%20ASC > > > > Three tickets excluded: > > - SAMZA-689, @Chinmay, were you able to re-produce it? I am thinking of > > mark it as won't fix since 0.10.0 will remove the checkpoint topic > > altogether. > > - SAMZA-747, we will have to upgrade to RocksDB 3.11.1 to include the fix > > that breaks Samza 0.10.0 build on Linux boxes > > - SAMZA-723, stream appender deadlock issue > > > > Thanks! > > > > -Yi > > > > > > On Thu, Jul 30, 2015 at 4:52 PM, Yi Pan <nickpa...@gmail.com> wrote: > > > > > Hi, all, > > > > > > Thanks a lot for helping out to select the features planned in 0.10.0. > > > > > > Based on the above discussion, I am proposing to move the following > > > tickets later (i.e. 0.11.0). > > > > > > 30/32 tickets Status=open/reopen (exception for SAMZA-723: stream > > appender > > > deadlock issue) : > > > > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20SAMZA%20AND%20status%20in%20(Open%2C%20Reopened)%20AND%20fixVersion%20%3D%200.10.0%20ORDER%20BY%20due%20ASC%2C%20priority%20DESC%2C%20created%20ASC > > > > > > Two tickets excluded: > > > - SAMZA-689, @Chinmay, were you able to re-produce it? I am thinking of > > > mark it as won't fix since 0.10.0 will remove the checkpoint topic > > > altogether. > > > - SAMZA-747, we will have to upgrade to RocksDB 3.11.1 to include the > fix > > > that breaks Samza 0.10.0 build on Linux boxes > > > > > > Anything that I missed? > > > > > > Thanks! > > > > > > -Yi > > > > > > > > > On Wed, Jul 29, 2015 at 9:57 AM, Navina Ramesh < > > > nram...@linkedin.com.invalid> wrote: > > > > > >> +1 for StreamAppender bug fix as a mandatory in 0.10. > > >> > > >> @Yan: will review SAMZA-676 today and test it out locally. > > >> > > >> Thanks! > > >> Navina > > >> > > >> On Wed, Jul 29, 2015 at 8:38 AM, Chinmay Soman < > > chinmay.cere...@gmail.com > > >> > > > >> wrote: > > >> > > >> > I can take care of SAMZA-340, SAMZA-683 and will follow up with > Luis > > >> for > > >> > SAMZA-401,2,3,4 > > >> > > > >> > On Wed, Jul 29, 2015 at 12:10 AM, Dan <danharve...@gmail.com> > wrote: > > >> > > > >> > > I agree SAMZA-741 for the ElasticSearch producer should be in too > so > > >> > we've > > >> > > got a better API as part of that release. > > >> > > > > >> > > - Dan > > >> > > > > >> > > > > >> > > On 29 July 2015 at 07:51, Yan Fang <yanfang...@gmail.com> wrote: > > >> > > > > >> > > > Actually, I also want to include a few patch-available features, > > >> > > > especially: > > >> > > > > > >> > > > 1. broadcast stream (SAMZA-676) > > >> > > > - waiting for review > > >> > > > > > >> > > > 2. graphite support (SAMZA-340) > > >> > > > 3. meter and histogram (SAMZA-683) > > >> > > > 4. utility (SAMZA-401) > > >> > > > - 2,3,4 belong to Luis, if he does not have time to update, > > >> since > > >> > > they > > >> > > > only need some small changes, we can edit it and get +1 from > > another > > >> > > > committer. > > >> > > > > > >> > > > 5. hdfs producer (SAMZA-693) > > >> > > > - I am reviewing. > > >> > > > > > >> > > > 6. upgrade yarn to 2.7.1 (SAMZA-563) > > >> > > > - though I am reviewing, this ticket is negotiable if we want > > to > > >> put > > >> > > > into the 0.10.0 release. If we do not, I think, when users > enable > > >> the > > >> > > > worker-persisting and container-persisting features, Samza will > > not > > >> be > > >> > > able > > >> > > > to handle it. (Some classes are only available after yarn 2.5.0 > > >> while > > >> > > Samza > > >> > > > currently only support yarn 2.4.0) > > >> > > > > > >> > > > 7. others: scrooge, class loader isolation, etc. > > >> > > > - those are waiting for reviewing too. > > >> > > > > > >> > > > My opinion is that, if we can clean up all the patch-available > > >> tickets, > > >> > > it > > >> > > > will be great. Most of them have been already reviewed more than > > >> once. > > >> > > So I > > >> > > > think it should not be very time-consuming to have them in the > > >> 0.10.0 > > >> > > > release. > > >> > > > > > >> > > > What do you think? > > >> > > > > > >> > > > Of course, another must-have is the bug-fix of the Stream > > Appender. > > >> :) > > >> > > > > > >> > > > Thanks, > > >> > > > > > >> > > > Fang, Yan > > >> > > > yanfang...@gmail.com > > >> > > > > > >> > > > On Tue, Jul 28, 2015 at 10:27 PM, Roger Hoover < > > >> roger.hoo...@gmail.com > > >> > > > > >> > > > wrote: > > >> > > > > > >> > > > > Thanks, Yi. > > >> > > > > > > >> > > > > I propose that we also include SAMZA-741 for Elasticsearch > > >> versioning > > >> > > > > support with the new ES producer. I think it's very close to > > >> being > > >> > > > merged. > > >> > > > > > > >> > > > > Roger > > >> > > > > > > >> > > > > > > >> > > > > On Tue, Jul 28, 2015 at 10:08 PM, Yi Pan <nickpa...@gmail.com > > > > >> > wrote: > > >> > > > > > > >> > > > > > Hi, all, > > >> > > > > > > > >> > > > > > I want to start the discussion on the release schedule for > > >> 0.10.0. > > >> > > > There > > >> > > > > > are a few important features that we plan to release in > 0.10.0 > > >> and > > >> > I > > >> > > > want > > >> > > > > > to start this thread s.t. we can agree on what to include in > > >> 0.10.0 > > >> > > > > > release. > > >> > > > > > > > >> > > > > > There are the following main features added in 0.10.0: > > >> > > > > > - RocksDB TTL support > > >> > > > > > - Add CoordinatorStream and disable CheckpointManager > > >> > > > > > - Elasticsearch Producer > > >> > > > > > - Host affinity > > >> > > > > > And other 0.10.0 tickets: > > >> > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20SAMZA%20AND%20status%20in%20(%22In%20Progress%22%2C%20Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.10.0 > > >> > > > > > > > >> > > > > > I propose to cut a 0.10.0 release after we get the following > > >> issues > > >> > > > > > resolved: > > >> > > > > > - SAMZA-615: Migrate checkpoint from checkpoint topic to > > >> > Coordinator > > >> > > > > stream > > >> > > > > > - SAMZA-617: YARN host affinity in Samza > > >> > > > > > > > >> > > > > > Thoughts? > > >> > > > > > > > >> > > > > > Thanks! > > >> > > > > > > > >> > > > > > -Yi > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > >> > > > >> > -- > > >> > Thanks and regards > > >> > > > >> > Chinmay Soman > > >> > > > >> > > >> > > >> > > >> -- > > >> Navina R. > > >> > > > > > > > > > > > > -- > Navina R. >
