Based on the requests listed in this thread Stephan and myself cherry-picked the following commits:
7634310 [FLINK-1266] Generalize DistributedFileSystem implementation (rmetzger) 40a2705 [FLINK-1266] Update mongodb link and address pull request comments (rmetzger) cd66ced [FLINK-1266] Properly pass the fs.defaulFS setting when initializing … (rmetzger) 3bf2d21 [FLINK-1266] More dependency exclusions (rmetzger) e8ab5b7 [FLINK-1266] Backport fix to 0.8 (rmetzger) 7cd0f47 [docs] Prepare documentation for 0.8 release (rmetzger) e83ccd0 [FLINK-1385] Print warning if not resources are _currently_ available… (rmetzger) 4f9dcae [FLINK-1378] [scala] Fix type extraction for nested type parameters (aljoscha) fced2eb [FLINK-1378] Add support for Throwables in KryoSerializer (aljoscha) ada35eb [FLINK-1378] [scala] Add support for Try[A] (Success/Failure) (aljoscha) a64abe1 [docs] Update README and internals (scheduling) for graduation and fi… (SephanEwen) 4f95ce7 Fix typo in README.md (uce) Both of us committed some other fixes mainly for the dependencies and licences, the distribution and the quickstarts. Pushing the results as soon as the tests pass. Does anyone have any other issue that has to be included in the next release candidate? On Sat, Jan 10, 2015 at 7:34 PM, Robert Metzger <rmetz...@apache.org> wrote: > I've tested it on an empty YARN cluster, allocating more containers than > available. > Flink will then allocate as many containers as possible. > > On Sat, Jan 10, 2015 at 7:31 PM, Stephan Ewen <se...@apache.org> wrote: > > > Seems reasonable. Have you tested it on a cluster with concurrent YARN > > jobs? > > > > On Sat, Jan 10, 2015 at 7:28 PM, Robert Metzger <rmetz...@apache.org> > > wrote: > > > > > I would really like to include this commit into the 0.8 release as > well: > > > > > > > > > https://github.com/apache/flink/commit/ec2bb573d185429f8b3efe111850b8f0e67f2704 > > > A user is affected by this issue. > > > If you agree, I can merge it. > > > > > > On Sat, Jan 10, 2015 at 7:25 PM, Stephan Ewen <se...@apache.org> > wrote: > > > > > > > I have gone through the code, cleaned up dependencies and made sure > > that > > > > all licenses are correctly handled. > > > > The changes are in the public release-0.8 branch. > > > > > > > > From that side, the code is now good to go in my opinion. > > > > > > > > > > > > Stephan > > > > > > > > > > > > On Sat, Jan 10, 2015 at 12:30 PM, Robert Metzger < > rmetz...@apache.org> > > > > wrote: > > > > > > > > > I've updated the docs/_config.yml variables to reflect that hadoop2 > > is > > > > now > > > > > the default profile: https://github.com/apache/flink/pull/294 > > > > > > > > > > On Fri, Jan 9, 2015 at 8:52 PM, Stephan Ewen <se...@apache.org> > > wrote: > > > > > > > > > > > Just as a heads up. I am almost through with checking > dependencies > > > and > > > > > > licenses. > > > > > > Will commit that later tonight or tomorrow. > > > > > > > > > > > > On Fri, Jan 9, 2015 at 7:09 PM, Stephan Ewen <se...@apache.org> > > > wrote: > > > > > > > > > > > > > I vote to include it as well. It is sort of vital for advanced > > use > > > of > > > > > the > > > > > > > Scala API. > > > > > > > > > > > > > > It is also an isolated change that does not affect other > > > components, > > > > so > > > > > > it > > > > > > > should be testable very well. > > > > > > > > > > > > > > On Fri, Jan 9, 2015 at 7:05 PM, Robert Metzger < > > > rmetz...@apache.org> > > > > > > > wrote: > > > > > > > > > > > > > >> I'd say yes because its affecting a user. > > > > > > >> > > > > > > >> On Fri, Jan 9, 2015 at 7:00 PM, Aljoscha Krettek < > > > > aljos...@apache.org > > > > > > > > > > > > >> wrote: > > > > > > >> > > > > > > >> > I have a fix for this issue: > > > > > > >> > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > https://issues.apache.org/jira/browse/FLINK-1378?jql=project%20%3D%20FLINK > > > > > > >> > and I think this should also make it into the 0.8.0 release. > > > > > > >> > > > > > > > >> > What do you think? > > > > > > >> > > > > > > > >> > On Fri, Jan 9, 2015 at 3:28 PM, Márton Balassi < > > > > > > >> balassi.mar...@gmail.com> > > > > > > >> > wrote: > > > > > > >> > > Sure, thanks Ufuk. > > > > > > >> > > > > > > > > >> > > On Fri, Jan 9, 2015 at 3:15 PM, Ufuk Celebi < > u...@apache.org > > > > > > > > wrote: > > > > > > >> > > > > > > > > >> > >> Marton, could you also cherry-pick 7f659f6 and 7e08fa1 > for > > > the > > > > > next > > > > > > >> RC? > > > > > > >> > >> It's a minor update to the README describing the IDE > setup. > > > > > > >> > >> > > > > > > >> > >> I will closed the respective issue FLINK-1109. > > > > > > >> > >> > > > > > > >> > >> On 08 Jan 2015, at 23:50, Henry Saputra < > > > > henry.sapu...@gmail.com > > > > > > > > > > > > >> > wrote: > > > > > > >> > >> > > > > > > >> > >> > Marton, could you close this VOTE thread by replying to > > the > > > > > > >> original > > > > > > >> > >> > email and append [CANCEL] in the subject line. > > > > > > >> > >> > > > > > > > >> > >> > - Henry > > > > > > >> > >> > > > > > > > >> > >> > On Thu, Jan 8, 2015 at 9:35 AM, Márton Balassi < > > > > > > >> > balassi.mar...@gmail.com> > > > > > > >> > >> wrote: > > > > > > >> > >> >> Cherry-picked and tested: found no duplicate > > dependencies > > > in > > > > > > lib, > > > > > > >> > yarn > > > > > > >> > >> >> uberjar build goes without the mentioned warns. > > > > > > >> > >> >> Travis tests are passing, pushing soon. > > > > > > >> > >> >> > > > > > > >> > >> >> On Thu, Jan 8, 2015 at 4:57 PM, Stephan Ewen < > > > > > se...@apache.org> > > > > > > >> > wrote: > > > > > > >> > >> >> > > > > > > >> > >> >>> Nice. > > > > > > >> > >> >>> > > > > > > >> > >> >>> @Marton: As soon as as you are done, I make a pass > over > > > the > > > > > > >> > licenses... > > > > > > >> > >> >>> > > > > > > >> > >> >>> Stephan > > > > > > >> > >> >>> > > > > > > >> > >> >>> > > > > > > >> > >> >>> On Thu, Jan 8, 2015 at 4:42 PM, Robert Metzger < > > > > > > >> rmetz...@apache.org > > > > > > >> > > > > > > > > >> > >> >>> wrote: > > > > > > >> > >> >>> > > > > > > >> > >> >>>> Allright. The travis tests are green and I tested it > > > again > > > > > > with > > > > > > >> > >> Tachyon > > > > > > >> > >> >>> on > > > > > > >> > >> >>>> a cluster. > > > > > > >> > >> >>>> > > > > > > >> > >> >>>> My pull request also fixes some of the issues > > mentioned > > > > > > earlier > > > > > > >> in > > > > > > >> > >> this > > > > > > >> > >> >>>> thread by Stephan (the warnings from shading > regarding > > > > > > duplicate > > > > > > >> > >> >>> classes). > > > > > > >> > >> >>>> I can not fix all of them because some projects like > > > > hadoop > > > > > > just > > > > > > >> > have > > > > > > >> > >> the > > > > > > >> > >> >>>> "conflicts" in their dependencies. > > > > > > >> > >> >>>> > > > > > > >> > >> >>>> I'll merge the pull request to master. > > > > > > >> > >> >>>> Marton can merge it to "release-0.8". > > > > > > >> > >> >>>> > > > > > > >> > >> >>>> On Thu, Jan 8, 2015 at 2:42 PM, Stephan Ewen < > > > > > > se...@apache.org> > > > > > > >> > >> wrote: > > > > > > >> > >> >>>> > > > > > > >> > >> >>>>> Robert, can you let us know once the PR is merged? > > > > > > >> > >> >>>>> > > > > > > >> > >> >>>>> Then we can start with the next steps... > > > > > > >> > >> >>>>> > > > > > > >> > >> >>>>> > > > > > > >> > >> >>>>> > > > > > > >> > >> >>>>> On Thu, Jan 8, 2015 at 2:07 PM, Robert Metzger < > > > > > > >> > rmetz...@apache.org> > > > > > > >> > >> >>>>> wrote: > > > > > > >> > >> >>>>> > > > > > > >> > >> >>>>>> Please wait with merging 268. There is still a > minor > > > > open > > > > > > >> issue. > > > > > > >> > >> >>>>>> > > > > > > >> > >> >>>>>> On Thu, Jan 8, 2015 at 1:28 PM, Márton Balassi < > > > > > > >> > >> >>>> balassi.mar...@gmail.com > > > > > > >> > >> >>>>>> > > > > > > >> > >> >>>>>> wrote: > > > > > > >> > >> >>>>>> > > > > > > >> > >> >>>>>>> +1 for merging PR 268, volunteering for the > merge. > > It > > > > > > should > > > > > > >> > also > > > > > > >> > >> >>>> solve > > > > > > >> > >> >>>>>> the > > > > > > >> > >> >>>>>>> issue mentioned by Stephan with the yarn uberjar. > > > > > > >> > >> >>>>>>> > > > > > > >> > >> >>>>>>> Updating the release scripts and doing a > > double-check > > > > on > > > > > > the > > > > > > >> > >> >>>> cosmetics. > > > > > > >> > >> >>>>>>> > > > > > > >> > >> >>>>>>> On Thu, Jan 8, 2015 at 12:55 PM, Stephan Ewen < > > > > > > >> se...@apache.org > > > > > > >> > > > > > > > > >> > >> >>>>> wrote: > > > > > > >> > >> >>>>>>> > > > > > > >> > >> >>>>>>>> We just found and fixed another highly critical > > bug. > > > > > > >> > >> >>>>>>>> > > > > > > >> > >> >>>>>>>> I vote to also cherry pick commit > > > > > > >> > >> >>>>>>>> 19066b520435528e104a69ccf372f56811123ee3 > > > ([FLINK-1371] > > > > > > >> > >> >>>>>>>> [runtime] Fix KryoSerializer to not swallow > > > > > EOFExceptions) > > > > > > >> > >> >>>>>>>> > > > > > > >> > >> >>>>>>>> > > > > > > >> > >> >>>>>>>> > > > > > > >> > >> >>>>>>>> On Thu, Jan 8, 2015 at 11:55 AM, Robert Metzger > < > > > > > > >> > >> >>>> rmetz...@apache.org > > > > > > >> > >> >>>>>> > > > > > > >> > >> >>>>>>>> wrote: > > > > > > >> > >> >>>>>>>> > > > > > > >> > >> >>>>>>>>> +1 for merging pull request 268. It makes Flink > > > even > > > > > more > > > > > > >> > >> >>>>> compatible > > > > > > >> > >> >>>>>>> with > > > > > > >> > >> >>>>>>>>> hadoop. > > > > > > >> > >> >>>>>>>>> > > > > > > >> > >> >>>>>>>>> > > > > > > >> > >> >>>>>>>>> regarding the documentation: I already updated > > the > > > > > build > > > > > > >> > >> >>>>>> instructions. > > > > > > >> > >> >>>>>>>> But > > > > > > >> > >> >>>>>>>>> we should double check everything again. > > > > > > >> > >> >>>>>>>>> I probably won't have time to look into this > > today > > > > > > however. > > > > > > >> > >> >>>>>>>>> > > > > > > >> > >> >>>>>>>>> On Thu, Jan 8, 2015 at 11:50 AM, Stephan Ewen < > > > > > > >> > >> >>> se...@apache.org> > > > > > > >> > >> >>>>>>> wrote: > > > > > > >> > >> >>>>>>>>> > > > > > > >> > >> >>>>>>>>>> After the dependencies are cleaned up > (Robert's > > > pull > > > > > > >> request > > > > > > >> > >> >>>>>>>>>> https://github.com/apache/flink/pull/268 > solves > > > > > that), > > > > > > we > > > > > > >> > >> >>> need > > > > > > >> > >> >>>>> to > > > > > > >> > >> >>>>>>> also > > > > > > >> > >> >>>>>>>>> do > > > > > > >> > >> >>>>>>>>>> the following: > > > > > > >> > >> >>>>>>>>>> > > > > > > >> > >> >>>>>>>>>> - Make a pass over dependencies to ensure that > > > > NOTICE > > > > > > and > > > > > > >> > >> >>>>> LICENSE > > > > > > >> > >> >>>>>>>> files > > > > > > >> > >> >>>>>>>>>> are up to date (both source and bin > > distribution) > > > > > > >> > >> >>>>>>>>>> - Adjust the variables in the docs to reflect > > the > > > > fact > > > > > > >> that > > > > > > >> > >> >>>>>> hadoop2 > > > > > > >> > >> >>>>>>> is > > > > > > >> > >> >>>>>>>>> now > > > > > > >> > >> >>>>>>>>>> the default profile > > > > > > >> > >> >>>>>>>>>> > > > > > > >> > >> >>>>>>>>>> I would volunteer for the first task. > > > > > > >> > >> >>>>>>>>>> > > > > > > >> > >> >>>>>>>>>> Stephan > > > > > > >> > >> >>>>>>>>>> > > > > > > >> > >> >>>>>>>>>> > > > > > > >> > >> >>>>>>>>>> On Wed, Jan 7, 2015 at 10:01 PM, Stephan Ewen > < > > > > > > >> > >> >>>> se...@apache.org> > > > > > > >> > >> >>>>>>>> wrote: > > > > > > >> > >> >>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>> I also see a warning when building the yarn > fat > > > > jar. > > > > > > >> > >> >>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>> This is a consequence of the duplicate > > > > dependencies. > > > > > > >> > >> >>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>> [WARNING] servlet-api-3.0.20100224.jar, > > > > > > >> > >> >>>>>>> javax.servlet-api-3.0.1.jar, > > > > > > >> > >> >>>>>>>>>>> javax.servlet-3.1.jar, servlet-api-2.5.jar > > define > > > > 42 > > > > > > >> > >> >>>>> overlappping > > > > > > >> > >> >>>>>>>>>> classes: > > > > > > >> > >> >>>>>>>>>>> [WARNING] - javax.servlet.http.Cookie > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > javax.servlet.http.HttpSessionBindingEvent > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > javax.servlet.http.NoBodyResponse > > > > > > >> > >> >>>>>>>>>>> [WARNING] - javax.servlet.ServletContext > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > javax.servlet.ServletOutputStream > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > javax.servlet.http.HttpSessionListener > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > javax.servlet.http.HttpSessionContext > > > > > > >> > >> >>>>>>>>>>> [WARNING] - javax.servlet.FilterChain > > > > > > >> > >> >>>>>>>>>>> [WARNING] - javax.servlet.GenericServlet > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> javax.servlet.http.HttpServletRequestWrapper > > > > > > >> > >> >>>>>>>>>>> [WARNING] - 32 more... > > > > > > >> > >> >>>>>>>>>>> [WARNING] hadoop-yarn-api-2.2.0.jar, > > > > > > >> > >> >>>>> hadoop-yarn-common-2.2.0.jar > > > > > > >> > >> >>>>>>>>> define > > > > > > >> > >> >>>>>>>>>> 3 > > > > > > >> > >> >>>>>>>>>>> overlappping classes: > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > org.apache.hadoop.yarn.util.package-info > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> org.apache.hadoop.yarn.factories.package-info > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> > >> >>>>>> > > org.apache.hadoop.yarn.factory.providers.package-info > > > > > > >> > >> >>>>>>>>>>> [WARNING] asm-4.0.jar, asm-3.1.jar define 21 > > > > > > overlappping > > > > > > >> > >> >>>>>> classes: > > > > > > >> > >> >>>>>>>>>>> [WARNING] - org.objectweb.asm.Type > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > org.objectweb.asm.AnnotationVisitor > > > > > > >> > >> >>>>>>>>>>> [WARNING] - org.objectweb.asm.MethodVisitor > > > > > > >> > >> >>>>>>>>>>> [WARNING] - org.objectweb.asm.Attribute > > > > > > >> > >> >>>>>>>>>>> [WARNING] - org.objectweb.asm.FieldWriter > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > org.objectweb.asm.signature.SignatureWriter > > > > > > >> > >> >>>>>>>>>>> [WARNING] - org.objectweb.asm.MethodWriter > > > > > > >> > >> >>>>>>>>>>> [WARNING] - org.objectweb.asm.Edge > > > > > > >> > >> >>>>>>>>>>> [WARNING] - org.objectweb.asm.Handler > > > > > > >> > >> >>>>>>>>>>> [WARNING] - org.objectweb.asm.ByteVector > > > > > > >> > >> >>>>>>>>>>> [WARNING] - 11 more... > > > > > > >> > >> >>>>>>>>>>> [WARNING] javax.servlet-api-3.0.1.jar, > > > > > > >> > >> >>> javax.servlet-3.1.jar, > > > > > > >> > >> >>>>>>>>>>> servlet-api-3.0.20100224.jar define 32 > > > overlappping > > > > > > >> > >> >>> classes: > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > javax.servlet.annotation.HttpConstraint > > > > > > >> > >> >>>>>>>>>>> [WARNING] - javax.servlet.DispatcherType > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> > >> >>>>> javax.servlet.descriptor.JspPropertyGroupDescriptor > > > > > > >> > >> >>>>>>>>>>> [WARNING] - javax.servlet.Registration > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > javax.servlet.SessionTrackingMode > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> > >> >>>>>>>>> > > > > > > javax.servlet.annotation.ServletSecurity$EmptyRoleSemantic > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > javax.servlet.annotation.HandlesTypes > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > javax.servlet.ServletRegistration > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > javax.servlet.annotation.ServletSecurity > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > javax.servlet.ServletContainerInitializer > > > > > > >> > >> >>>>>>>>>>> [WARNING] - 22 more... > > > > > > >> > >> >>>>>>>>>>> [WARNING] jasper-compiler-5.5.23.jar, > > > > > > >> > >> >>>> jasper-runtime-5.5.23.jar > > > > > > >> > >> >>>>>>>> define > > > > > > >> > >> >>>>>>>>> 1 > > > > > > >> > >> >>>>>>>>>>> overlappping classes: > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > org.apache.jasper.compiler.Localizer > > > > > > >> > >> >>>>>>>>>>> [WARNING] commons-collections-3.2.1.jar, > > > > > > >> > >> >>>>>>> commons-beanutils-1.7.0.jar, > > > > > > >> > >> >>>>>>>>>>> commons-beanutils-core-1.8.0.jar define 10 > > > > > overlappping > > > > > > >> > >> >>>>> classes: > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> > >> >>>>> org.apache.commons.collections.FastHashMap$EntrySet > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> > >> >>>> org.apache.commons.collections.FastHashMap$KeySet > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > org.apache.commons.collections.ArrayStack > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> > >> >>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>> > > > > > > >> > >> >>>>>>>>> > > > > > > >> > >> >>>>>>>> > > > > > > >> > >> >>>>>>> > > > > > > >> > >> >>>>>> > > > > > > >> > >> >>>>> > > > > > > >> > >> >>>> > > > > > > >> > >> >>> > > > > > > >> > >> > > > > > > >> > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > org.apache.commons.collections.FastHashMap$CollectionView$CollectionViewIterator > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> > >> >>>> org.apache.commons.collections.FastHashMap$Values > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> > >> >>>>>>>> > > > > > org.apache.commons.collections.FastHashMap$CollectionView > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> org.apache.commons.collections.FastHashMap$1 > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > org.apache.commons.collections.Buffer > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > org.apache.commons.collections.FastHashMap > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> > >> >>>>>>> > > > org.apache.commons.collections.BufferUnderflowException > > > > > > >> > >> >>>>>>>>>>> [WARNING] commons-beanutils-1.7.0.jar, > > > > > > >> > >> >>>>>>>> commons-beanutils-core-1.8.0.jar > > > > > > >> > >> >>>>>>>>>>> define 82 overlappping classes: > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> org.apache.commons.beanutils.ConvertUtilsBean > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> > >> >>>>>>>> > > > > org.apache.commons.beanutils.converters.SqlTimeConverter > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > org.apache.commons.beanutils.Converter > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> > >> >>>>>>>>> > > > > > > org.apache.commons.beanutils.converters.FloatArrayConverter > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> > >> >>>> org.apache.commons.beanutils.NestedNullException > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> > >> >>>>> org.apache.commons.beanutils.ConvertingWrapDynaBean > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> > >> >>>>>>>>> > > > > > > org.apache.commons.beanutils.converters.LongArrayConverter > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> > >> >>>>>>>> > > > > org.apache.commons.beanutils.converters.SqlDateConverter > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> > >> >>>>>>>>>> > > > > > > >> org.apache.commons.beanutils.converters.BooleanArrayConverter > > > > > > >> > >> >>>>>>>>>>> [WARNING] - > > > > > > >> > >> >>>>>>> > > > org.apache.commons.beanutils.converters.StringConverter > > > > > > >> > >> >>>>>>>>>>> [WARNING] - 72 more... > > > > > > >> > >> >>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>> On Wed, Jan 7, 2015 at 9:08 PM, Robert > Metzger > > < > > > > > > >> > >> >>>>>>> rmetz...@apache.org> > > > > > > >> > >> >>>>>>>>>>> wrote: > > > > > > >> > >> >>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>> ... I did some more checks: > > > > > > >> > >> >>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>> The hadoop200alpha version has some issues > > with > > > > the > > > > > > >> hadoop > > > > > > >> > >> >>>>>>>> dependency > > > > > > >> > >> >>>>>>>>>>>> exclusions. I fixed the issues in this pull > > > > request: > > > > > > >> > >> >>>>>>>>>>>> https://github.com/apache/flink/pull/268. > The > > > > > > >> dependency > > > > > > >> > >> >>>>>>> exclusions > > > > > > >> > >> >>>>>>>>> for > > > > > > >> > >> >>>>>>>>>>>> hadoop are basically disabled because they > are > > > > > > >> overwritten > > > > > > >> > >> >>>> by > > > > > > >> > >> >>>>>> the > > > > > > >> > >> >>>>>>>>>>>> hadoop200alpha profile. This causes issues > > like > > > > two > > > > > > asm > > > > > > >> > >> >>>>> versions > > > > > > >> > >> >>>>>>>> (4.0 > > > > > > >> > >> >>>>>>>>>> and > > > > > > >> > >> >>>>>>>>>>>> 3.2) in the lib/ folder. > > > > > > >> > >> >>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>> Very cosmetic: > > > > > > >> > >> >>>>>>>>>>>> - We can update the urls in the README.txt / > > > > > README.md > > > > > > >> of > > > > > > >> > >> >>>> the > > > > > > >> > >> >>>>>>> binary > > > > > > >> > >> >>>>>>>>>>>> releases. They contain > > > > > > >> > >> >>>>>>>>>>>> http://flink.incubator.apache.org > > > > > > >> > >> >>>>>>>>>>>> https://github.com/apache/incubator-flink > > > > > > >> > >> >>>>>>>>>>>> u...@flink.incubator.apache.org > > > > > > >> > >> >>>>>>>>>>>> d...@flink.incubator.apache.org > > > > > > >> > >> >>>>>>>>>>>> Which all don't need the "incubator" anymore > > > > > > >> (mailinglists > > > > > > >> > >> >>>>>> should > > > > > > >> > >> >>>>>>>> work > > > > > > >> > >> >>>>>>>>>> as > > > > > > >> > >> >>>>>>>>>>>> well, but we need to verify) > > > > > > >> > >> >>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>> Positive checks: > > > > > > >> > >> >>>>>>>>>>>> - No incubator notices > > > > > > >> > >> >>>>>>>>>>>> - Example plan preview is working for all > > > examples > > > > > > >> > >> >>>>>>>>>>>> - All examples are running with build-in > data, > > > > > > submitted > > > > > > >> > >> >>>> from > > > > > > >> > >> >>>>>> the > > > > > > >> > >> >>>>>>>> web > > > > > > >> > >> >>>>>>>>>>>> interface > > > > > > >> > >> >>>>>>>>>>>> - scala examples (some) > > > > > > >> > >> >>>>>>>>>>>> - streaming examples (some) > > > > > > >> > >> >>>>>>>>>>>> - No exceptions or WARN log messages > occurred > > > > after > > > > > a > > > > > > >> > >> >>> "start > > > > > > >> > >> >>>>> jm > > > > > > >> > >> >>>>>> / > > > > > > >> > >> >>>>>>>> web > > > > > > >> > >> >>>>>>>>>> --> > > > > > > >> > >> >>>>>>>>>>>> all java batch examples --> stop everything" > > > > cycle. > > > > > > >> > >> >>>>>>>>>>>> - ./bin/flink also works for the wordcount > > > example > > > > > ;) > > > > > > >> > >> >>>>>>>>>>>> - no binaries in the src archive > > > > > > >> > >> >>>>>>>>>>>> - the source archive builds (mvn clean > > install) > > > > > > >> (including > > > > > > >> > >> >>>> rat > > > > > > >> > >> >>>>>>>> license > > > > > > >> > >> >>>>>>>>>>>> header check, checkstyle and all tests) > > > > > > >> > >> >>>>>>>>>>>> - gpg signatures are valid: gpg --verify > > > > > > >> > >> >>>>>> flink-0.8.0-src.tgz.asc > > > > > > >> > >> >>>>>>>>>>>> flink-0.8.0-src.tgz > > > > > > >> > >> >>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>> On Wed, Jan 7, 2015 at 7:55 PM, Robert > > Metzger < > > > > > > >> > >> >>>>>>> rmetz...@apache.org > > > > > > >> > >> >>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>> wrote: > > > > > > >> > >> >>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>> -1 > > > > > > >> > >> >>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>> There is a major issue with the hadoop1 and > > > > hadoop2 > > > > > > >> > >> >>>>> versions: > > > > > > >> > >> >>>>>> We > > > > > > >> > >> >>>>>>>>> made > > > > > > >> > >> >>>>>>>>>>>>> hadoop2 the default profile, so the 0.8.0 > > > version > > > > > > will > > > > > > >> > >> >>>> pull > > > > > > >> > >> >>>>>> the > > > > > > >> > >> >>>>>>>>>> hadoop2 > > > > > > >> > >> >>>>>>>>>>>>> dependencies. > > > > > > >> > >> >>>>>>>>>>>>> We basically need an explicit 0.8.0-hadoop1 > > > > version > > > > > > >> now. > > > > > > >> > >> >>>>>>>>>>>>> The release candidate contains a 0.8.0 > > version > > > > > which > > > > > > >> has > > > > > > >> > >> >>>>>> hadoop2 > > > > > > >> > >> >>>>>>>>>>>> activated > > > > > > >> > >> >>>>>>>>>>>>> by default, the 0.8.0-hadoop2 version also > > has > > > > > > hadoop2 > > > > > > >> > >> >>>>>> activated > > > > > > >> > >> >>>>>>>> by > > > > > > >> > >> >>>>>>>>>>>>> default. In this release candidate, there > is > > no > > > > way > > > > > > for > > > > > > >> > >> >>>>> users > > > > > > >> > >> >>>>>> to > > > > > > >> > >> >>>>>>>>>> depend > > > > > > >> > >> >>>>>>>>>>>> on > > > > > > >> > >> >>>>>>>>>>>>> a hadoop1 flink dependency. > > > > > > >> > >> >>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>> In general, we should warn users that the > > > default > > > > > > >> hadoop > > > > > > >> > >> >>>>>>>>> dependencies > > > > > > >> > >> >>>>>>>>>>>> have > > > > > > >> > >> >>>>>>>>>>>>> changed with the release! > > > > > > >> > >> >>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>> I suggest to wait a bit with the next RC to > > > > collect > > > > > > >> more > > > > > > >> > >> >>>>>>> feedback > > > > > > >> > >> >>>>>>>> on > > > > > > >> > >> >>>>>>>>>> the > > > > > > >> > >> >>>>>>>>>>>>> release candidate. > > > > > > >> > >> >>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>> On Wed, Jan 7, 2015 at 7:37 PM, Márton > > Balassi > > > < > > > > > > >> > >> >>>>>>>> mbala...@apache.org > > > > > > >> > >> >>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>> wrote: > > > > > > >> > >> >>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>>> Please vote on releasing the following > > > candidate > > > > > as > > > > > > >> > >> >>>> Apache > > > > > > >> > >> >>>>>>> Flink > > > > > > >> > >> >>>>>>>>>>>> version > > > > > > >> > >> >>>>>>>>>>>>>> 0.8.0 > > > > > > >> > >> >>>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>>> This release will be the first major > release > > > for > > > > > > Flink > > > > > > >> > >> >>>> as a > > > > > > >> > >> >>>>>> top > > > > > > >> > >> >>>>>>>>> level > > > > > > >> > >> >>>>>>>>>>>>>> project. > > > > > > >> > >> >>>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>>> > > > > > > >> > >> >>>>> > > > > > ------------------------------------------------------------- > > > > > > >> > >> >>>>>>>>>>>>>> The commit to be voted on is in the branch > > > > > > >> > >> >>>>>> "release-0.8.0-rc1" > > > > > > >> > >> >>>>>>>>>>>>>> (commit 8c30f60): > > > > > > >> > >> >>>>>>>>>>>>>> > > > > > > >> > >> >>>>> > > > > > https://git-wip-us.apache.org/repos/asf/flink/commit/8c30f60 > > > > > > >> > >> >>>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>>> The release artifacts to be voted on can > be > > > > found > > > > > > at: > > > > > > >> > >> >>>>>>>>>>>>>> > > > > > http://people.apache.org/~mbalassi/flink-0.8.0-rc1/ > > > > > > >> > >> >>>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>>> Release artifacts are signed with the > > > following > > > > > key: > > > > > > >> > >> >>>>>>>>>>>>>> > > > > > > https://people.apache.org/keys/committer/mbalassi.asc > > > > > > >> > >> >>>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>>> The staging repository for this release > can > > be > > > > > found > > > > > > >> > >> >>> at: > > > > > > >> > >> >>>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>> > > > > > > >> > >> >>>>>>> > > > > > > >> > >> >>>> > > > > > > >> > >> > > > > > > >> > > > > > > > https://repository.apache.org/content/repositories/orgapacheflink-1021 > > > > > > >> > >> >>>>>>>>>>>>>> > > > > > > >> > >> >>>>> > > > > > ------------------------------------------------------------- > > > > > > >> > >> >>>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>>> Please vote on releasing this package as > > > Apache > > > > > > Flink > > > > > > >> > >> >>>>> 0.8.0. > > > > > > >> > >> >>>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>>> The vote is open for the next 72 hours and > > > > passes > > > > > > if a > > > > > > >> > >> >>>>>> majority > > > > > > >> > >> >>>>>>>> of > > > > > > >> > >> >>>>>>>>> at > > > > > > >> > >> >>>>>>>>>>>>>> least > > > > > > >> > >> >>>>>>>>>>>>>> three +1 PMC votes are cast. > > > > > > >> > >> >>>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>>> [ ] +1 Release this package as Apache > Flink > > > > 0.8.0 > > > > > > >> > >> >>>>>>>>>>>>>> [ ] -1 Do not release this package because > > ... > > > > > > >> > >> >>>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>>> > > > > > > >> > >> >>>>>>>>>> > > > > > > >> > >> >>>>>>>>> > > > > > > >> > >> >>>>>>>> > > > > > > >> > >> >>>>>>> > > > > > > >> > >> >>>>>> > > > > > > >> > >> >>>>> > > > > > > >> > >> >>>> > > > > > > >> > >> >>> > > > > > > >> > >> > > > > > > >> > >> > > > > > > >> > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
