It would be good to have the patch, but it is also a very tricky patch, so pushing it hastily may be problematic.
We could put out 0.8 and very soon a 0.8.1 with that fix. Am 12.01.2015 11:12 schrieb "Till Rohrmann" <[email protected]>: > I only have to fix a last dead lock and then the fix should be working. > > On Mon, Jan 12, 2015 at 11:06 AM, Ufuk Celebi <[email protected]> wrote: > > > Thanks, Marton. Yes, I think > > https://issues.apache.org/jira/browse/FLINK-1376. > > > > Till has a fix coming up for it. Should we wait for this or postpone it > to > > 0.8.1? > > > > – Ufuk > > > > On 12 Jan 2015, at 10:16, Márton Balassi <[email protected]> > wrote: > > > > > Based on the requests listed in this thread Stephan and myself > > > cherry-picked the following commits: > > > > > > 7634310 [FLINK-1266] Generalize DistributedFileSystem implementation > > > (rmetzger) > > > 40a2705 [FLINK-1266] Update mongodb link and address pull request > > comments > > > (rmetzger) > > > cd66ced [FLINK-1266] Properly pass the fs.defaulFS setting when > > > initializing … (rmetzger) > > > 3bf2d21 [FLINK-1266] More dependency exclusions (rmetzger) > > > e8ab5b7 [FLINK-1266] Backport fix to 0.8 (rmetzger) > > > 7cd0f47 [docs] Prepare documentation for 0.8 release (rmetzger) > > > e83ccd0 [FLINK-1385] Print warning if not resources are _currently_ > > > available… (rmetzger) > > > > > > 4f9dcae [FLINK-1378] [scala] Fix type extraction for nested type > > parameters > > > (aljoscha) > > > fced2eb [FLINK-1378] Add support for Throwables in KryoSerializer > > (aljoscha) > > > ada35eb [FLINK-1378] [scala] Add support for Try[A] > > > (Success/Failure) (aljoscha) > > > > > > a64abe1 [docs] Update README and internals (scheduling) for graduation > > and > > > fi… (SephanEwen) > > > 4f95ce7 Fix typo in README.md (uce) > > > > > > Both of us committed some other fixes mainly for the dependencies and > > > licences, the distribution and the quickstarts. Pushing the results as > > soon > > > as the tests pass. > > > > > > Does anyone have any other issue that has to be included in the next > > > release candidate? > > > > > > > > > On Sat, Jan 10, 2015 at 7:34 PM, Robert Metzger <[email protected]> > > wrote: > > > > > >> I've tested it on an empty YARN cluster, allocating more containers > than > > >> available. > > >> Flink will then allocate as many containers as possible. > > >> > > >> On Sat, Jan 10, 2015 at 7:31 PM, Stephan Ewen <[email protected]> > wrote: > > >> > > >>> Seems reasonable. Have you tested it on a cluster with concurrent > YARN > > >>> jobs? > > >>> > > >>> On Sat, Jan 10, 2015 at 7:28 PM, Robert Metzger <[email protected] > > > > >>> wrote: > > >>> > > >>>> I would really like to include this commit into the 0.8 release as > > >> well: > > >>>> > > >>>> > > >>> > > >> > > > https://github.com/apache/flink/commit/ec2bb573d185429f8b3efe111850b8f0e67f2704 > > >>>> A user is affected by this issue. > > >>>> If you agree, I can merge it. > > >>>> > > >>>> On Sat, Jan 10, 2015 at 7:25 PM, Stephan Ewen <[email protected]> > > >> wrote: > > >>>> > > >>>>> I have gone through the code, cleaned up dependencies and made sure > > >>> that > > >>>>> all licenses are correctly handled. > > >>>>> The changes are in the public release-0.8 branch. > > >>>>> > > >>>>> From that side, the code is now good to go in my opinion. > > >>>>> > > >>>>> > > >>>>> Stephan > > >>>>> > > >>>>> > > >>>>> On Sat, Jan 10, 2015 at 12:30 PM, Robert Metzger < > > >> [email protected]> > > >>>>> wrote: > > >>>>> > > >>>>>> I've updated the docs/_config.yml variables to reflect that > hadoop2 > > >>> is > > >>>>> now > > >>>>>> the default profile: https://github.com/apache/flink/pull/294 > > >>>>>> > > >>>>>> On Fri, Jan 9, 2015 at 8:52 PM, Stephan Ewen <[email protected]> > > >>> wrote: > > >>>>>> > > >>>>>>> Just as a heads up. I am almost through with checking > > >> dependencies > > >>>> and > > >>>>>>> licenses. > > >>>>>>> Will commit that later tonight or tomorrow. > > >>>>>>> > > >>>>>>> On Fri, Jan 9, 2015 at 7:09 PM, Stephan Ewen <[email protected]> > > >>>> wrote: > > >>>>>>> > > >>>>>>>> I vote to include it as well. It is sort of vital for advanced > > >>> use > > >>>> of > > >>>>>> the > > >>>>>>>> Scala API. > > >>>>>>>> > > >>>>>>>> It is also an isolated change that does not affect other > > >>>> components, > > >>>>> so > > >>>>>>> it > > >>>>>>>> should be testable very well. > > >>>>>>>> > > >>>>>>>> On Fri, Jan 9, 2015 at 7:05 PM, Robert Metzger < > > >>>> [email protected]> > > >>>>>>>> wrote: > > >>>>>>>> > > >>>>>>>>> I'd say yes because its affecting a user. > > >>>>>>>>> > > >>>>>>>>> On Fri, Jan 9, 2015 at 7:00 PM, Aljoscha Krettek < > > >>>>> [email protected] > > >>>>>>> > > >>>>>>>>> wrote: > > >>>>>>>>> > > >>>>>>>>>> I have a fix for this issue: > > >>>>>>>>>> > > >>>>>>>>> > > >>>>>>> > > >>>>>> > > >>>>> > > >>>> > > >>> > > >> > > > https://issues.apache.org/jira/browse/FLINK-1378?jql=project%20%3D%20FLINK > > >>>>>>>>>> and I think this should also make it into the 0.8.0 release. > > >>>>>>>>>> > > >>>>>>>>>> What do you think? > > >>>>>>>>>> > > >>>>>>>>>> On Fri, Jan 9, 2015 at 3:28 PM, Márton Balassi < > > >>>>>>>>> [email protected]> > > >>>>>>>>>> wrote: > > >>>>>>>>>>> Sure, thanks Ufuk. > > >>>>>>>>>>> > > >>>>>>>>>>> On Fri, Jan 9, 2015 at 3:15 PM, Ufuk Celebi < > > >> [email protected] > > >>>> > > >>>>>> wrote: > > >>>>>>>>>>> > > >>>>>>>>>>>> Marton, could you also cherry-pick 7f659f6 and 7e08fa1 > > >> for > > >>>> the > > >>>>>> next > > >>>>>>>>> RC? > > >>>>>>>>>>>> It's a minor update to the README describing the IDE > > >> setup. > > >>>>>>>>>>>> > > >>>>>>>>>>>> I will closed the respective issue FLINK-1109. > > >>>>>>>>>>>> > > >>>>>>>>>>>> On 08 Jan 2015, at 23:50, Henry Saputra < > > >>>>> [email protected] > > >>>>>>> > > >>>>>>>>>> wrote: > > >>>>>>>>>>>> > > >>>>>>>>>>>>> Marton, could you close this VOTE thread by replying to > > >>> the > > >>>>>>>>> original > > >>>>>>>>>>>>> email and append [CANCEL] in the subject line. > > >>>>>>>>>>>>> > > >>>>>>>>>>>>> - Henry > > >>>>>>>>>>>>> > > >>>>>>>>>>>>> On Thu, Jan 8, 2015 at 9:35 AM, Márton Balassi < > > >>>>>>>>>> [email protected]> > > >>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>> Cherry-picked and tested: found no duplicate > > >>> dependencies > > >>>> in > > >>>>>>> lib, > > >>>>>>>>>> yarn > > >>>>>>>>>>>>>> uberjar build goes without the mentioned warns. > > >>>>>>>>>>>>>> Travis tests are passing, pushing soon. > > >>>>>>>>>>>>>> > > >>>>>>>>>>>>>> On Thu, Jan 8, 2015 at 4:57 PM, Stephan Ewen < > > >>>>>> [email protected]> > > >>>>>>>>>> wrote: > > >>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> Nice. > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> @Marton: As soon as as you are done, I make a pass > > >> over > > >>>> the > > >>>>>>>>>> licenses... > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> Stephan > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> On Thu, Jan 8, 2015 at 4:42 PM, Robert Metzger < > > >>>>>>>>> [email protected] > > >>>>>>>>>>> > > >>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>> Allright. The travis tests are green and I tested it > > >>>> again > > >>>>>>> with > > >>>>>>>>>>>> Tachyon > > >>>>>>>>>>>>>>> on > > >>>>>>>>>>>>>>>> a cluster. > > >>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>> My pull request also fixes some of the issues > > >>> mentioned > > >>>>>>> earlier > > >>>>>>>>> in > > >>>>>>>>>>>> this > > >>>>>>>>>>>>>>>> thread by Stephan (the warnings from shading > > >> regarding > > >>>>>>> duplicate > > >>>>>>>>>>>>>>> classes). > > >>>>>>>>>>>>>>>> I can not fix all of them because some projects like > > >>>>> hadoop > > >>>>>>> just > > >>>>>>>>>> have > > >>>>>>>>>>>> the > > >>>>>>>>>>>>>>>> "conflicts" in their dependencies. > > >>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>> I'll merge the pull request to master. > > >>>>>>>>>>>>>>>> Marton can merge it to "release-0.8". > > >>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>> On Thu, Jan 8, 2015 at 2:42 PM, Stephan Ewen < > > >>>>>>> [email protected]> > > >>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> Robert, can you let us know once the PR is merged? > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> Then we can start with the next steps... > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> On Thu, Jan 8, 2015 at 2:07 PM, Robert Metzger < > > >>>>>>>>>> [email protected]> > > >>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>> Please wait with merging 268. There is still a > > >> minor > > >>>>> open > > >>>>>>>>> issue. > > >>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>> On Thu, Jan 8, 2015 at 1:28 PM, Márton Balassi < > > >>>>>>>>>>>>>>>> [email protected] > > >>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> +1 for merging PR 268, volunteering for the > > >> merge. > > >>> It > > >>>>>>> should > > >>>>>>>>>> also > > >>>>>>>>>>>>>>>> solve > > >>>>>>>>>>>>>>>>>> the > > >>>>>>>>>>>>>>>>>>> issue mentioned by Stephan with the yarn uberjar. > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> Updating the release scripts and doing a > > >>> double-check > > >>>>> on > > >>>>>>> the > > >>>>>>>>>>>>>>>> cosmetics. > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> On Thu, Jan 8, 2015 at 12:55 PM, Stephan Ewen < > > >>>>>>>>> [email protected] > > >>>>>>>>>>> > > >>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>> We just found and fixed another highly critical > > >>> bug. > > >>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>> I vote to also cherry pick commit > > >>>>>>>>>>>>>>>>>>>> 19066b520435528e104a69ccf372f56811123ee3 > > >>>> ([FLINK-1371] > > >>>>>>>>>>>>>>>>>>>> [runtime] Fix KryoSerializer to not swallow > > >>>>>> EOFExceptions) > > >>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>> On Thu, Jan 8, 2015 at 11:55 AM, Robert Metzger > > >> < > > >>>>>>>>>>>>>>>> [email protected] > > >>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> +1 for merging pull request 268. It makes Flink > > >>>> even > > >>>>>> more > > >>>>>>>>>>>>>>>>> compatible > > >>>>>>>>>>>>>>>>>>> with > > >>>>>>>>>>>>>>>>>>>>> hadoop. > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> regarding the documentation: I already updated > > >>> the > > >>>>>> build > > >>>>>>>>>>>>>>>>>> instructions. > > >>>>>>>>>>>>>>>>>>>> But > > >>>>>>>>>>>>>>>>>>>>> we should double check everything again. > > >>>>>>>>>>>>>>>>>>>>> I probably won't have time to look into this > > >>> today > > >>>>>>> however. > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> On Thu, Jan 8, 2015 at 11:50 AM, Stephan Ewen < > > >>>>>>>>>>>>>>> [email protected]> > > >>>>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>> After the dependencies are cleaned up > > >> (Robert's > > >>>> pull > > >>>>>>>>> request > > >>>>>>>>>>>>>>>>>>>>>> https://github.com/apache/flink/pull/268 > > >> solves > > >>>>>> that), > > >>>>>>> we > > >>>>>>>>>>>>>>> need > > >>>>>>>>>>>>>>>>> to > > >>>>>>>>>>>>>>>>>>> also > > >>>>>>>>>>>>>>>>>>>>> do > > >>>>>>>>>>>>>>>>>>>>>> the following: > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>> - Make a pass over dependencies to ensure that > > >>>>> NOTICE > > >>>>>>> and > > >>>>>>>>>>>>>>>>> LICENSE > > >>>>>>>>>>>>>>>>>>>> files > > >>>>>>>>>>>>>>>>>>>>>> are up to date (both source and bin > > >>> distribution) > > >>>>>>>>>>>>>>>>>>>>>> - Adjust the variables in the docs to reflect > > >>> the > > >>>>> fact > > >>>>>>>>> that > > >>>>>>>>>>>>>>>>>> hadoop2 > > >>>>>>>>>>>>>>>>>>> is > > >>>>>>>>>>>>>>>>>>>>> now > > >>>>>>>>>>>>>>>>>>>>>> the default profile > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>> I would volunteer for the first task. > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>> Stephan > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>> On Wed, Jan 7, 2015 at 10:01 PM, Stephan Ewen > > >> < > > >>>>>>>>>>>>>>>> [email protected]> > > >>>>>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>> I also see a warning when building the yarn > > >> fat > > >>>>> jar. > > >>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>> This is a consequence of the duplicate > > >>>>> dependencies. > > >>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] servlet-api-3.0.20100224.jar, > > >>>>>>>>>>>>>>>>>>> javax.servlet-api-3.0.1.jar, > > >>>>>>>>>>>>>>>>>>>>>>> javax.servlet-3.1.jar, servlet-api-2.5.jar > > >>> define > > >>>>> 42 > > >>>>>>>>>>>>>>>>> overlappping > > >>>>>>>>>>>>>>>>>>>>>> classes: > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - javax.servlet.http.Cookie > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>> javax.servlet.http.HttpSessionBindingEvent > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >> javax.servlet.http.NoBodyResponse > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - javax.servlet.ServletContext > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >> javax.servlet.ServletOutputStream > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>> javax.servlet.http.HttpSessionListener > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>> javax.servlet.http.HttpSessionContext > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - javax.servlet.FilterChain > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - javax.servlet.GenericServlet > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>> javax.servlet.http.HttpServletRequestWrapper > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - 32 more... > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] hadoop-yarn-api-2.2.0.jar, > > >>>>>>>>>>>>>>>>> hadoop-yarn-common-2.2.0.jar > > >>>>>>>>>>>>>>>>>>>>> define > > >>>>>>>>>>>>>>>>>>>>>> 3 > > >>>>>>>>>>>>>>>>>>>>>>> overlappping classes: > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>> org.apache.hadoop.yarn.util.package-info > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>> org.apache.hadoop.yarn.factories.package-info > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>>>>>>>>>>> > > >>> org.apache.hadoop.yarn.factory.providers.package-info > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] asm-4.0.jar, asm-3.1.jar define 21 > > >>>>>>> overlappping > > >>>>>>>>>>>>>>>>>> classes: > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - org.objectweb.asm.Type > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>> org.objectweb.asm.AnnotationVisitor > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - org.objectweb.asm.MethodVisitor > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - org.objectweb.asm.Attribute > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - org.objectweb.asm.FieldWriter > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>> org.objectweb.asm.signature.SignatureWriter > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - org.objectweb.asm.MethodWriter > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - org.objectweb.asm.Edge > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - org.objectweb.asm.Handler > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - org.objectweb.asm.ByteVector > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - 11 more... > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] javax.servlet-api-3.0.1.jar, > > >>>>>>>>>>>>>>> javax.servlet-3.1.jar, > > >>>>>>>>>>>>>>>>>>>>>>> servlet-api-3.0.20100224.jar define 32 > > >>>> overlappping > > >>>>>>>>>>>>>>> classes: > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>> javax.servlet.annotation.HttpConstraint > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - javax.servlet.DispatcherType > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>>>>>>>>>> javax.servlet.descriptor.JspPropertyGroupDescriptor > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - javax.servlet.Registration > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >> javax.servlet.SessionTrackingMode > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>> javax.servlet.annotation.ServletSecurity$EmptyRoleSemantic > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>> javax.servlet.annotation.HandlesTypes > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >> javax.servlet.ServletRegistration > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>> javax.servlet.annotation.ServletSecurity > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>> javax.servlet.ServletContainerInitializer > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - 22 more... > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] jasper-compiler-5.5.23.jar, > > >>>>>>>>>>>>>>>> jasper-runtime-5.5.23.jar > > >>>>>>>>>>>>>>>>>>>> define > > >>>>>>>>>>>>>>>>>>>>> 1 > > >>>>>>>>>>>>>>>>>>>>>>> overlappping classes: > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>> org.apache.jasper.compiler.Localizer > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] commons-collections-3.2.1.jar, > > >>>>>>>>>>>>>>>>>>> commons-beanutils-1.7.0.jar, > > >>>>>>>>>>>>>>>>>>>>>>> commons-beanutils-core-1.8.0.jar define 10 > > >>>>>> overlappping > > >>>>>>>>>>>>>>>>> classes: > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>>>>>>>>>> org.apache.commons.collections.FastHashMap$EntrySet > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>>>>>>>>> org.apache.commons.collections.FastHashMap$KeySet > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>> org.apache.commons.collections.ArrayStack > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>> > > >>>>>>>>>> > > >>>>>>>>> > > >>>>>>> > > >>>>>> > > >>>>> > > >>>> > > >>> > > >> > > > org.apache.commons.collections.FastHashMap$CollectionView$CollectionViewIterator > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>>>>>>>>> org.apache.commons.collections.FastHashMap$Values > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>>>>>>>>>>>>> > > >>>>>> org.apache.commons.collections.FastHashMap$CollectionView > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>> org.apache.commons.collections.FastHashMap$1 > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>> org.apache.commons.collections.Buffer > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>> org.apache.commons.collections.FastHashMap > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>>>>>>>>>>>> > > >>>> org.apache.commons.collections.BufferUnderflowException > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] commons-beanutils-1.7.0.jar, > > >>>>>>>>>>>>>>>>>>>> commons-beanutils-core-1.8.0.jar > > >>>>>>>>>>>>>>>>>>>>>>> define 82 overlappping classes: > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>> org.apache.commons.beanutils.ConvertUtilsBean > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>>>>>>>>>>>>> > > >>>>> org.apache.commons.beanutils.converters.SqlTimeConverter > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>> org.apache.commons.beanutils.Converter > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>> org.apache.commons.beanutils.converters.FloatArrayConverter > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>>>>>>>>> org.apache.commons.beanutils.NestedNullException > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>>>>>>>>>> org.apache.commons.beanutils.ConvertingWrapDynaBean > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>> org.apache.commons.beanutils.converters.LongArrayConverter > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>>>>>>>>>>>>> > > >>>>> org.apache.commons.beanutils.converters.SqlDateConverter > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>> org.apache.commons.beanutils.converters.BooleanArrayConverter > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - > > >>>>>>>>>>>>>>>>>>> > > >>>> org.apache.commons.beanutils.converters.StringConverter > > >>>>>>>>>>>>>>>>>>>>>>> [WARNING] - 72 more... > > >>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>> On Wed, Jan 7, 2015 at 9:08 PM, Robert > > >> Metzger > > >>> < > > >>>>>>>>>>>>>>>>>>> [email protected]> > > >>>>>>>>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>> ... I did some more checks: > > >>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>> The hadoop200alpha version has some issues > > >>> with > > >>>>> the > > >>>>>>>>> hadoop > > >>>>>>>>>>>>>>>>>>>> dependency > > >>>>>>>>>>>>>>>>>>>>>>>> exclusions. I fixed the issues in this pull > > >>>>> request: > > >>>>>>>>>>>>>>>>>>>>>>>> https://github.com/apache/flink/pull/268. > > >> The > > >>>>>>>>> dependency > > >>>>>>>>>>>>>>>>>>> exclusions > > >>>>>>>>>>>>>>>>>>>>> for > > >>>>>>>>>>>>>>>>>>>>>>>> hadoop are basically disabled because they > > >> are > > >>>>>>>>> overwritten > > >>>>>>>>>>>>>>>> by > > >>>>>>>>>>>>>>>>>> the > > >>>>>>>>>>>>>>>>>>>>>>>> hadoop200alpha profile. This causes issues > > >>> like > > >>>>> two > > >>>>>>> asm > > >>>>>>>>>>>>>>>>> versions > > >>>>>>>>>>>>>>>>>>>> (4.0 > > >>>>>>>>>>>>>>>>>>>>>> and > > >>>>>>>>>>>>>>>>>>>>>>>> 3.2) in the lib/ folder. > > >>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>> Very cosmetic: > > >>>>>>>>>>>>>>>>>>>>>>>> - We can update the urls in the README.txt / > > >>>>>> README.md > > >>>>>>>>> of > > >>>>>>>>>>>>>>>> the > > >>>>>>>>>>>>>>>>>>> binary > > >>>>>>>>>>>>>>>>>>>>>>>> releases. They contain > > >>>>>>>>>>>>>>>>>>>>>>>> http://flink.incubator.apache.org > > >>>>>>>>>>>>>>>>>>>>>>>> https://github.com/apache/incubator-flink > > >>>>>>>>>>>>>>>>>>>>>>>> [email protected] > > >>>>>>>>>>>>>>>>>>>>>>>> [email protected] > > >>>>>>>>>>>>>>>>>>>>>>>> Which all don't need the "incubator" anymore > > >>>>>>>>> (mailinglists > > >>>>>>>>>>>>>>>>>> should > > >>>>>>>>>>>>>>>>>>>> work > > >>>>>>>>>>>>>>>>>>>>>> as > > >>>>>>>>>>>>>>>>>>>>>>>> well, but we need to verify) > > >>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>> Positive checks: > > >>>>>>>>>>>>>>>>>>>>>>>> - No incubator notices > > >>>>>>>>>>>>>>>>>>>>>>>> - Example plan preview is working for all > > >>>> examples > > >>>>>>>>>>>>>>>>>>>>>>>> - All examples are running with build-in > > >> data, > > >>>>>>> submitted > > >>>>>>>>>>>>>>>> from > > >>>>>>>>>>>>>>>>>> the > > >>>>>>>>>>>>>>>>>>>> web > > >>>>>>>>>>>>>>>>>>>>>>>> interface > > >>>>>>>>>>>>>>>>>>>>>>>> - scala examples (some) > > >>>>>>>>>>>>>>>>>>>>>>>> - streaming examples (some) > > >>>>>>>>>>>>>>>>>>>>>>>> - No exceptions or WARN log messages > > >> occurred > > >>>>> after > > >>>>>> a > > >>>>>>>>>>>>>>> "start > > >>>>>>>>>>>>>>>>> jm > > >>>>>>>>>>>>>>>>>> / > > >>>>>>>>>>>>>>>>>>>> web > > >>>>>>>>>>>>>>>>>>>>>> --> > > >>>>>>>>>>>>>>>>>>>>>>>> all java batch examples --> stop everything" > > >>>>> cycle. > > >>>>>>>>>>>>>>>>>>>>>>>> - ./bin/flink also works for the wordcount > > >>>> example > > >>>>>> ;) > > >>>>>>>>>>>>>>>>>>>>>>>> - no binaries in the src archive > > >>>>>>>>>>>>>>>>>>>>>>>> - the source archive builds (mvn clean > > >>> install) > > >>>>>>>>> (including > > >>>>>>>>>>>>>>>> rat > > >>>>>>>>>>>>>>>>>>>> license > > >>>>>>>>>>>>>>>>>>>>>>>> header check, checkstyle and all tests) > > >>>>>>>>>>>>>>>>>>>>>>>> - gpg signatures are valid: gpg --verify > > >>>>>>>>>>>>>>>>>> flink-0.8.0-src.tgz.asc > > >>>>>>>>>>>>>>>>>>>>>>>> flink-0.8.0-src.tgz > > >>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>> On Wed, Jan 7, 2015 at 7:55 PM, Robert > > >>> Metzger < > > >>>>>>>>>>>>>>>>>>> [email protected] > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>> -1 > > >>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>> There is a major issue with the hadoop1 and > > >>>>> hadoop2 > > >>>>>>>>>>>>>>>>> versions: > > >>>>>>>>>>>>>>>>>> We > > >>>>>>>>>>>>>>>>>>>>> made > > >>>>>>>>>>>>>>>>>>>>>>>>> hadoop2 the default profile, so the 0.8.0 > > >>>> version > > >>>>>>> will > > >>>>>>>>>>>>>>>> pull > > >>>>>>>>>>>>>>>>>> the > > >>>>>>>>>>>>>>>>>>>>>> hadoop2 > > >>>>>>>>>>>>>>>>>>>>>>>>> dependencies. > > >>>>>>>>>>>>>>>>>>>>>>>>> We basically need an explicit 0.8.0-hadoop1 > > >>>>> version > > >>>>>>>>> now. > > >>>>>>>>>>>>>>>>>>>>>>>>> The release candidate contains a 0.8.0 > > >>> version > > >>>>>> which > > >>>>>>>>> has > > >>>>>>>>>>>>>>>>>> hadoop2 > > >>>>>>>>>>>>>>>>>>>>>>>> activated > > >>>>>>>>>>>>>>>>>>>>>>>>> by default, the 0.8.0-hadoop2 version also > > >>> has > > >>>>>>> hadoop2 > > >>>>>>>>>>>>>>>>>> activated > > >>>>>>>>>>>>>>>>>>>> by > > >>>>>>>>>>>>>>>>>>>>>>>>> default. In this release candidate, there > > >> is > > >>> no > > >>>>> way > > >>>>>>> for > > >>>>>>>>>>>>>>>>> users > > >>>>>>>>>>>>>>>>>> to > > >>>>>>>>>>>>>>>>>>>>>> depend > > >>>>>>>>>>>>>>>>>>>>>>>> on > > >>>>>>>>>>>>>>>>>>>>>>>>> a hadoop1 flink dependency. > > >>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>> In general, we should warn users that the > > >>>> default > > >>>>>>>>> hadoop > > >>>>>>>>>>>>>>>>>>>>> dependencies > > >>>>>>>>>>>>>>>>>>>>>>>> have > > >>>>>>>>>>>>>>>>>>>>>>>>> changed with the release! > > >>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>> I suggest to wait a bit with the next RC to > > >>>>> collect > > >>>>>>>>> more > > >>>>>>>>>>>>>>>>>>> feedback > > >>>>>>>>>>>>>>>>>>>> on > > >>>>>>>>>>>>>>>>>>>>>> the > > >>>>>>>>>>>>>>>>>>>>>>>>> release candidate. > > >>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>> On Wed, Jan 7, 2015 at 7:37 PM, Márton > > >>> Balassi > > >>>> < > > >>>>>>>>>>>>>>>>>>>> [email protected] > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>> Please vote on releasing the following > > >>>> candidate > > >>>>>> as > > >>>>>>>>>>>>>>>> Apache > > >>>>>>>>>>>>>>>>>>> Flink > > >>>>>>>>>>>>>>>>>>>>>>>> version > > >>>>>>>>>>>>>>>>>>>>>>>>>> 0.8.0 > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>> This release will be the first major > > >> release > > >>>> for > > >>>>>>> Flink > > >>>>>>>>>>>>>>>> as a > > >>>>>>>>>>>>>>>>>> top > > >>>>>>>>>>>>>>>>>>>>> level > > >>>>>>>>>>>>>>>>>>>>>>>>>> project. > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> > > >>>>>> ------------------------------------------------------------- > > >>>>>>>>>>>>>>>>>>>>>>>>>> The commit to be voted on is in the branch > > >>>>>>>>>>>>>>>>>> "release-0.8.0-rc1" > > >>>>>>>>>>>>>>>>>>>>>>>>>> (commit 8c30f60): > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> > > >>>>>> https://git-wip-us.apache.org/repos/asf/flink/commit/8c30f60 > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>> The release artifacts to be voted on can > > >> be > > >>>>> found > > >>>>>>> at: > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>> http://people.apache.org/~mbalassi/flink-0.8.0-rc1/ > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>> Release artifacts are signed with the > > >>>> following > > >>>>>> key: > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>> https://people.apache.org/keys/committer/mbalassi.asc > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>> The staging repository for this release > > >> can > > >>> be > > >>>>>> found > > >>>>>>>>>>>>>>> at: > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>> > > >>>>>>>>>>>> > > >>>>>>>>> > > >>>>>> > > >>> > https://repository.apache.org/content/repositories/orgapacheflink-1021 > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> > > >>>>>> ------------------------------------------------------------- > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>> Please vote on releasing this package as > > >>>> Apache > > >>>>>>> Flink > > >>>>>>>>>>>>>>>>> 0.8.0. > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>> The vote is open for the next 72 hours and > > >>>>> passes > > >>>>>>> if a > > >>>>>>>>>>>>>>>>>> majority > > >>>>>>>>>>>>>>>>>>>> of > > >>>>>>>>>>>>>>>>>>>>> at > > >>>>>>>>>>>>>>>>>>>>>>>>>> least > > >>>>>>>>>>>>>>>>>>>>>>>>>> three +1 PMC votes are cast. > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>> [ ] +1 Release this package as Apache > > >> Flink > > >>>>> 0.8.0 > > >>>>>>>>>>>>>>>>>>>>>>>>>> [ ] -1 Do not release this package because > > >>> ... > > >>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>> > > >>>>>>>>>>>> > > >>>>>>>>>> > > >>>>>>>>> > > >>>>>>>> > > >>>>>>>> > > >>>>>>> > > >>>>>> > > >>>>> > > >>>> > > >>> > > >> > > > > >
