Re: Flink 1.4.0-RC2 Hadoop Build

2017-12-04 Thread Stephan Ewen
Hi! Here is the issue: https://issues.apache.org/jira/browse/FLINK-8196 Fix coming up... Stephan On Mon, Dec 4, 2017 at 6:45 PM, Vijay Srinivasaraghavan < vijikar...@yahoo.com> wrote: > Hi Aljoscha, > > >> Regarding the issue you discovered, I think we have to revert a commit > that added exc

Re: Flink 1.4.0-RC2 Hadoop Build

2017-12-04 Thread Vijay Srinivasaraghavan
Hi Aljoscha, >> Regarding the issue you discovered, I think we have to revert a commit that >> added exclusions that were too aggressive. Is there a JIRA for this?  RegardsVijay On Monday, December 4, 2017 1:16 AM, Aljoscha Krettek wrote: Hi, The behaviour with Flink 1.4 is that we w

Re: Flink 1.4.0-RC2 Hadoop Build

2017-12-04 Thread Aljoscha Krettek
Hi, The behaviour with Flink 1.4 is that we will always include Hadoop dependencies unless we explicitly exclude them via "-DwithoutHadoop". If you build without any flags you will get the default Hadoop version which currently is 2.4.1. Regarding the issue you discovered, I think we have to re

Re: Flink 1.4.0-RC2 Hadoop Build

2017-12-03 Thread Vijay Srinivasaraghavan
The issue is reproducible with 2.7.1 as well. My understanding is from 1.4.0 we don't include Hadoop dependencies by default but only when we explicitly enable the particular Hadoop version. However, when I build it normally using "mvn clean install -DskipTests", the Hadoop dependencies are ge

Re: Flink 1.4.0-RC2 Hadoop Build

2017-12-03 Thread Stephan Ewen
Hmmm, this is caused by a missing dependency (javax.servlet). Could be that this dependency is newly excluded, or that this issue only exists with Hadoop 2.7.0 (HDFS release tests have worked with both newer and older Hadoop versions). Here is what I think we should do - Can you check whether t

Flink 1.4.0-RC2 Hadoop Build

2017-12-01 Thread Vijay Srinivasaraghavan
Hello, I am trying to build and run Flink from 1.4.0-rc2 branch with hadoop binary 2.7.0 compatibility. Here are the steps I followed to build (I have maven 3.3.9). ===cd $FLINK_HOMEmvn clean install -DskipTests -Dhadoop.vers