Yes, please open a JIRA ticket.
On 30/08/2019 18:46, Elise RAMÉ wrote:
Thank you all !
Classpath option works for me and is easier so I’ll do this way.
About flink-shaded and vendor-repos, would it be helpful if I describe
this issue in a Jira ticket ?
Le 30 août 2019 à 11:43, Chesnay Schepler <ches...@apache.org
<mailto:ches...@apache.org>> a écrit :
It appears we did not port the vendor-repos profile to flink-shaded.
If the classpath option is not viable in your case (for example
because you cannot use child-first classloading), then currently you
would have to setup the vendor repos yourself in your local maven
installation.
On 29/08/2019 18:48, Stephan Ewen wrote:
The easiest thing is to build Flink against a specific Hadoop
version at all, but just to take plain Flink (Hadoop free) and
export the HADOOP_CLASSPATH variable to point to the vendor libraries.
Does that work for you?
On Thu, Aug 29, 2019 at 4:15 PM Elise RAMÉ
<elise.r...@telecomnancy.net <mailto:elise.r...@telecomnancy.net>>
wrote:
Hi all,
I need to build Flink 1.9 against a vendor specific Hadoop
version and something bother me in the Building Flink from
Source documentation
<https://ci.apache.org/projects/flink/flink-docs-release-1.9/flinkDev/building.html#custom--vendor-specific-versions>
(1.9
and 1.10-SNAPSHOT versions).
As far as I understand this documentation, I have to build
flink-shaded <https://github.com/apache/flink-shaded> using the
vendor-repos Maven profile :
/mvn clean install -DskipTests -Pvendor-repos
-Dhadoop.version=2.7.3.2.6.5.0-292/
I tried it using flink-shaded 7.0 (given version in Flink
downloads page), 8.0 version or master branch and always got the
same error (attached screenshot) :
<maven-error.png>
It seems to me that flink-shaded-hadoop module has been moved
from Flink to flink-shaded recently and I found the expected
profile in Flink pom.xml file :
https://github.com/apache/flink/blob/3079d11913f153ec40c75afb5356fd3be1a1e550/pom.xml#L1037
So I succeed in building flink-shaded and then Flink against my
specific version of Hadoop by adding this profile into
flink-shaded pom.xml first.
Didn’t I understand the documentation or vendor-repos profile
has indeed to be defined into flink-shaded pom.xml ?
Thanks,
Elise
