Thanks a lot! Please keep me updated with this :)
On 19 June 2017 at 6:33:15 PM, Flavio Pompermaier (pomperma...@okkam.it) wrote:
Ok, I'll let you know as soon as I recompile Flink 1.3.x.
Thanks,
Flavio
On Mon, Jun 19, 2017 at 7:26 AM, Tzu-Li (Gordon) Tai
wrote:
Hi Flavio,
It’s most likely
Ok, I'll let you know as soon as I recompile Flink 1.3.x.
Thanks,
Flavio
On Mon, Jun 19, 2017 at 7:26 AM, Tzu-Li (Gordon) Tai
wrote:
> Hi Flavio,
>
> It’s most likely related to a problem with Maven.
> I’m pretty sure this actually isn’t a problem anymore. Could you verify by
> rebuilding Flink
Hi Flavio,
It’s most likely related to a problem with Maven.
I’m pretty sure this actually isn’t a problem anymore. Could you verify by
rebuilding Flink and see if the problem remains? Thanks a lot.
Best,
Gordon
On 16 June 2017 at 6:25:10 PM, Tzu-Li (Gordon) Tai (tzuli...@apache.org) wrote:
Th
That’s actually what I’m trying to figure out right now, what had changed since
then ...
On 16 June 2017 at 12:23:57 PM, Flavio Pompermaier (pomperma...@okkam.it) wrote:
I've never tested with flink 1.3.0, I have the problem with Flink 1.2.1. Didn't
you say that you also had non-shaded guava d
I've never tested with flink 1.3.0, I have the problem with Flink 1.2.1.
Didn't you say that you also had non-shaded guava dependencies in the flink
dist jar some days ago?
On Fri, Jun 16, 2017 at 12:19 PM, Tzu-Li (Gordon) Tai
wrote:
> Hi Flavio,
>
> I was just doing some end-to-end rebuild Flin
Hi Flavio,
I was just doing some end-to-end rebuild Flink + cluster execution with ES sink
tests, and it seems like the Guava shading problem isn’t there anymore in the
flink-dist jar.
On the `release-1.3` branch, built with Maven 3.0.5, the Guava dependencies in
flink-dist are all properly sh
Hi Gordon,
any news on this?
On Mon, Jun 12, 2017 at 9:54 AM, Tzu-Li (Gordon) Tai
wrote:
> This seems like a shading problem then.
> I’ve tested this again with Maven 3.0.5, even without building against CDH
> Hadoop binaries the flink-dist jar contains non-shaded Guava dependencies.
>
> Let me
This seems like a shading problem then.
I’ve tested this again with Maven 3.0.5, even without building against CDH
Hadoop binaries the flink-dist jar contains non-shaded Guava dependencies.
Let me investigate a bit and get back to this!
Cheers,
Gordon
On 8 June 2017 at 2:47:02 PM, Flavio Pomper
On an empty machine (with Ubuntu 14.04.5 LTS) and an empty maven local repo
I did:
1. git clone https://github.com/apache/flink.git && cd flink && git
checkout tags/release-1.2.1
2. /opt/devel/apache-*maven-3.3.9*/bin/mvn clean install
-Dhadoop.version=2.6.0-cdh5.9.0 -Dhbase.version=1.
Yes, those should not be in the flink-dist jar, so the root reason should be
that the shading isn’t working properly for your custom build.
If possible, could you try building Flink again with a lower Maven version as
specified in the doc, and see if that works?
If so, it could be that Maven 3.3
What I did was to take the sources of the new ES connector and I took them
into my code.
Flink was compiled with maven 3.3+ but I did the double compilation as
specified in the Flink build section.
In flink dist I see guava classes, e.g.:
com/google/common/util/concurrent/MoreExecutors$1.class
com
Ah, I assumed you were running 1.3.0 (since you mentioned “new” ES connector).
Another thing to check, if you built Flink yourself, make sure you’re not using
Maven 3.3+. There are shading problems when Flink is built with Maven versions
higher then that.
The flink-dist jar should not contain an
I shaded the Elasticsearch dependency [1] and now the job works.
So I cannot run a job that needs guava 18 on Flink 1.2.1...
[1] https://www.elastic.co/blog/to-shade-or-not-to-shade
On Wed, Jun 7, 2017 at 5:33 PM, Tzu-Li (Gordon) Tai
wrote:
> Hi Flavio,
>
> Could there be another dependency in
Hi Flavio,
Could there be another dependency in your job that requires a conflicting
version (w.r.t. ES 2.4.1) of Guava?
I’ve just double checked the flink-dist jar, there doesn’t seem to be any
non-shaded Guava dependencies there, so the conflict should not have been
caused by Flink.
Cheers,
14 matches
Mail list logo
