Thanks a lot! Please keep me updated with this :)
On 19 June 2017 at 6:33:15 PM, Flavio Pompermaier (pomperma...@okkam.it) wrote:
Ok, I'll let you know as soon as I recompile Flink 1.3.x.
Thanks,
Flavio
On Mon, Jun 19, 2017 at 7:26 AM, Tzu-Li (Gordon) Tai
wrote:
Hi Flavio,
It’s most likely
Ok, I'll let you know as soon as I recompile Flink 1.3.x.
Thanks,
Flavio
On Mon, Jun 19, 2017 at 7:26 AM, Tzu-Li (Gordon) Tai
wrote:
> Hi Flavio,
>
> It’s most likely related to a problem with Maven.
> I’m pretty sure this actually isn’t a problem anymore. Could you verify by
> rebuilding Flink
Hi Flavio,
It’s most likely related to a problem with Maven.
I’m pretty sure this actually isn’t a problem anymore. Could you verify by
rebuilding Flink and see if the problem remains? Thanks a lot.
Best,
Gordon
On 16 June 2017 at 6:25:10 PM, Tzu-Li (Gordon) Tai (tzuli...@apache.org) wrote:
Th
That’s actually what I’m trying to figure out right now, what had changed since
then ...
On 16 June 2017 at 12:23:57 PM, Flavio Pompermaier (pomperma...@okkam.it) wrote:
I've never tested with flink 1.3.0, I have the problem with Flink 1.2.1. Didn't
you say that you also had non-shaded guava d
I've never tested with flink 1.3.0, I have the problem with Flink 1.2.1.
Didn't you say that you also had non-shaded guava dependencies in the flink
dist jar some days ago?
On Fri, Jun 16, 2017 at 12:19 PM, Tzu-Li (Gordon) Tai
wrote:
> Hi Flavio,
>
> I was just doing some end-to-end rebuild Flin
Hi Flavio,
I was just doing some end-to-end rebuild Flink + cluster execution with ES sink
tests, and it seems like the Guava shading problem isn’t there anymore in the
flink-dist jar.
On the `release-1.3` branch, built with Maven 3.0.5, the Guava dependencies in
flink-dist are all properly sh
Hi Gordon,
any news on this?
On Mon, Jun 12, 2017 at 9:54 AM, Tzu-Li (Gordon) Tai
wrote:
> This seems like a shading problem then.
> I’ve tested this again with Maven 3.0.5, even without building against CDH
> Hadoop binaries the flink-dist jar contains non-shaded Guava dependencies.
>
> Let me
This seems like a shading problem then.
I’ve tested this again with Maven 3.0.5, even without building against CDH
Hadoop binaries the flink-dist jar contains non-shaded Guava dependencies.
Let me investigate a bit and get back to this!
Cheers,
Gordon
On 8 June 2017 at 2:47:02 PM, Flavio Pomper
On an empty machine (with Ubuntu 14.04.5 LTS) and an empty maven local repo
I did:
1. git clone https://github.com/apache/flink.git && cd flink && git
checkout tags/release-1.2.1
2. /opt/devel/apache-*maven-3.3.9*/bin/mvn clean install
-Dhadoop.version=2.6.0-cdh5.9.0 -Dhbase.version=1.
Yes, those should not be in the flink-dist jar, so the root reason should be
that the shading isn’t working properly for your custom build.
If possible, could you try building Flink again with a lower Maven version as
specified in the doc, and see if that works?
If so, it could be that Maven 3.3
What I did was to take the sources of the new ES connector and I took them
into my code.
Flink was compiled with maven 3.3+ but I did the double compilation as
specified in the Flink build section.
In flink dist I see guava classes, e.g.:
com/google/common/util/concurrent/MoreExecutors$1.class
com
Ah, I assumed you were running 1.3.0 (since you mentioned “new” ES connector).
Another thing to check, if you built Flink yourself, make sure you’re not using
Maven 3.3+. There are shading problems when Flink is built with Maven versions
higher then that.
The flink-dist jar should not contain an
I shaded the Elasticsearch dependency [1] and now the job works.
So I cannot run a job that needs guava 18 on Flink 1.2.1...
[1] https://www.elastic.co/blog/to-shade-or-not-to-shade
On Wed, Jun 7, 2017 at 5:33 PM, Tzu-Li (Gordon) Tai
wrote:
> Hi Flavio,
>
> Could there be another dependency in
Hi Flavio,
Could there be another dependency in your job that requires a conflicting
version (w.r.t. ES 2.4.1) of Guava?
I’ve just double checked the flink-dist jar, there doesn’t seem to be any
non-shaded Guava dependencies there, so the conflict should not have been
caused by Flink.
Cheers,
Hi to all,
I'm trying to use the new ES connector to index data from Flink (with ES
2.4.1).
When I try to run it from Eclipse everything is ok, when I run it from the
cluster I get the following exception:
java.lang.NoSuchMethodError: com.google.common.util.
concurrent.MoreExecutors.directExecutor
15 matches
Mail list logo
