One thing to be aware of when testing Flink 1.4 is the changes to
dependencies and classloading.
By default, Flink 1.4 uses now inverted classloading to allow users to use
their own copies of dependencies, irrespective of what the underlying
classpath is spoiled with. You can for example use a dif
I think this Avro issue might be related:
https://issues.apache.org/jira/browse/AVRO-803
> On 7. Dec 2017, at 17:19, Timo Walther wrote:
>
> Hi Jörn,
>
> thanks for the little example. Maybe Avro changed the behavior about maps
> from the old version we used in 1.3 to the newest version in Fl
Hi Jörn,
thanks for the little example. Maybe Avro changed the behavior about
maps from the old version we used in 1.3 to the newest version in Flink
1.4.0.
I will investigate this and might open an issue for it.
Regards,
Timo
Am 12/7/17 um 5:07 PM schrieb Joern Kottmann:
Hello Timo,
tha
Hello Timo,
thanks for your quick response. I can't share the code of that pipeline here.
The Flink version I am using is this one:
http://people.apache.org/~aljoscha/flink-1.4.0-rc3/flink-1.4.0-src.tgz
That was compiled by me with mvn install -DskipTests (for some reason
the tests failed, can a
Can you also check the type of the keys in your map. Avro distinguished
between String and Utf8 class. Maybe this is why your key cannot be found.
Regards,
Timo
Am 12/7/17 um 3:54 PM schrieb Timo Walther:
Hi Jörn,
could you tell us a bit more about your job? Did you import the
flink-avro mo
Hi Jörn,
could you tell us a bit more about your job? Did you import the
flink-avro module? How does the Flink TypeInformation for your Avro type
look like using println(ds.getType)? It sounds like a very weird error
if the toString() method shows the key. Can you reproduce the error in
your
Hello,
after having a version mismatch between Avro in Flink 1.3.2 I decided
to see how things work with Flink 1.4.0.
The pipeline I am building runs now, deployed as standalone on YARN
with Flink 1.3.2 and putting it "FIRST" on the classpath (to use Avro
1.8.2 instead of an 1.7.x version).
The
