I think I found a workaround. Instead of reading Avro files as GenericRecords, if I read them as specific records and then use a map to convert (typecast) them as GenericRecord, the problem goes away.
I ran some tests and so far this workaround seems to be working in my local setup. -Tarandeep On Wed, May 11, 2016 at 10:24 PM, Tarandeep Singh <tarand...@gmail.com> wrote: > Hi, > > I am using DataSet API and reading Avro files as DataSet<GenericRecord>. I > am seeing this weird behavior that record is read correctly from file > (verified by printing all values) but when when this record is passed to > Flink chain/DAG (e.g. KeySelector), every field in this record has the same > value as the first field value. Even more weird is they values are of > different types, e.g. I have a record Query with two fields key (integer) > and query (String). When the record was read from file, correct values were > read (e.g. 100, "apache flink"). But when I print/check values in > KeySelector, I get (100, 100). > > I saw similar post on stackoverflow- > > http://stackoverflow.com/questions/37115618/apache-flink-union-operator-giving-wrong-response > > Any idea what might be happening? > Any workaround will be greatly appreciated. > > Thank you, > Tarandeep > >
