Re: Example - Reading Avro Generic records

2016-04-02 Thread Tarandeep Singh
Thank you Gna for opening the ticket. I looked into AvroInputFormat code and inspired by it I wrote a GenericAvroInputFormat. The code is awfully similar (and hence redundant) to original AvroInputFormat, so it is a good idea to modify AvroInputFormat in flink to support GenericRecord. Anyways, I

Re: YARN session application attempts

2016-04-02 Thread Ufuk Celebi
Hey Stefano, yarn.resourcemanager.am.max-attempts is a setting for your YARN cluster and cannot be influenced by Flink. Flink cannot set a higher number than this for yarn.application-attempts. The key that is set/overriden by Flink is probably only valid for the YARN session, but I'm not too fam

Re: YARN High Availability

2016-04-02 Thread Ufuk Celebi
Hey Konstantin, That's weird. Can you please log the client output on DEBUG level and provide that as well? I'm wondering whether the client uses a different root path. The following seems to happen: - you use ledf_recovery as the root namespace - the task managers are connecting (they resolve th