Hi Kevin, could you check what's on the class path of the Flink cluster? You should see this in the jobmanager.log at the top. It seems as if there is a Hadoop dependency with a lower version. Flink 1.7 is build against which Hadoop version? You should make sure that you either use the Hadoop-free version of the version where the Hadoop version is >= 2.7. Not sure what option EMR offers here.
Cheers, Till On Tue, Feb 26, 2019 at 12:23 AM Bohinski, Kevin (Contractor) < kevin_bohin...@comcast.com> wrote: > When running Flink 1.7 on EMR 5.21 using StreamingFileSink we see > java.lang.UnsupportedOperationException: Recoverable writers on Hadoop are > only supported for HDFS and for Hadoop version 2.7 or newer. EMR is showing > Hadoop version 2.8.5. Is anyone else seeing this issue? >
