Hi Stephan, With previous versions, I tried around 1.7, I always had to compile MapR hadoop to get it working. With 1.9 I took hadoop-less Flink, which worked with MapR FS until I switched on HA. So it is hard to say if this is regression or not.
The error happens when Flink tries to initialize BLOB storage on MapR FS. Without HA it takes zookeeper from classpath (MapR org.apache.zookeeper) and with HA it takes shaded one. After fixing couple of issue with pom, I was able to compile Flink with MapR zookeeper and now when I start with HA mode it uses shaded zookeeper (which is now MapR) to initialize BLOB and org.apache.zookeeper (which is as well MapR) for HA recovery. It works, but, I was expecting it to work without compiling MapR dependencies. Hope this helps, Maxim. On Thu, Aug 29, 2019 at 7:00 PM Stephan Ewen <se...@apache.org> wrote: > Hi Maxim! > > The change of the MapR dependency should not have an impact on that. > Do you know if the same thing worked in prior Flink versions? Is that a > regression in 1.9? > > The exception that you report, is that from Flink's HA services trying to > connect to ZK, or from the MapR FS client trying to connect to ZK? > > Best, > Stephan > > > On Tue, Aug 27, 2019 at 11:03 AM Maxim Parkachov <lazy.gop...@gmail.com> > wrote: > >> Hi everyone, >> >> I'm testing release 1.9 on MapR secure cluster. I took flink binaries >> from download page and trying to start Yarn session cluster. All MapR >> specific libraries and configs are added according to documentation. >> >> When I start yarn-session without high availability, it uses zookeeper >> from MapR distribution (org.apache.zookeeper) and correctly connects to >> cluster and access to maprfs works as expected. >> >> But if I add zookeeper as high-avalability option, instead of MapR >> zookeeper it tries to use shaded zookeeper and this one could not connect >> with mapr credentials: >> >> 2019-08-27 10:42:45,240 ERROR >> org.apache.flink.shaded.zookeeper.org.apache.zookeeper.client.ZooKeeperSaslClient >> - An error: (java.security.PrivilegedActionException: >> javax.security.sasl.SaslException: GSS initiate failed [Caused by >> GSSException: No valid credentials provided (Mechanism level: Failed to find >> any Kerberos tgt)]) occurred when evaluating Zookeeper Quorum Member's >> received SASL token. Zookeeper Client will go to AUTH_FAILED state. >> 2019-08-27 10:42:45,240 ERROR >> org.apache.flink.shaded.zookeeper.org.apache.zookeeper.ClientCnxn - SASL >> authentication with Zookeeper Quorum member failed: >> javax.security.sasl.SaslException: An error: >> (java.security.PrivilegedActionException: javax.security.sasl.SaslException: >> GSS initiate failed [Caused by GSSException: No valid credentials provided >> (Mechanism level: Failed to find any Kerberos tgt)]) occurred when >> evaluating Zookeeper Quorum Member's received SASL token. Zookeeper Client >> will go to AUTH_FAILED state. >> I tried to use separate zookeeper cluster for HA, but maprfs still doesn't >> work. >> >> Is this related to removal of MapR specific settings in Release 1.9 ? >> Should I still compile custom version of Flink with MapR dependencies ? >> (trying to do now, but getting some errors during compilation). >> >> Can I somehow force flink to use MapR zookeeper even with HA mode ? >> >> Thanks in advance, >> Maxim. >> >>
