Spark 1.4.0 - Custom built from source against Hortonworks HDP 2.2 (hadoop 2.6.0+) HDP 2.2 Cluster (Secure, kerberos)
spark-shell (--master yarn-client) launches fine and the prompt shows up. Clicking on the Application Master url on the YARN RM UI, throws 500 connect error. The same build works well against a non-secure cluster (same HDP distribution). No debug logs or stack trace is easily visible. Where do I look for what is going wrong ? And has anything changed in spark security that could be contributing to this ? Thank you for your help with this. Regards, Nachiketa