Re: Kerberos setup in Apache spark connecting to remote HDFS/Yarn

2016-06-17 Thread Sudarshan Rangarajan
Hi Ami, Did you try setting spark.yarn.principal and spark.yarn.keytab as configuration properties, passing in their corresponding Kerberos values ? Search for these properties on http://spark.apache.org/docs/latest/running-on-yarn.html to learn more about what's expected for them. Regards, Suda

User impersonation with Kerberos and Delegation tokens

2016-05-25 Thread Sudarshan Rangarajan
Hi there, I'm using SparkLauncher API from Spark v1.6.1, to submit a Spark job to YARN. The service from where this API will be invoked will need to talk to other services on our cluster via Kerberos (ex. HDFS, YARN etc.). Also, my service expects to impersonate its then logged-in user during job