It looks like your kerberos configuration issue. Do you mind to share your
configuration ? Or you can first try to run spark-shell using
spark.yarn.keytab & spark.yarn.principle to verify them.
On Wed, Aug 31, 2016 at 6:12 AM, Pradeep Reddy <pradeepreddy.a...@gmail.com>
wrote:
> Hi- I recently built zeppelin from source and configured kerberos
> authentication. For Kerberos I added "spark.yarn.keytab" &
> "spark.yarn.principal" and also set master to "yarn-client". But I keep
> getting this error whenever I use spark interpreter in the notebook
>
> 3536728 started by scheduler org.apache.zeppelin.spark.
> SparkInterpreter335845091
> ERROR [2016-08-30 17:45:37,237] ({pool-2-thread-2} Job.java[run]:189) -
> Job failed
> java.lang.IllegalArgumentException: Invalid rule: L
> RULE:[2:$1@$0](.*@\Q<DOMAIN1>.COM\E$)s/@\Q<DOMAIN1>\E$//L
> RULE:[1:$1@$0](.*@\Q<DOMAIN2>\E$)s/@\Q<DOMAIN2>\E$//L
> RULE:[2:$1@$0](.*@\Q<DOMAIN2>\E$)s/@\Q<DOMAIN2>\E$//L
> DEFAULT
> at org.apache.hadoop.security.authentication.util.
> KerberosName.parseRules(KerberosName.java:321)
> at org.apache.hadoop.security.authentication.util.
> KerberosName.setRules(KerberosName.java:386)
> at org.apache.hadoop.security.HadoopKerberosName.setConfiguration(
> HadoopKerberosName.java:75)
> at org.apache.hadoop.security.UserGroupInformation.initialize(
> UserGroupInformation.java:227)
> at org.apache.hadoop.security.UserGroupInformation.
> ensureInitialized(UserGroupInformation.java:214)
> at org.apache.hadoop.security.UserGroupInformation.
> isAuthenticationMethodEnabled(UserGroupInformation.java:275)
> at org.apache.hadoop.security.UserGroupInformation.
> isSecurityEnabled(UserGroupInformation.java:269)
> at org.apache.hadoop.security.UserGroupInformation.
> loginUserFromKeytab(UserGroupInformation.java:820)
> at org.apache.zeppelin.spark.SparkInterpreter.open(
> SparkInterpreter.java:539)
> at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(
> LazyOpenInterpreter.java:69)
> at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(
> LazyOpenInterpreter.java:93)
> at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$
> InterpretJob.jobRun(RemoteInterpreterServer.java:383)
> at org.apache.zeppelin.scheduler.Job.run(Job.java:176)
> at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(
> FIFOScheduler.java:139)
> at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> INFO [2016-08-30 17:45:37,247] ({pool-2-thread-2}
> SchedulerFactory.java[jobFinished]:137)
> - Job remoteInterpretJob_1472593536728 finished by scheduler
> org.apache.zeppelin.spark.SparkInterpreter335845091
>
> Thanks,
> Pradeep
>
>
--
Best Regards
Jeff Zhang
