Hi Yeshwant,

Which version of Zeppelin are you on?

If you are on latest then you don't need to do any of ZEPPELIN_IMPERSONATE_CMD
or ZEPPELIN_IMPERSONATE_SPARK_PROXY_USER. Just by enabling User
Impersonation check-box should be sufficient.

Can you confirm by `ps aux | grep spark`. This is what I see on my machine;

prabhjyotsingh@MACHINE:~/ps-zeppelin/logs$ ps aux | grep spark
prabhjyotsingh    2496   0.2  3.9  5179540 657660 s000  S    12:08PM
0:30.68
/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/bin/java
-cp
/Users/prabhjyotsingh/ps-zeppelin/interpreter/spark/*:/Users/prabhjyotsingh/ps-zeppelin/zeppelin-interpreter/target/lib/*:/Users/prabhjyotsingh/ps-zeppelin/zeppelin-interpreter/target/classes/:/Users/prabhjyotsingh/ps-zeppelin/zeppelin-interpreter/target/test-classes/:/Users/prabhjyotsingh/ps-zeppelin/zeppelin-zengine/target/test-classes/:/Users/prabhjyotsingh/ps-zeppelin/interpreter/spark/zeppelin-spark_2.10-0.8.0-SNAPSHOT.jar:/Users/prabhjyotsingh/spark-2.0.0-bin-hadoop2.7/conf/:/Users/prabhjyotsingh/spark-2.0.0-bin-hadoop2.7/jars/*
-Xmx1g -Dfile.encoding=UTF-8
-Dlog4j.configuration=file:///Users/prabhjyotsingh/ps-zeppelin/conf/log4j.properties
-Dzeppelin.log.file=/Users/prabhjyotsingh/ps-zeppelin/logs/zeppelin-interpreter-spark-user1-spark-prabhjyotsingh-HW11610.local.log
org.apache.spark.deploy.SparkSubmit --conf
spark.driver.extraClassPath=:/Users/prabhjyotsingh/ps-zeppelin/interpreter/spark/*:/Users/prabhjyotsingh/ps-zeppelin/zeppelin-interpreter/target/lib/*::/Users/prabhjyotsingh/ps-zeppelin/zeppelin-interpreter/target/classes:/Users/prabhjyotsingh/ps-zeppelin/zeppelin-interpreter/target/test-classes:/Users/prabhjyotsingh/ps-zeppelin/zeppelin-zengine/target/test-classes:/Users/prabhjyotsingh/ps-zeppelin/interpreter/spark/zeppelin-spark_2.10-0.8.0-SNAPSHOT.jar
--conf spark.driver.extraJavaOptions= -Dfile.encoding=UTF-8
-Dlog4j.configuration=file:///Users/prabhjyotsingh/ps-zeppelin/conf/log4j.properties
-Dzeppelin.log.file=/Users/prabhjyotsingh/ps-zeppelin/logs/zeppelin-interpreter-spark-user1-spark-prabhjyotsingh-HW11610.local.log
--class org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer
*--proxy-user
user1*
/Users/prabhjyotsingh/ps-zeppelin/interpreter/spark/zeppelin-spark_2.10-0.8.0-SNAPSHOT.jar
50911
prabhjyotsingh    2508   0.0  0.0  2445100    860 s000  S+   12:08PM
0:00.00 grep spark
prabhjyotsingh    2495   0.0  0.0  2465144    764 s000  S    12:08PM
0:00.00 /bin/bash /Users/prabhjyotsingh/ps-zeppelin/bin/interpreter.sh -d
/Users/prabhjyotsingh/ps-zeppelin/interpreter/spark -p 50911 -u user1 -l
/Users/prabhjyotsingh/ps-zeppelin/local-repo/2CEZC4JXN -g spark
prabhjyotsingh    2484   0.0  0.0  2465144   1368 s000  S    12:08PM
0:00.01 /bin/bash /Users/prabhjyotsingh/ps-zeppelin/bin/interpreter.sh -d
/Users/prabhjyotsingh/ps-zeppelin/interpreter/spark -p 50911 -u user1 -l
/Users/prabhjyotsingh/ps-zeppelin/local-repo/2CEZC4JXN -g spark

Ref: https://github.com/apache/zeppelin/pull/1840


On 10 May 2017 at 06:10, Yeshwanth Jagini <y...@yotabitesllc.com> wrote:

> Hi Users,
>
> I am trying to setup Zeppelin for multiple users.
> and i found there are multiple configurations in different places. started
> tinkering with them and i didn't had any luck .
> here's my setup and configuration.
>
> Zeppelin server is running as root.
>
> i edited zeppelin-env.sh  and uncommented
>
> export ZEPPELIN_IMPERSONATE_CMD='sudo -H -u ${ZEPPELIN_IMPERSONATE_USER}
> bash -c'       # Optional, when user want to run interpreter as end web
> user. eg) 'sudo -H -u ${ZEPPELIN_IMPERSONATE_USER} bash -c '
> export ZEPPELIN_IMPERSONATE_SPARK_PROXY_USER=true  #Optional, by default
> is true; can be set to false if you don't want to use --proxy-user option
> with Spark interpreter when impersonation enabled
>
> and  the interpreter settings are as follows
>
> [image: Inline image 1]
>
>
> for different combination of configurations i am getting different types
> of errors
>
> if i do not specify impersonation configuration in zeppelin-env.sh  and
> specify impersonation in interpreter setting i am getting a
> org.apache.zeppelin.interpreter.InterpreterException: Host key
> verification failed.
> if i specify both zeppelin impersonation configuration and interpreter
> impersonation config, it's throwing error as user1 cannot impersonate user1
>
> if i do not specify any impersonation configuration at all , interpreter
> is launching spark-submit as root. that's expected.
>
> could some one please explain me how to set impersonation config and
> which configuration i am messing up here
>
>
> Thanks,
> Yeshwanth Jagini
>



-- 

Warm Regards,

Prabhjyot Singh

Reply via email to