Re: 2FA for Zeppelin login

2021-03-16 Thread James Srinivasan
You might want to look at something like keycloak in front of your zeppelin server, or integrate keycloak and shiro. On Tue, 16 Mar 2021, 02:33 Jeff Zhang, wrote: > I am not familiar with 2FA, since zeppelin is using shiro, so as long > shiro support that zeppelin can support 2FA > > > Rahul Jai

Re: Zeppelin Spark user impersonation works - but why?

2019-10-15 Thread James Srinivasan
Turns out ambari-agent is my friend and was periodically renewing the ticket for me. Hurrah! Thanks for the pointers, James On Tue, 15 Oct 2019 at 08:05, James Srinivasan wrote: > > No, I don't specify any keytabs in the config files. However, I have > several Zeppelin instances

Re: Zeppelin Spark user impersonation works - but why?

2019-10-15 Thread James Srinivasan
? > > James Srinivasan 于2019年10月15日周二 上午10:35写道: >> >> No, and in any case I don't think that works when proxying users? >> >> On Tue, 15 Oct 2019, 02:25 Jeff Zhang, wrote: >>> >>> Do you specify spark.yarn.keytab somewhere ? >>> >>&g

Re: Zeppelin Spark user impersonation works - but why?

2019-10-14 Thread James Srinivasan
No, and in any case I don't think that works when proxying users? On Tue, 15 Oct 2019, 02:25 Jeff Zhang, wrote: > Do you specify spark.yarn.keytab somewhere ? > > James Srinivasan 于2019年10月15日周二 上午4:01写道: > >> I'm testing Zeppelin 0.8.2, using AD for user authentic

Zeppelin Spark user impersonation works - but why?

2019-10-14 Thread James Srinivasan
I'm testing Zeppelin 0.8.2, using AD for user authentication and Spark with user impersonation. If I log into my zeppelin host as the zeppelin (domain) user, check I have a Kerberos ticket using klist, start zeppelin and then run some Spark code (yarn-cluster), everything is fine - the Spark job i

Re: thrift.transport.TTransportException

2019-10-01 Thread James Srinivasan
I'm guessing you might have conflicting versions of libthrift on your classpath On Tue, 1 Oct 2019, 08:44 Jeff Zhang, wrote: > It looks like you are using pyspark, could you try just start scala spark > interpreter via `%spark` ? First let's figure out whether it is related > with pyspark. > > >

Re: Any way to diagnose TTransportException errors?

2019-09-04 Thread James Srinivasan
tps://www.linkedin.com/company/placeiq/> > [image: Experian Makes Strategic Investment In PlaceIQ] > <https://www.placeiq.com/2019/08/experian-makes-strategic-investment-in-placeiq/> > [image: PlaceIQ: Oracle Data Cloud Premier Data Provider] > <http://go.placeiq.com/WC01DP

Re: Any way to diagnose TTransportException errors?

2019-09-02 Thread James Srinivasan
Is there a chance you have differing versions of libthrift on your classpath? I've seen errors (admittedly not looking like yours) for that reason? James On Sun, 1 Sep 2019 at 00:57, Paul Brenner wrote: > We are using a recent build post 0.81 so 0.82? > > Restarting the interpreter helps in 75%

Re: Restarting interpreter for user in a user isolated, note scoped process

2019-07-29 Thread James Srinivasan
We've been hitting similar issues - Spark interpreter configured to run per user in an isolated process, then per note in a scoped process - the intention being that each user has their own Spark interpreter (e.g. for resource allocation and queuing) but that that interpreter can be isolated betwee

Re: Spark job fails when zeppelin.spark.useNew is true

2019-05-23 Thread James Srinivasan
We use Geomesa on Accumulo with Spark and Zeppelin on a Kerberized cluster (hdp3). We've had a number of issues, but that one doesn't look familiar. >From memory, we had to: Build geomesa spark with Accumulo version to match our cluster, and libthrift to match Accumulo, and another version change

Re: Zeppelin 0.8.1 & Spark User Impersonation

2019-04-04 Thread James Srinivasan
2019 at 20:17, James Srinivasan wrote: > > I'm using Zeppelin 0.8.1 with a Kerberized HDP 3 cluster. Without user > impersonation, it seems fine. With user impersonation, I get the > following stack trace trying to run println(sc.version). Google > suggest libthrift incompatib

Zeppelin 0.8.1 & Spark User Impersonation

2019-03-21 Thread James Srinivasan
I'm using Zeppelin 0.8.1 with a Kerberized HDP 3 cluster. Without user impersonation, it seems fine. With user impersonation, I get the following stack trace trying to run println(sc.version). Google suggest libthrift incompatibilities, but the one jar I could find is the same on 0.8.0 vs 0.8.1 (I

Confusion around Interpreter Binding mode

2019-02-27 Thread James Srinivasan
Hi all, We have Zeppelin configured to run spark2 Per user in isolated process then Per note in isolated process I'm seeing more YARN jobs that I expected. With a single user, I'm currently running two separate notebooks, yet have five YARN jobs. Does "Per note" mean per paragraph in the noteboo