Jeff- Thanks!! I figured the issue, I didn't need to copy the hive-site.xml
to spark_home/conf.
All I needed to do was set the SPARK_HOME environment variable in
"zeppelin-env.sh". That has made the local mode to work as well.
export SPARK_HOME=/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib
AFAIK, kerberos should not related here. ZEPPELIN-1175 just remove
ZEPPELIN_HOME/conf from the classpath of interpreter process. I guess you
put hive-site.xml under ZEPPELIN_HOME/conf, can you try to put it
under SPARK_HOME/conf ?
On Thu, Sep 1, 2016 at 10:01 AM, Pradeep Reddy
wrote:
> I just tr
I just tried enabling kerberos on 0.6.1 and its now able to talk to my hive
metastore, I see all my databases and tables. However the moment I takeout
kerberos and run zeppelin 0.6.1 in local mode by resetting the "master" &
removing spark variables, i see just one default database.
I can live wit
No luck, even after copying the hive-site.xml in interpreter/spark/depI
also tried, downloading 0.6.1 src vs 0.5.6. for the same steps I followed,
0.5.6 is able to talk to my hive metastore, where as the other recent
builds are not, they just show one "default" database.
Thanks,
Pradeep
On W
I think it's related to https://issues.apache.org/jira/browse/ZEPPELIN-1175
which remove some class path when Zeppelin launches interpreter. Could you
please check your hive-site.xml is included in your interpreter process? It
looks like a configuration issue because you can see the default databas
Hi Jongyoul- I followed the exact same steps for compiling and setting up
the new build from source as 0.5.6 (only difference is, I acquired the
source for latest build using "git clone")
hive-site.xml was copied to conf directory. But, the spark interpreter is
not talking to the hive metastore. B
Hello,
Do you copy your hive-site.xml in a proper position?
On Wed, Aug 31, 2016 at 3:52 PM, Pradeep Reddy
wrote:
> nothing obvious. I will stick to 0.5.6 build, until the latest builds
> stabilize.
>
> On Wed, Aug 31, 2016 at 1:39 AM, Jeff Zhang wrote:
>
>> Then I guess maybe you are connecti
nothing obvious. I will stick to 0.5.6 build, until the latest builds
stabilize.
On Wed, Aug 31, 2016 at 1:39 AM, Jeff Zhang wrote:
> Then I guess maybe you are connecting to different database. Why not using
> 'z.show(sql("databases"))' to display the databases ? Then you will get
> a hint wha
Then I guess maybe you are connecting to different database. Why not
using 'z.show(sql("databases"))'
to display the databases ? Then you will get a hint what's going on.
On Wed, Aug 31, 2016 at 2:36 PM, Pradeep Reddy
wrote:
> Yes...I didn't wish to show the names of the databases that we have
Yes...I didn't wish to show the names of the databases that we have in our
data lake on that screen shot. so thats why I chose to display the count.
The latest zeppelin build just shows 1 count which is "default" database.
Thanks,
Pradeep
On Wed, Aug 31, 2016 at 1:33 AM, Jeff Zhang wrote:
> 116
116 is the databases count number. Do you expect a list of database ? then
you need to use 'z.show(sql("databases"))'
On Wed, Aug 31, 2016 at 2:26 PM, Pradeep Reddy
wrote:
> Here it is Jeff
>
> [image: Inline image 1]
>
> On Wed, Aug 31, 2016 at 1:24 AM, Jeff Zhang wrote:
>
>> Hi Pradeep,
>>
>>
Here it is Jeff
[image: Inline image 1]
On Wed, Aug 31, 2016 at 1:24 AM, Jeff Zhang wrote:
> Hi Pradeep,
>
> I don't see the databases on your screenshot (second one for 0.5.6). I
> think the output is correct.
>
>
>
> On Wed, Aug 31, 2016 at 12:55 PM, Pradeep Reddy <
> pradeepreddy.a...@gmail.
Hi Pradeep,
I don't see the databases on your screenshot (second one for 0.5.6). I
think the output is correct.
On Wed, Aug 31, 2016 at 12:55 PM, Pradeep Reddy wrote:
> Hi Jeff- I was able to make Kerberos work in 0.5.6 zeppelin build. It
> seems like Kerberos not working & spark not able to
Hi Jeff- I was able to make Kerberos work in 0.5.6 zeppelin build. It seems
like Kerberos not working & spark not able to talk to the shared hive meta
store are defects in the current build.
On Tue, Aug 30, 2016 at 11:09 PM, Pradeep Reddy wrote:
> Hi Jeff-
>
> I switched to local mode now, I'm a
Hi Jeff-
I switched to local mode now, I'm able to summon the implicit objects like
sc, sqlContext etc., but it doesn't show my databases & tables, just shows
1 database "default".
Zeppelin Latest Build
[image: Inline image 3]
Zeppelin 0.5.6, running on the same machine, is able to show my data
> the spark interpreter is not showing my tables & databases, may be its
running in an isolated mode... I'm just getting empty list, so I attempted
to do kerberos authentication to workaround that issue, and bumped into
this road block.
kerberos would not help here, actually I think it would make
Jeff- I was also successfully able to run spark shell, after running
kdestroy, with the below command and was able to get to my hive tables.
spark-shell --conf spark.yarn.keytab=$HOME/pradeep.x.alla.keytab --conf
spark.yarn.principal=pradeep.x.alla --deploy-mode client --master yarn
--queue
On T
Thanks Jeff..I have always used zeppelin in local mode, but when I migrated
from 0.5.6 to this version, the spark interpreter is not showing my tables
& databases, may be its running in an isolated mode... I'm just getting
empty list, so I attempted to do kerberos authentication to workaround that
It looks like your kerberos configuration issue. Do you mind to share your
configuration ? Or you can first try to run spark-shell using
spark.yarn.keytab & spark.yarn.principle to verify them.
On Wed, Aug 31, 2016 at 6:12 AM, Pradeep Reddy
wrote:
> Hi- I recently built zeppelin from source and
Hi- I recently built zeppelin from source and configured kerberos
authentication. For Kerberos I added "spark.yarn.keytab" &
"spark.yarn.principal" and also set master to "yarn-client". But I keep
getting this error whenever I use spark interpreter in the notebook
3536728 started by scheduler
org
20 matches
Mail list logo
