Zeppelin pres
Hi I remember sometimes back we discussed a place to list past/future events in which Zeppelin has been/will be presented. I dont remember where this information is stored. Can someone refresh my mind? Cheers Guillaume
Re: Dockerfile?
I think this one runs on Ubuntu https://hub.docker.com/r/aquila/zeppelin/ On Sunday, 5 June 2016, Luciano Resende wrote: > Or you could provide a PR and enhance what is already there :) > > On Sun, Jun 5, 2016 at 11:09 AM, Darren Govoni > wrote: > >> Thanks. I will share my dockerfile once I get it working too. >> >> >> >> Sent from my Verizon Wireless 4G LTE smartphone >> >> >> Original message >> From: Luciano Resende > > >> Date: 06/05/2016 1:48 PM (GMT-05:00) >> To: users@zeppelin.apache.org >> >> Subject: Re: Dockerfile? >> >> This is not Ubuntu based, but can give you some help: >> >> Spark base: >> https://github.com/lresende/docker-spark >> >> Zeppelin (using the above spark base): >> https://github.com/lresende/docker-systemml-notebook >> >> This is pre-r dependencies, so I still need to update with R. >> >> >> >> On Sun, Jun 5, 2016 at 10:07 AM, Darren Govoni > > wrote: >> >>> Hi >>> >>> Does anyone know of an updated docker file that builds latest zeppelin, >>> spark, hadoop etc. Ubuntu based? >>> >>> Thanks >>> Darren >>> >>> >>> >>> Sent from my Verizon Wireless 4G LTE smartphone >>> >> >> >> >> -- >> Luciano Resende >> http://twitter.com/lresende1975 >> http://lresende.blogspot.com/ >> > > > > -- > Luciano Resende > http://twitter.com/lresende1975 > http://lresende.blogspot.com/ > -- PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net
Review on notebook
Hi Tomorrow with a colleague, I will be presenting Apache Zeppelin to the Toulouse Data Science. The demo will be based on the following notebook: https://www.zeppelinhub.com/viewer/notebooks/bm90ZTovL3RvZy9Mb2NhbFplcHBlbGluLzUxODMvbm90ZS5qc29u It is inspired by some work from Carol Mc Donald (mapR) - we added some stuff & a couple of visualization. Feel free to have a look All comments and improvements are welcome :-) Thanks to Bala & Sunil for reviewing the code and finding some issues! Cheers Guillaume
Support %sh
Hi
My question is related to %sh. Shall we expect a full support of bash ?
I was playing trying to simplify Anish's notebook and come down to the
following snipplet which is working with bash locally but not in a
paragraph probably due to the ${}
Any comment? Shall I consider this as a bug?
Cheers
Guillaume
#! /bin/bash
# this paragraph downloads the datasets used in the analysis of this
notebook
# create the directory for storing the datasets
DIR=data/transportation
mkdir -p $DIR && cd $DIR
URLS=('
http://ec.europa.eu/eurostat/estat-navtree-portlet-prod/BulkDownloadListing?sort=1&downfile=data%2Ftran_r_net.tsv.gz'
'
http://ec.europa.eu/eurostat/estat-navtree-portlet-prod/BulkDownloadListing?sort=1&downfile=data%2Ftran_hv_psmod.tsv.gz'
'
http://ec.europa.eu/eurostat/estat-navtree-portlet-prod/BulkDownloadListing?sort=1&downfile=data%2Filc_hcmp06.tsv.gz
')
NAMES=(RailRoadWtrNet.tsv.gz PassenTransMode.tsv.gz PopDistPubTran.tsv.gz)
for i in $(seq 0 $((${#URLS[*]}-1)))
do
wget ${URLS[i]} -O ${NAMES[i]}
done
Angular issue
Hi I was on my way testing angular when I noticed this behavior. https://www.zeppelinhub.com/viewer/notebooks/bm90ZTovL3RvZy9Mb2NhbFplcHBlbGluLzUzMDUvbm90ZS5qc29u What am I doing wrong? Cheers Guillaume
Re: Angular issue
Thanks Teja for noticing that stupid error ;-) !
On Sat, 2 Jul 2016 at 23:57 TEJA SRIVASTAV wrote:
> html syntax is wrong
>
> current: echo -e "%angular Click
> {{run}}<\button>"
> mistake: echo -e "%angular Click {{run}}
> *<\b*utton>"
> expected: echo -e "%angular Click {{run}}
> *"
>
> can u try this
>
>
> On Sun, Jul 3, 2016 at 2:53 AM tog wrote:
>
>> Hi
>>
>> I was on my way testing angular when I noticed this behavior.
>>
>>
>> https://www.zeppelinhub.com/viewer/notebooks/bm90ZTovL3RvZy9Mb2NhbFplcHBlbGluLzUzMDUvbm90ZS5qc29u
>>
>> What am I doing wrong?
>>
>> Cheers
>> Guillaume
>>
>
Zeppelin on windows
Hi I have access to a HDP platform running on RedHat. I would like to install Zeppelin on my Windows 7 laptop and configure it to connect to the cluster. I possibly see one issue which is the As a first quick and dirty test, I have downloaded the 0.6 binary version and configured the "conf/zeppelin-env.cmd" where I have configured only the MASTER variable. A test give me the attached error. Is there some specific requirement on the windows machine (currently nothing specific is installed) ? I see at least one issue which is the the initialization of kerberos on the cluster, can this be handled by Shiro ? Cheers Guillaume zeppelin-interpreter-spark-alleon_g-TOLL302005470.log Description: Binary data
Re: [ANNOUNCE] Apache Zeppelin 0.6.1 released
Congrats to the team! On Tue, 16 Aug 2016 at 10:12 Alexander Bezzubov wrote: > Congratulations, everyone! > > And thank you Mina for putting it all together! > > https://twitter.com/ApacheZeppelin/status/765459508315303936 > > -- > Alex > > On Tue, Aug 16, 2016 at 4:57 PM, Mina Lee wrote: > >> The Apache Zeppelin community is pleased to announce the availability of >> the 0.6.1 release. >> >> Zeppelin is a collaborative data analytics and visualization tool for >> distributed, general-purpose data processing system such as Apache Spark, >> Apache Flink, etc. >> >> The community put significant effort into improving Apache Zeppelin since >> the last release, focusing on supporting Scala 2.11 and Spark 2.0. >> 22 contributors provided 80+ patches for new features, improvements >> and bug fixes. More than 60+ issues have been resolved. >> >> We encourage download the latest release from >> http://zeppelin.apache.org/download.html >> >> Release note is available at >> http://zeppelin.apache.org/releases/zeppelin-release-0.6.1.html >> >> We welcome your help and feedback. For more information on the project and >> how to get involved, visit our website at http://zeppelin.apache.org/ >> >> Thanks to all users and contributors who have helped to improve Apache >> Zeppelin. >> >> Regards, >> The Apache Zeppelin community >> >
Re: jdbc interpreter settings [pb with HIVE]
Hi Vinay Actually I succeeded using my default principal & password and using the following default url: jdbc:hive2://mycluster.bdata.corp:8443/;ssl=true;transportMode=http;httpPath=/gateway/pam/hive Still a problem remains when trying to access Hive from spark: %spark println(sc.version) val hiveContext = new org.apache.spark.sql.hive.HiveContext(sc); leads to: 1.5.2 java.io.IOException: Login failure for ta-1t77-bdata-...@bdata.corp from keytab /local/home/ta-1t77-bdata-gal/ta-1t77-bdata-gal.keytab: javax.security.auth.login.LoginException: Client not found in Kerberos database (6) at org.apache.hadoop.security.UserGroupInformation.loginUserFromKeytab(UserGroupInformation.java:962) at org.apache.spark.sql.hive.client.ClientWrapper.(ClientWrapper.scala:170) at org.apache.spark.sql.hive.HiveContext.executionHive$lzycompute(HiveContext.scala:164) at org.apache.spark.sql.hive.HiveContext.executionHive(HiveContext.scala:162) Any idea why? Cheers On Tue, 16 Aug 2016 at 21:38 tog wrote: > Hi Vinay > > Thanks for the quick answer. > I am a bit puzzled by your proposal. For the time being, I have been > succesful configuring Zeppelin without shiro by adding properties to the > Spark interpreter directly. > > Would it be possible to to the same with appropriate property settings for > the jdbc setting? > > One colleague also suggested to go through normal user/password but > pointing to a Knox URI instead of the normal hive one (+ some options) > > Cheers > Guillaume > > > On Tuesday, 16 August 2016, Vinay Shukla wrote: > >> Guillaume, >> >> Can you try this? >> >> Enable Zeppelin authentication, via Shiro config and have Kerberos setup >> for Zeppelin. Zeppelin JDBC interpreter should automatically add logged in >> user's identity to the JDBC connection after this confg. >> >> >> Note the settings below. >> >> Thanks, >> Vinay >> >> >> >> ÃIdentity Propagation with JDBC (Hive) >> 1.Enable Authentication via Shiro Config >> –zeppelin.jdbc.auth.type = KERBEROS >> –zeppelin.jdbc.principal = principal value >> –zeppelin.jdbc.keytab.location = keytab location >> •JDBC Interpreter will add end-user as >> jdbc:hive2://HiveHost:1/default;principal=hive/_h...@my-realm.com >> ;hive.server2.proxy.user=<$USER_NAME> >> >> On Tue, Aug 16, 2016 at 9:36 AM, Guillaume Alleon < >> guillaume.all...@gmail.com> wrote: >> >> > Hi >> > >> > I am a bit confused on the way to set up Zeppelin to use hive to access >> my >> > data on a kerberized cluster. >> > I looked at the doc and there is no mention about Kerberos settings. The >> > only place where I find some traces about that was in that pull request >> > from June: https://issues.apache.org/jira/plugins/servlet/mobile# >> > issue/ZEPPELIN-1146 >> > >> > Could someone confirm the properties that need to be set-up to configure >> > the jdbc interpreter so that I can use hive on a kerberized cluster. >> > >> > Thanks >> > Guillaume >> > >> > >> > >> > Sent from a small device >> > > > -- > PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net >
JDBC Interpreter
Hi I have installed Zeppelin so that it can connect to a HDP cluster. I have configured the jdbc interpreter to use HIVE - but I have a strange behavior (i.e. differences with what I get from Ambari) For example, the following *does work* with Ambari: show databases; use mydb; show tables; The following does work in Zeppelin: show databases But the following *does not*: - show databases; It can not compile the request due to the ; - use mydb returns a table having one row (Update count) of value -1 Is it a misunderstanding on my side - or I cannot chain commands like in Ambari? Cheers Guillaume
Re: JDBC Interpreter
Yes I understand but that will lead to weird notebooks with paragraph having one line and no meaningful output (like the one with use somedb). Would that make sense to output only the last command and have a similar behavior than ambari and it's hive view? At least I would suggest to have a more meaningful error message. Currently the interpreter seems to refuse any additional command - once you have tried to launch a series of semi-colon separated commands On Friday, 19 August 2016, Jongyoul Lee wrote: > Zeppelin's JDBC interpreter support single commands at once. That's > because Zeppelin cannot handle different multiple output within a paragraph. > > On Fri, Aug 19, 2016 at 1:50 AM, tog wrote: > >> Hi >> >> I have installed Zeppelin so that it can connect to a HDP cluster. >> >> I have configured the jdbc interpreter to use HIVE - but I have a strange >> behavior (i.e. differences with what I get from Ambari) >> >> For example, the following *does work* with Ambari: >> show databases; >> use mydb; >> show tables; >> >> The following does work in Zeppelin: >> show databases >> >> But the following *does not*: >> - show databases; >> It can not compile the request due to the ; >> >> - use mydb >> returns a table having one row (Update count) of value -1 >> >> Is it a misunderstanding on my side - or I cannot chain commands like in >> Ambari? >> >> Cheers >> Guillaume >> >> >> > > > -- > 이종열, Jongyoul Lee, 李宗烈 > http://madeng.net >
