How can I use pyspark in zeppelin?

2017-02-23 Thread Beth Lee
I installed spark-2.1.0-bin-hadoop2.7.tgz and zeppelin-0.7.0-bin-all.tgz in ubuntu. I set the zeppelin-env.sh like below. export PYTHONPATH=/usr/bin/python export PYSPARK_PYTHON=/home/jin/spark/python So I try to use pyspark in the zeppelin notebook. %spark.pyspark print(2+2)

Re: Real-time Updated Plots with Kafka

2017-02-23 Thread Mich Talebzadeh
you can use zeppelin scheduler to execute it every few seconds assuming that zeppelin has sufficient to execute every instance of the code Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

PySpark: Dependencies and scripts through Zeppelin

2017-02-23 Thread William Markito Oliveira
What's the right way to package scripts and distribute dependencies (conda environments) with Zeppelin ? I'm currently using the variable zeppelin.pyspark.python from the Spark interpreter set to my conda environment python, but still when I submit the jobs and they start executing I do get "No mo

Re: [DISCUSS] Admin feature

2017-02-23 Thread Ruslan Dautkhanov
I do like the idea of the Admin feature. It complements Multitenancy very well. Not every user should be able to change global settings that affect all users. Also most of our Zeppelin users have only high-level understanding of Spark and can only write sql queries. So the admin feature helps with

Can I call sub-function in Zeppelin?

2017-02-23 Thread Beth Lee
Zeppelin supports auto-complete function in a notebook. So I enter the ctrl+. in my notebook to use it. But I can only show the lists which I typed it before. Is there any way to call sub-function using the auto-complete function in python or spark etc.? (In case of python: When I enter the tab t

Re: How can I use anaconda in zeppelin?

2017-02-23 Thread Beth Lee
Thank you I try using it. Thanks, Jin 2017-02-23 15:55 GMT+09:00 moon soo Lee : > If you're using '%python', not '%pyspark', you can try %python.conda to > change your environment. > > Run > > %python.conda help > > in the notebook will display available command. This allow dynamically > configu