Re: Env var suport in interpreter-setting.json

2018-08-29 Thread Jongyoul Lee
You could edit it like: "zeppelin.spark.uiWebUrl": { "envName": "SPARK_UI_URL", "propertyName": "zeppelin.spark.uiWebUrl", "defaultValue": "", "description": "Override Spark UI default URL", "type": "string" }, Hope this help. On Wed, Aug 29, 2018 at 10:03 PM, Ricardo Martinelli de Ol

Re: Python script calls R script in Zeppelin on Hadoop

2018-08-29 Thread Jeff Zhang
I am not sure what's wrong. maybe you can ssh to that machine and run this r script manually first to verify what's wrong. Lian Jiang 于2018年8月30日周四 上午10:34写道: > Jeff, > > R is installed on namenode and all data nodes. The R packages have been > copied to them all too. I am not sure if an R scri

Re: Python script calls R script in Zeppelin on Hadoop

2018-08-29 Thread Lian Jiang
Jeff, R is installed on namenode and all data nodes. The R packages have been copied to them all too. I am not sure if an R script launched by pyspark's subprocess can access spark context or not. If not, using addFiles to add R packages into spark context will not help test.r install the packages

Re: Python script calls R script in Zeppelin on Hadoop

2018-08-29 Thread Jeff Zhang
You need to make sure the spark driver machine have this package installed. And since you are using yarn-cluster mode via livy, you have to install this packages on all nodes because the spark driver could be launched in any node of this cluster. Lian Jiang 于2018年8月30日周四 上午1:46写道: > After calli

Re: "Read replica" for Zeppelin

2018-08-29 Thread Jongyoul Lee
I like this idea, totally. I have an exactly same issue and thought to provide read-only mode. BTW, currently, Zeppelin server doesn't look proper for now. I, personally, have an idea to make a simple webserver only as a viewer. JL On Wed, Aug 29, 2018 at 9:55 PM, peay wrote: > Hello, > > I ha

Re: Python script calls R script in Zeppelin on Hadoop

2018-08-29 Thread Lian Jiang
After calling a sample R script, we found another issue when running a real R script. This R script failed to load changepoint library. I tried: %livy2.sparkr install.packages("changepoint", repos="file:///mnt/data/tmp/r") library(changepoint) // I see "Successfully loaded changepoint package ver

Re: Build Errors with v0.8.0

2018-08-29 Thread Bradley Barber
I've also been experiencing this worning: "[WARNING] The requested profile "hadoop-2.x" could not be activated because it does not exist." except with version 2.6. This warning has not resulted in a build failure however, so i don't think this is the source of the error you are seeing. It is odd th

Build Errors with v0.8.0

2018-08-29 Thread Sam Nicholson
Or perhaps it's just the documentation... I'm building 0.8.0, as per instructions at https://zeppelin.apache.org/docs/0.8.0/setup/basics/how_to_build.html I'm building in Jenkins, so the git clone is more involved... git rev-parse refs/remotes/origin/refs/tags/v0.8.0 ... Checking out Revision

Env var suport in interpreter-setting.json

2018-08-29 Thread Ricardo Martinelli de Oliveira
Hi, Does anyone know if there is env var support in interpreter-setting.json? I'd like to configure zeppelin.spark.uiWebUrl parameter default value with the value of my SPARK_UI_URL env var. -- Ricardo Martinelli de Oliveira Senior Software Engineer T: +55 11 3524-6125 | M: +55 11 9 7069-6531 Av

"Read replica" for Zeppelin

2018-08-29 Thread peay
Hello, I have a Zeppelin server with a S3 repo backend for notebooks. I would like to have a second Zeppelin instance to access the notebooks in read only mode. Mostly for security reasons, but also in general some weak form of HA. Any suggestion on how to achieve this? I've set it up naively,