Re: Spark Interpreter error: 'not found: type'

2018-03-13 Thread Karan Sewani
Hello Marcus Maybe it has something to do with https://stackoverflow.com/questions/13008792/how-to-import-class-using-fully-qualified-namehttps://stackoverflow.com/questions/13008792/how-to-import-class-using-fully-qualified-name

Re: Zeppelin - Spark Driver location

2018-03-13 Thread Jeff Zhang
spark-submit is called in bin/interpreter.sh, I didn't try standalone cluster mode. It is expected to run driver in separate host, but didn't guaranteed zeppelin support this. Ankit Jain 于2018年3月14日周三 上午8:34写道: > Hi Jhang, > What is the expected behavior with standalone cluster mode? Should we s

Re: Zeppelin - Spark Driver location

2018-03-13 Thread Ankit Jain
Hi Jhang, What is the expected behavior with standalone cluster mode? Should we see separate driver processes in the cluster(one per user) or multiple SparkSubmit processes? I was trying to dig in Zeppelin code & didn’t see where Zeppelin does the Spark-submit to the cluster? Can you please poi

Re: Zeppelin - Spark Driver location

2018-03-13 Thread Jeff Zhang
ZEPPELIN-2898 is for yarn cluster model. And Zeppelin have integration test for yarn mode, so guaranteed it would work. But don't' have test for standalone, so not sure the behavior of standalone mode. Ruslan Dautkhanov 于2018年3月14日周三 上午8:06写道

Re: Zeppelin - Spark Driver location

2018-03-13 Thread Ruslan Dautkhanov
https://github.com/apache/zeppelin/pull/2577 pronounces yarn-cluster in it's title so I assume it's only yarn-cluster. Never used standalone-cluster myself. Which distro of Hadoop do you use? Cloudera desupported standalone in CDH 5.5 and will remove in CDH 6. https://www.cloudera.com/documentatio

Re: Zeppelin - Spark Driver location

2018-03-13 Thread Jhon Anderson Cardenas Diaz
Does this new feature work only for yarn-cluster ?. Or for spark standalone too ? El mar., 13 de mar. de 2018 18:34, Ruslan Dautkhanov escribió: > > Zeppelin version: 0.8.0 (merged at September 2017 version) > > https://issues.apache.org/jira/browse/ZEPPELIN-2898 was merged end of > September so

Re: [DISCUSS] Roadmap 0.9 and future

2018-03-13 Thread Ruslan Dautkhanov
Thanks for sharing this moon ! Those are great ideas. -- Ruslan Dautkhanov On Wed, Mar 7, 2018 at 11:21 AM, moon soo Lee wrote: > Hi forks, > > There were an offline meeting yesterday at PaloAlto with contributors and > users. We've shared idea about current state of project and future proj

Re: Zeppelin - Spark Driver location

2018-03-13 Thread Ruslan Dautkhanov
> Zeppelin version: 0.8.0 (merged at September 2017 version) https://issues.apache.org/jira/browse/ZEPPELIN-2898 was merged end of September so not sure if you have that. Check out https://medium.com/@zjffdu/zeppelin-0-8-0-new-features-ea53e8810235 how to set this up. -- Ruslan Dautkhanov O

Zeppelin - Spark Driver location

2018-03-13 Thread Jhon Anderson Cardenas Diaz
Hi zeppelin users ! I am working with zeppelin pointing to a spark in standalone. I am trying to figure out a way to make zeppelin runs the spark driver outside of client process that submits the application. According with the documentation ( http://spark.apache.org/docs/2.1.1/spark-standalone.h

Re: Highlight Zeppelin 0.8 New Features

2018-03-13 Thread Paul Brenner
Love this. Shared it with my team and we discovered multiple new features. ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) *Paul Brenner* ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( https://www.facebook.co

Re: Highlight Zeppelin 0.8 New Features

2018-03-13 Thread Ruslan Dautkhanov
Thanks Jeff! That's great - our users were asking what are the highlights of the new release. -- Ruslan Dautkhanov On Tue, Mar 13, 2018 at 10:07 AM, moon soo Lee wrote: > Looks great. I think online registry (helium) for visualization and spell > is another important feature. > > Thanks, >

Re: Highlight Zeppelin 0.8 New Features

2018-03-13 Thread moon soo Lee
Looks great. I think online registry (helium) for visualization and spell is another important feature. Thanks, moon On Tue, Mar 13, 2018 at 12:41 AM Jeff Zhang wrote: > > I planned to publish this article after 0.8 release, but I think it would > be helpful for users to experience and verify t

Highlight Zeppelin 0.8 New Features

2018-03-13 Thread Jeff Zhang
I planned to publish this article after 0.8 release, but I think it would be helpful for users to experience and verify these features before 0.8 release. So I sent it out before 0.8 release. I would be very appreciated that users can try these features via branch-0.8, and this is not a full list o

RE: [DISCUSS] Roadmap 0.9 and future

2018-03-13 Thread Belousov Maksim Eduardovich
Hello Moon and users! Thanks a lot for sharing. I propose to abandon the roadmap. The idea of no roadmap in open source projects is from the book "Social Architecture". The author is Pieter Hintjen. As it's written: in 2007 he founded the successful and broad-ranging ZeroMQ community. There is