Re: Zeppelin is much slower than pure spark-shell

It could be many reasons. You need to check the spark UI, whether they use the same resources and same number of tasks York Huang 于2016年11月17日周四 下午1:05写道： > Hi, > I am using a spark sql JOIN. It runs well in SPARK-SHELL --master > yarn-client, but is very slow and timeout in zeppelin. > > Where s

Zeppelin is much slower than pure spark-shell

Hi, I am using a spark sql JOIN. It runs well in SPARK-SHELL --master yarn-client, but is very slow and timeout in zeppelin. Where should I examine the issue? Thanks

ArrayIndexOutOfBoundsException on Zeppelin notebook example

Hi All, I have the following Scala code (taken from https://zeppelin.apache.org/docs/0.6.2/quickstart/tutorial.html#data-retrieval) that deals with the sample Bank-details data: ---*---

Re: Having issues with Hive RuntimeException in runing Zeppelin notebook applicaiton

Hi Moon, I have set those variables as follows (a partial view of the zeppelin-env.sh file). Is this okay? #!/bin/bash export JAVA_HOME=/usr/lib/jvm/java-8-oracle export PATH=$PATH:$JAVA_HOME/bin export SPARK_HOME=/home/asif/spark-2.0.0-bin-hadoop2.7 export PATH=$PATH:$SPARK_HOME/bin   

Re: Having issues with Hive RuntimeException in runing Zeppelin notebook applicaiton

Hi Moon, No,  I did not set those two environmental variables. I'm still how to do that. I have installed Spark on my machine and have set the SPARK_HOME. However, do I also need to install and configure the Hadoop. But the error is all about the Hive. Am I some how wrong? A sample zeppelin-env.s

Re: Having issues with Hive RuntimeException in runing Zeppelin notebook applicaiton

>>> at /home/asif/zeppelin-0.6.2-bin-all/metastore_db has an incompatible >>> format with the current version of the software. The database was created >>> by or upgraded by version 10.11. Try to delete this folder and rerun it again. Best Regard, Jeff Zhang From: moon soo Lee mailto:m...@ap

Re: Having issues with Hive RuntimeException in runing Zeppelin notebook applicaiton

Hi, It's strange, Do you have SPARK_HOME or HADOOP_CONF_DIR defined in conf/zeppelin-env.sh? You can stop Zeppelin, delete /home/asif/zeppelin-0.6.2-bin-all/metastore_db, start Zeppelin and try again. Thanks, moon On Tue, Nov 15, 2016 at 4:05 PM Muhammad Rezaul Karim wrote: > > > > Hi, > I am

Re: Embedded Mode for interpreter

Hi, Zeppelin actually does have embedded mode that runs Interpreter in the same JVM that Zeppelin run. This feature does not exposed to user, but it can be controlled by InterpreterOption.remote field. https://github.com/apache/zeppelin/blob/master/zeppelin-interpreter/src/main/java/org/apache/ze

OutOfMemoryError: Java heap space - is it executor or driver?

I hit OOM error at certain point. Mostly noticed after fitting model multiple times. I can't figure out if this is driver or executor. From logs it looks like Driver. I don't see any heap space error in Executor logs> zeppelin-interpreter-spark.local.log INFO [2016-11-16 10:52:29,063] ({dispa

Re: FW: Issue with Zeppelin setup on Datastax-Spark

I figured what was the issue. I did not install knitr package in R. After installing the package in R, i restarted the zeppelin and all looks good now. On Wed, Nov 16, 2016 at 4:09 PM, Abul Basar wrote: > Hello DuyHai, > > Original problem reported by Arpan Saha is related to Datastax. I am usin

Aw: Re: Two different errors while executing Spark SQL queries against cached temp tables

Hi Alex,   thanks for responding, I hope I can give you all the needed information.  I downloaded the 0.6.2 binary package and used the standard configuration. I only start the zeppelin-deamon and zeppelin spins up the embedded Spark environment. I only added the postgresql package (org.postgr

RE: Unable to connect with Spark Interpreter

Hello Alexander, Thank you for a quick response. Please, see the server log attached. Unfortunately, I don’t have any zeppelin-interpreter-spark*.log in the logs file. Questions: - It happens everytime – even, If I try to run several paragraphs - Yes, it keeps happening even

Re: Unable to connect with Spark Interpreter

Hi Jan, this is rather generic error saying that ZeppelinServer somehow could not connect to the interpreter proces on your machine. Could you please share more from logs/* in particular, .out and .log of the Zeppelin server AND zepplein-interpreter-spark*.log - usually this is enough to identify

Re: Two different errors while executing Spark SQL queries against cached temp tables

Hi Florian, sorry for slow response, I guess the main reason for not much feedback here is that its hard to reproduce the error you describe, as it does not happen reliably even on your local environment. java.lang.NoSuchMethodException: org.apache.spark.io.LZ4CompressionCodec This can be a sign

Unable to connect with Spark Interpreter

Hello, I am not able to run any Spark code in the Zeppelin. I tried compiled versions of Zeppelin as well as to compile the source code on my own based on the https://github.com/apache/zeppelin steps. My configuration is Scala in 2.11 version and spark 2.0.1. Also, I tried different versions of

Aw: Two different errors while executing Spark SQL queries against cached temp tables

Hi,   can anyone help me with this? It is very anoying, because I get this error very often (on my local maschine and also on a second vm). I use Zeppelin 0.6.2 with Spark 2.0 and Scala 2.11.     Best regards Florian   Gesendet: Montag, 14. November 2016 um 20:45 Uhr Von: "Florian Schulz"

Re: FW: Issue with Zeppelin setup on Datastax-Spark

Hello DuyHai, Original problem reported by Arpan Saha is related to Datastax. I am using Spark + Zeppelin. Below is the configuration. - Spark 2.0.2 - Zeppelin: 0.6.2 - Java 1.8.0_111 - R: 3.3.1 Thanks, Abul On Wed, Nov 16, 2016 at 3:44 PM, DuyHai Doan wrote: > I recommend downlo

Re: FW: Issue with Zeppelin setup on Datastax-Spark

I recommend downloading my pre-built Zeppelin for Datastax. Shared folder link: https://drive.google.com/folderview?id=0B6wR2aj4Cb6wQ01aR3ItR0xUNms On Wed, Nov 16, 2016 at 11:13 AM, DuyHai Doan wrote: > Ok I understand why you have issue. > > You are using Spark 2.0.2 and latest Datastax 5.0.3 i

Re: FW: Issue with Zeppelin setup on Datastax-Spark

Ok I understand why you have issue. You are using Spark 2.0.2 and latest Datastax 5.0.3 is still using Spark version 1.6.X On Wed, Nov 16, 2016 at 10:23 AM, Abul Basar wrote: > I am facing a similar issue while using Spark R. > > My environment: > >- Spark 2.0.2 >- Zeppelin: 0.6.2 >

Re: FW: Issue with Zeppelin setup on Datastax-Spark

I am facing a similar issue while using Spark R. My environment: - Spark 2.0.2 - Zeppelin: 0.6.2 - Java 1.8.0_111 - R: 3.3.1 SPARK_HOME is set. I am trying to run a simple paragraph. %r print("hello ...") I get the following exception *Interpreter Log* > # getZeppelinR > .zeppel