Re: Faild to build on spark 1.4

No, I did not change anything, did git pull then mvn clean... Eran On Tue, Jun 23, 2015 at 9:54 AM Daniel Haviv < daniel.ha...@veracity-group.com> wrote: > Hi, > Did you make changes to the pom.xml ? > It seems to be searching inside Cloudera's MVN repo and not maven central. > > BR, > Daniel > >

Re: future plans for Zeppelin

great.. thanks for the answers... code completion is very good - I just could not find it documented anywhere... I think this project is great - but documentation could be improved in few places... thanks again for your help Borisa Zivkovic "Believe you can, believe you can't;

Re: future plans for Zeppelin

Hi guys, when try to execute the tutorial in zeppelin in the part of sql no working fine, the error is: Granted executor ID app-20150623103023-/5 on hostPort ip-172-31-17-217.ec2.internal:44733 with 2 cores, 512.0 MB RAM INFO [2015-06-23 12:33:06,511] ({sparkDriver-akka.actor.default-dispatch

Re: NPE exception in Spark interpreter log + broken pipe exception once awhile in the Zeppelin log

Interesting. Yes, it might be that the Spark Context crashed. I'll do few tests for that and update. On Tue, Jun 23, 2015 at 6:36 AM, moon soo Lee wrote: > for broken pipe error, > > Zeppelin runs Spark driver (SparkContext) in separate JVM process and > communicate through thrift protocol. The

Re: NPE exception in Spark interpreter log + broken pipe exception once awhile in the Zeppelin log

Hi Moon and thanks for the answers, this mailing list is defiantly one of the responsive mailing list I have encountered. About the NPE, Zeppelin continue working as expected after the exception. Actually, this exception raised WHEN I'm trying to access the web ui. Also, it raised once awhile with

RE: Exporting Notebook source

Thanks, Moon. From: moon soo Lee [mailto:m...@apache.org] Sent: Saturday, June 20, 2015 3:32 PM To: users@zeppelin.incubator.apache.org Subject: Re: Exporting Notebook source Hi, Thanks for using Zeppelin. Currently there no export feature. One alternative is, you can extend Zeppe

Commands working in spark shell but not in zeppelin

Hi, I have a fairly simple set of commands which work in the spark shell. However, they do not work on zeppelin. The commands are: val wbIPR=Array(8.40, 8.09, 7.56, 6.83, 5.88, 4.72, 3.36, 1.78, 0.0) val pressureIPR=Array(0.00,1000.00,2000.00,300

Commands not working Zeppelin

Hi, I have successfully installed zeppelin on my CentOS 6.6 VM. I'm accessing the notebook using my machine ip address and port number. I'm able to see the Zeppelin screen. Here when I create new note and try to run I'm facing the issue. [cid:image001.png@01D0AD9F.334FFDB0] Do I need to do any

Re: Commands not working Zeppelin

Hi Karthik, Could you press enter after %md, Sometime it works for me, since you mentioned its your first time, I hope you mush have clicked on save interpreters, which you can see by clicking the top right setting button. Regards Nihal Sent from my iPhone > On 23-Jun-2015, at 22:57, "Vadla,

Re: future plans for Zeppelin

Hi, Your error message has an instruction. "Check your cluster UI to ensure that workers are registered and have sufficient resources". Could you make sure if your spark cluster have enough resources? Thanks, moon On Tue, Jun 23, 2015 at 3:51 AM Victor Manuel Garcia < victor.gar...@beeva.com> w

RE: Commands not working Zeppelin

Hi Nihal, No it’s not working for me. ☹ Still the same error. Do we need to do any extra settings after installation.? Thanks Karthik From: Nihal Bhagchandani [mailto:nihal_bhagchand...@yahoo.com] Sent: Tuesday, June 23, 2015 10:55 AM To: users@zeppelin.incubator.apache.org Subject: Re: Command

Commands working in Spark shell failing in Zeppelin

Hi, I’ve tried to send this before but it didn’t come through. I have a fairly simple set of commands which work in the spark shell. However, they do not work on zeppelin. The commands are: val wbIPR=Array(8.40, 8.09, 7.56, 6.83, 5.88, 4.72, 3.36, 1.78,

Re: Commands working in Spark shell failing in Zeppelin

P.S. This is working on a remote spark cluster in AWS. Spark 1.3.0 or 1.3.1. Fails in both. > On 23 Jun 2015, at 19:25, Wood, Dean Jr (GE Oil & Gas) > wrote: > > Hi, > > I’ve tried to send this before but it didn’t come through. > > I have a fairly simple set of commands which work in the sp

Commands are not working on Zeppelin Notebook even after enabling interpreters

Hi, I have successfully installed zeppelin on my CentOS 6.6 VM. I'm accessing the notebook using my machine ip address and port number. I'm able to see the Zeppelin screen. Here when I create new note and try to run I'm facing the issue. [cid:image001.png@01D0AD9F.334FFDB0] Do I need to do any

Re: Commands working in Spark shell failing in Zeppelin

Hi, Thanks for sharing the problem. I tried your code and got the same exception. I've found it is coming from one of our recently merged code. Here's issue for this problem https://issues.apache.org/jira/browse/ZEPPELIN-127 Here's quick fix for it. https://github.com/apache/incubator-zeppelin/p

Re: Commands not working Zeppelin

Hi, Karthik There're no special settings required for %md. Could you check log files and see is there some exception? Related log files are [ZEPPELIN_HOME]/logs/zeppelin-[USERNAME]-[HOSTNAME].log and [ZEPPELIN_HOME]/logs/zeppelin-interpreter-md-[USERNAME]-[HOSTNAME].log Thanks, moon On Tue, Jun

RE: Commands not working Zeppelin

Wow, Thanks Moon looking into logs really helped me. The problem is with permissions. I just made all .sh scripts in /bin to executable . Ex: chmod +x interpreter.sh Now I’m able to run commands. Thanks Karthik From: moon soo Lee [mailto:m...@apache.org] Sent: Tuesday, June 23, 2015 2:39 PM

Error while running any operation on resulting dataframe

Hi All, I am using Zeppelin notebook with Spark1.3.1 and Hadoop version 2.6. I am able to run entire tutorial shipped with it without any issues. Then I created new notebook to run simple code that fetches data from parquet file stored in HDFS on local machine. Following is code: val param_alarm

Importing a csv file into zeppelin!

I wanted to import a csv file into zeppelin, i didn't find any proper method yet! Thought of using the spark-package http://spark - packages.org/package/databricks/spark-csv , how can I go about it? Any other method? -- Sincerely! George Koshy, Richardson, in.linkedin.com/in/gkoshyk/

Re: Importing a csv file into zeppelin!

Hi, You can load spark packages using dependency loader. for example %dep z.load("com.databricks:spark-csv_2.10:1.0.3") Please check http://zeppelin.incubator.apache.org/docs/interpreter/spark.html#dependencyloading Thanks, moon On Tue, Jun 23, 2015 at 5:02 PM George Koshy wrote: > I wanted

Re: Error while running any operation on resulting dataframe

Hi Rajeev, Instead of sqlc, could you use zeppelin in-build sqlContext and try running the same command. -Nihal Sent from my iPhone > On 24-Jun-2015, at 4:32, Rajeev Prasad wrote: > > Hi All, > > I am using Zeppelin notebook with Spark1.3.1 and Hadoop version 2.6. I am > able to run entire

Re: Error while running any operation on resulting dataframe

Same. I have already tried that. Rajeev On Tue, Jun 23, 2015, 6:39 PM Nihal Bhagchandani < nihal_bhagchand...@yahoo.com> wrote: > Hi Rajeev, > > Instead of sqlc, could you use zeppelin in-build sqlContext and try > running the same command. > > -Nihal > Sent from my iPhone > > On 24-Jun-2015, at

Zeppelin Tutorial and using Hive Context

Hello! I have three questions: 1) I somehow lost the Zeppelin tutorial notebook and I was wondering if there's a copy of it somewhere I could find? Or if someone could provide the details? I know the tutorial has part of it, but not all of it. 2) I am getting this error when i am trying the foll

Re: Importing a csv file into zeppelin!

Thanks Moon! On Tue, Jun 23, 2015 at 5:10 PM, moon soo Lee wrote: > Hi, > > You can load spark packages using dependency loader. for example > > %dep > z.load("com.databricks:spark-csv_2.10:1.0.3") > > Please check > http://zeppelin.incubator.apache.org/docs/interpreter/spark.html#dependencyload

error: value read is not a member of org.apache.spark.sql.SQLContext

Please help, I get this error error: value read is not a member of org.apache.spark.sql.SQLContext val df = sqlContext.read.format("com.databricks.spark.csv").option("header", "true").load("filename.csv") My code is as follows: import org.apache.spark.SparkContext %dep com.databricks:spark-csv_2

Re: Importing a csv file into zeppelin!

I have developed some Scala library functions to achieve typical generation of DataFrame objects directly from CSV files. I can contribute this code if you think it would be useful. Robin > On Jun 23, 2015, at 8:10 PM, moon soo Lee wrote: > > Hi, > > You can load spark packages usin

Re: Importing a csv file into zeppelin!

Sure Robin, that would be great help! Where can I find the library functions! On Tue, Jun 23, 2015 at 8:12 PM, Robin Hillyard wrote: > I have developed some Scala library functions to achieve typical > generation of DataFrame objects directly from CSV files. I can contribute > this code if you t

Re: error: value read is not a member of org.apache.spark.sql.SQLContext

I try with the spark 1.3 command mentioned in spark-csv website val df = sqlContext.load("com.databricks.spark.csv", Map("path" -> "fileName.csv", "header" -> "true")) and I get the following error java.lang.NoClassDefFoundError: org/apache/commons/csv/CSVFormat at com.databricks.spark.csv.CsvRel

Re: error: value read is not a member of org.apache.spark.sql.SQLContext

Hi George, does spark version that you use on the cluster matches the one zeppelin is build with ? API that you use was introduced only in spark 1.4 and it is not the default version yet

Re: error: value read is not a member of org.apache.spark.sql.SQLContext

Yes Alex, sc.version tells me String = 1.3.1 So it is 1.3 and I used the 1.3 syntax from spark-csv website then there is a class not found error. NoClassDefFoundError: org/apache/commons/csv/CSVFormat I guess the spark-csv packages are not loading properly. I used %dep z.load("com.databricks:spa

Re: sqlContext fails to discover parquet partition

Dear all, I found the reason. After enabling the "spark.sql.parquet.useDataSourceApi" in sqlContext, the partition of parquet works correctly. example code: ``` sqlContext.setConf("spark.sql.parquet.useDataSourceApi", "true") val ecrtb20150622 = sqlContext.parquetFile("hdfs:///bwlogs/beta/archi

org.apache.zeppelin.interpreter.InterpreterException: java.lang.reflect.InvocationTargetException

Hello, I am confused on why the following code does not work, I would get this type of error before when it couldn't find the table, but this is a new type of error that I am getting. Thank you for the help. Best, Su //this works, i can also do hc.sql('...').take(10) and get results hc.sql("C