Cron job fails to run a paragraph that runs correctly manually

2016-02-17 Thread Jose Rivera-Rubio
Hi, I have a paragraph that runs a shell script to import data from a MySQL db to Parquet files using Python and Pyspark (it's legacy import code, that's why it's in a shell script instead of the python code directly in the paragraph). The issue is that if I manually run the paragraph it does the

Re: Notebook feature - "Link this paragraph"

2015-12-01 Thread Jose Rivera-Rubio
I also recognised this bug. The feature that @Mark Luk used to exist when clicking on "Link paragraph". It seems one of the latest commits might have clobbered that option. *Jose Rivera* p.s. We're Hiring ! *Data Engineer Lead **Intern Avenue

Cannot convert RDD of BigDecimal into dataframe

2015-10-08 Thread Jose Rivera-Rubio
Hi guys, I have a list of BigDecimal obtained through SparkSQL from some Parquet files. list: List[BigDecimal] = List(1015.00, 580.00, 290.00, 1160.00) When I try to convert them to dataframe to visualize them using the zeppelin context val df = sc.parallelize(list).toDF("list_of_numbers")

Re: Zeppelin dynamic forms

2015-06-25 Thread Jose Rivera-Rubio
I was looking for the same, in the end I opted for using the Scala binding to create the final string for the sqlContext.sql(queryString). For example: val inputStr = z.input("formName", "defaultValue").toString() val inputSelectStr = z.select("formName", "defaultValue", Seq(("option1", "optionD

Re: Hi, I want to know when will the latest stable version will be released

2015-06-15 Thread Jose Rivera-Rubio
If you have stability problems under other Linux distros you can run Zeppelin on a docker container. We created one based on CentOS https://registry.hub.docker.com/u/internavenue/centos-zeppelin/dockerfile/ On 14 June 2015 at 17:32, moon soo Lee wrote: > Hi, > > Hi, we're trying to make a releas

MySQL connection

2015-06-15 Thread Jose Rivera-Rubio
Hi guys, I'm trying to connect to my MySQL database with the new data sources API to load tables in datafraems. In the Spark shell this is straightforward and I just need to launch the shell with SPARK_CLASSPATH=/path/to/mysql-connector-java-5.1.6.jar bin/spark-shell --master local[2] and then r

Re: Zeppelin showing disconnected after successful build and daemon start

2015-05-08 Thread Jose Rivera-Rubio
ort 8081 for the web sockets. > > *From:* Jose Rivera-Rubio > *Sent:* ‎Friday‎, ‎May‎ ‎8‎, ‎2015 ‎7‎:‎19‎ ‎AM > *To:* Silvio Fiorito > *Cc:* users@zeppelin.incubator.apache.org > > Yes, I publish both. My sudo docker run command is > > sudo docker run -t -i -p 495

Re: Zeppelin showing disconnected after successful build and daemon start

2015-05-08 Thread Jose Rivera-Rubio
Yes, I publish both. My sudo docker run command is sudo docker run -t -i -p 49560:8080 -p 49561:8081 internavenue/centos-zeppelin:latest On 8 May 2015 at 12:13, Silvio Fiorito wrote: > Did you publish both port 8080 and 8081? > > -- > From: Jose

Zeppelin showing disconnected after successful build and daemon start

2015-05-08 Thread Jose Rivera-Rubio
Hi, I'm running Zeppelin on a Docker container, so I my problems shouldn't be related to port issues. However, I'm also seeing "disconnected" on the top right corner and I get this message when I run it: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0