Re: pyspark can't run through

2017-01-05 Thread Jianfeng (Jeff) Zhang
That means the user who launch zeppelin don’t have permission to use python. Please switch to another user with proper permission. Py4JJavaError: An error occurred while calling z:org.apache.spark.api.python.PythonRDD.runJob. : org.apache.spark.SparkException: Job aborted due to stage failure:

Re: PostgreSQL JDBC Connections

2017-01-05 Thread t p
YMMV and I don’t think my approach will work for your use case. Here is a suggestion based on what I’ve done. In the first paragraph you can register tables with code as such. %spark val example = sqlContext.read.format("jdbc").options( Map("url" -> "jdbc:postgresql://localhost:5432/db_name"

Re: PostgreSQL JDBC Connections

2017-01-05 Thread Benjamin Kim
We are using the JDBC interpreter. The business analysts only know SQL and run ad-hoc queries for their report exports to CSV. Cheers, Ben > On Jan 5, 2017, at 2:21 PM, t p wrote: > > Are you using JDBC or the PSQL interpreter? I had encountered something > similar while using the PSQL inter

Re: PostgreSQL JDBC Connections

2017-01-05 Thread t p
Are you using JDBC or the PSQL interpreter? I had encountered something similar while using the PSQL interpreter and I had to restart Zeppelin. My experience using PSQL (Postgresql, HAWK) was not as good as using spark/scala wrappers (JDBC data source) to connect via JDBC and then register tem

PostgreSQL JDBC Connections

2017-01-05 Thread Benjamin Kim
We are getting “out of shared memory” errors when multiple users are running SQL queries against our PostgreSQL DB either simultaneously or throughout the day. When this happens, Zeppelin 0.6.0 becomes unresponsive for any more SQL queries. It looks like this is being caused by too many locks be

pyspark can't run through

2017-01-05 Thread Alec Lee
Hello, all I recently come cross good tool - zeppelin, it is easy to use. But I have some troubles to make pyspark work in my server. The code below used to work fine, but for no reason it pop up errors like permission deny. Code %pyspark import pandas ## http://blog.csdn.net/lsshlsw/

Re: Zeppelin and treemap visualization

2017-01-05 Thread Deenar Toraskar
Jan This is not supported out of the box, but you can add cells to add this in. You can find a lot of treemap visualisations done using d3 https://bost.ocks.org/mike/treemap/. You can reformat your results into JSON and then use that with the javascript+d3 code and assemble the resulting HTML. Fi