Notebook note with %sql does not see registered tables in previous note

Hello, In promo video tutorial for Zeppelin ( http://www.youtube.com/watch?v=_PQbVH_aO5E&feature=youtu.be) I see demonstration of how to declare table 'bank' in one note and query this table in another note. I tried doing this and it did not work. I have one notebook with two notes: Note #1: //

Re: Notebook note with %sql does not see registered tables in previous note

I just tested it on my code and had not problem doing so. Can you share the code before the line eventsDF.registerTempTable("events")? Can you run the Zeppelin Load Data Into Table paragraph in the Zeppelin Tutorial and then try to run the select from bank on another note and see if it works? Gene

Re: Notebook note with %sql does not see registered tables in previous note

I use spark 1.4.1 on EMR cluster with YARN Sharing my code: PARAGRAPH #1 val sqlContext = new org.apache.spark.sql.SQLContext(sc) import scala.io.Source @transient val suffixesStr = "hello\nworld" @transient val suffList = suffixesStr.lines.filter(line => !line.startsWith("//") && line.trim() !=

Re: Notebook note with %sql does not see registered tables in previous note

Found solution! Instead of using 'val sqlContext = new org.apache.spark.sql.SQLContext(sc)' I need to use 'sqlContext' (provided by Zeppelin) Based on http://stackoverflow.com/questions/30819075/zeppelin-sqlcontext-registertemptable-issue 2015-09-09 16:40 GMT+04:00 Eugene : > I use spark 1.4.1 o

Re: Few Qs on Zeppelin

Hi Corneau and Leonardo, Thanks for the response. Just wondering whether these features can be part of the Roadmap of Zeppelline as these are required entirprise features. Regards, Sourav On Tue, Sep 8, 2015 at 6:35 PM, Corneau Damien wrote: > 1. Upload/Download -> No, the only way is to acce

Re: Zeppelin- spark streaming-kafka -help?

Any help? On 9 September 2015 at 00:57, Sajeevan Achuthan wrote: > >Similar bug reported before ZEPPELIN-108 > > > > On 8 September 2015 at 14:33, Sajeevan Achuthan < > achuthan.sajee...@gmail.com> wrote: > >> Hi Todd, >>Thanks for

Re: Few Qs on Zeppelin

you're welcome. they're all great features and I agree it would be good to have them. I've found there are a couple of JIRA tickets about something similar. simple authentication: https://issues.apache.org/jira/browse/ZEPPELIN-15 github integration: https://issues.apache.org/jira/browse/ZEPPELIN

Re: Zeppelin- spark streaming-kafka -help?

Which version of Zeppelin do you use? On Wed, Sep 9, 2015 at 7:29 AM Sajeevan Achuthan < achuthan.sajee...@gmail.com> wrote: > Any help? > > On 9 September 2015 at 00:57, Sajeevan Achuthan < > achuthan.sajee...@gmail.com> wrote: > >> >>Similar bug reported before ZEPPELIN-108 >>

Re: Any way to use :load statement in spark interpreter or do file include includes?

I found a solution. Basically you define several paragraphs. 1. utility paragraphs that prepare data and user defined functions, collapsed to be hidden from end-users. 2. business paragraphs that use #1, like "%sql select ... from defined_table1" 2015-09-08 20:07 GMT+04:00 Eugene : > In spark-sh

Re: Zeppelin- spark streaming-kafka -help?

0.5.0 On 9 September 2015 at 15:43, moon soo Lee wrote: > Which version of Zeppelin do you use? > > On Wed, Sep 9, 2015 at 7:29 AM Sajeevan Achuthan < > achuthan.sajee...@gmail.com> wrote: > >> Any help? >> >> On 9 September 2015 at 00:57, Sajeevan Achuthan < >> achuthan.sajee...@gmail.com> wrot

Re: Zeppelin + Spark On EMR?

Thanks Phil, it works. Great job and well done! best, /Shahab On Mon, Sep 7, 2015 at 6:32 PM, Phil Wills wrote: > Anders script is a bit out of date if you're using the latest version of > EMR. Here's my fork: > > https://gist.github.com/philwills/71539f833f57338236b5 > > which worked OK for m

Re: Zeppelin + Spark On EMR?

Here's a bit shorter alternative, too https://gist.github.com/snowindy/008f3e8b878a23c00679 2015-09-09 18:58 GMT+04:00 shahab : > Thanks Phil, it works. Great job and well done! > > best, > /Shahab > > On Mon, Sep 7, 2015 at 6:32 PM, Phil Wills wrote: > >> Anders script is a bit out of date if

Re: Scheduler already terminated Exception

If there're some way to reproduce the problem it'll help a lot. Let me investigate more on this problem. I'm working on improving interpreter process restart. https://github.com/Leemoonsoo/incubator-zeppelin/commit/3200b9aac26d394a67d496c3b209eb3cda046c4a Once i know how to reproduce "Scheduler a

Re: pyspark 1.5.0-SNAPSHOT is not supported

Recently some change has been made on master branch including spark 1.5.0 support. Please try it let me know if it works. Thanks, moon On Thu, Aug 20, 2015 at 8:11 AM Jerry Lam wrote: > Hi Zeppelin users and developers, > > Anyone encounters this problem? I built zeppelin myself with spark 1.5

Re: ZeppelinContext not found in spark executor classpath

Hi, Recently https://github.com/apache/incubator-zeppelin/pull/270 is merged into master branch and i believe it solves this problem. Let me know if it helps. Thanks, moon On Thu, Aug 20, 2015 at 2:36 AM David Salinas wrote: > Hi, > > I have the same error that is very ennoying and seems to be

Problem running Twitter streaming example

When attempting to run the Twitter streaming example from https://zeppelin.incubator.apache.org/docs/tutorial/tutorial.html I am seeing the following error. Can anyone help me figure it out? import org.apache.spark.streaming._ :30: error: object twitter is not a member of package org.apache.spark

object serializer is not a member of package org.apache.spark.streaming.kafka

am trying to get streaming data from kafka into spark for visualizing in zeppelin. getting the following error. what am i doing wrong :29: error: object serializer is not a member of package org.apache.spark.streaming.kafka import kafka.serializer.DefaultDecoder Here's a snippet of the code i'm t

warmstart hive on login

Hi All: I am facing a situation where notebooks I have that depend on a HiveContext to run fail unless I run an "initialization" notebook to create a hive context for my Zeppelin session. I would like to know if there is a way to give some initialization that sets up the HiveContext so that I can

Frequency of RECEIVE << PING

Dear all, I saw about 211 line of logs of "INFO NotebookServer: RECEIVE << PING" in 1 second. Is there a parameter to configure the frequency of PING? --- Currently we use the zeppelin on commit: b4b4f5521a57fd3b0902b5e3ab0e228c10b8bac5 Best, Wush

Re: Frequency of RECEIVE << PING

There is currently no configuration for the ping, The last commit that changed the ping timeout frequency was this one: https://github.com/apache/incubator-zeppelin/commit/a9d686b40f0a5a37cdc775403866f711df70cf56 However, if you got 211 ping a second, it would mean you had 211 notebooks opened, o

Re: Frequency of RECEIVE << PING

Thanks for your quick reply. I'll check if this is a bug or there are too many notebooks opened. 2015-09-10 12:29 GMT+08:00 Corneau Damien : > There is currently no configuration for the ping, > > The last commit that changed the ping timeout frequency was this one: > https://github.com/apache/i

Re: warmstart hive on login

Not sure if this is the best way but you can have a notebook which replace your homepage - this notebook beside showing what you want on the homepage can warmup whatever you want. http://zeppelin.incubator.apache.org/docs/manual/notebookashomepage.html BTW, as much as I now the spark interpreter cr

Re: Frequency of RECEIVE << PING

Don't hesitate to create a Jira issue if you find out that there is a bug in the ping feature. On Thu, Sep 10, 2015 at 2:34 PM, Wush Wu wrote: > > Thanks for your quick reply. > > I'll check if this is a bug or there are too many notebooks opened. > > 2015-09-10 12:29 GMT+08:00 Corneau Damien :