Re: Problems with web proxy

Hi Frank, mvn build in zeppelin-web calls 'npm install' && 'grunt build' underneath, could you try doing those manually (with 'rm -rf node_modules') and posting npm-debug.log\output in case it is still failing? Just to clarify your setup: you need to build Zeppelin on a machine with internet ava

Re: Problems with web proxy

PM, wrote: > After running ‘sudo npm install’ and ‘grunt build’ I got the following > warning/error message: > > > Running "wiredep:app" (wiredep) task > > Warning: Error: Cannot find where you keep your Bower packages. Use > --force to continue. > > >

Re: adding custom jars to zeppelin

Hi Roopa, thanks for your interest! This is definitely possible and the simplest way would be to use a dependency loading mechanism that is embedded in Zeppelin using "%dep" in the first paragraph as described here http://zeppelin.incubator.apache.org/docs/interpreter/spark.html#dependencyloading

Re: adding custom jars to zeppelin

ngodb-spark connectors: > > "com.stratio.deep" % "deep-mongodb" % "0.7.0", > "com.stratio" % "spark-mongodb" % "0.8.0" > > Can I load them in the same manner? > > RP > > > On Thu, May 7, 2015 at 10:30 AM, Alexander Bezzubov

Re: Load data file via zeppelin to spark.

Hi, thanks for your interest, as far as I know the only way to make a data available to every node on the cluster in the same fashion is using SparkContext sc.addFile("/path/to/file") and then get it's location via SparkFiles.get(fileName) Please let me know if that helps! -- Alexander On Thu

Re: Zeppelin packaging for Spark 1.3 gives errors

Hi Roopa, which command did you use to build Zeppelin? Please try 'mvn package ' instead and let us know if that works. On Tue, May 26, 2015 at 8:45 AM, Corneau Damien wrote: > Hi, > > Tests tends to fail when people compile zeppelin (works fine on CI). > Can you try compiling with -DskipT

Re: Using Zeppelin with EC2 spark cluster

Hi Jihun, thanks for your interest in Zeppelin! It looks like zeppelin server having troubles connecting to spark interpreter process. Could you please post logs/zeppelin-* server and interpreter logs? Thanks. On Mon, May 25, 2015 at 2:23 PM, Jihun choi wrote: > Hi, > I'm a noob user with Zep

Re: Zeppelin on remote machine

Hi Harsh, can you please post the spark interpreter (I assume that's what you are using) logs here too? You can find them under ./log/zeppelin-interpreter-spark-*.log It looks like it ZeppelinServer has troubles communicating to the Interpreter process somehow. -- Best regards, Alexander

Re: Question

Indeed, also the focus of Zeppelin is mostly cluster computing system backends. But answering your question about unique features - collaborative analysis is the one from the top of my head: try opening multiple tabs of single Zeppelin instance and start making changes (adding new paragraphs and r

Re: zeppelin not working with spark , if changed zeppelin master to yarn-cluster

To debug YARN setup there are 2 useful things, except ZeppelinServer logs : 1. logs of the interpreter process (logs/zeppelin-interpreter-spark-*) 2. userlogs of YARN application itself, like stderr\stdout of the containers from resourcemenager:8088/logs/userlogs/ If you could attach those that

Re: zeppelin web page show application status is finished but resource manager always show status is running.

Hi, yes, you are doing everything right and this is an expected behavior - the "Application" that you see in YARN UI is a Spark Master, it has UI and a history of executed jobs, scheduled from Zeppelin. On Tue, Jun 9, 2015 at 5:57 AM, prateek arora wrote: > > > Hi > > > > I am running zeppelin

Re: pyspark not working

Hi, you have to add two more properties to `zeppelin-env.sh` to make pyspark happy on YARN: export PYTHONPATH="${SPARK_HOME}/python:${SPARK_HOME }/python/lib/py4j-0.8.2.1-src.zip" export SPARK_YARN_USER_ENV="PYTHONPATH=${PYTHONPATH}" -- Alex On Tue, Jun 9, 2015 at 6:56 AM, prateek arora wro

Re: Importing HBase data to Zeppelin notebook

Hey Ignacia, this error message my be a bit cryptic indeed, but what this means is that this paragraph should be run first, after the interpreter start. Easiest way to do that - go to Interpreters menu on top and there manually restart particular interpreter the you are using at that notebook. Th

Re: spark on yarn

Hi Igor, did you manage to get Zeppelin up and running on your setup? In case you still need a hand, please feel free to attach interpreter logs under /logs dir, and in case of YARN: yarn userlogs are very useful for debug too. -- Alex On Tue, Jun 9, 2015 at 4:47 PM, Igor Mazor wrote: > Hi,

Re: How to include user written jars in path

Hi, thank you for your interest! Please check the documentation on the Add jars, files section in the http://zeppelin.incubator.apache.org/docs/install/install.html Or you can try runtime dependency loading feature of Zeppelin http://zeppelin.incubator.apache.org/docs/interpreter/spark.html#depen

Re: Exporting Notebook source

Xinh Huynh, in addition to Moon's answer, if you really need just something simple you can always do cat notebook/2A94M5J1Z/note.json | jq -c '.paragraphs[].text' | tr -d '"' | sed 's,\\n,\ ,g' (Note the line break that is needed on osx) Hope this helps. -- Alex On Sun, Jun 21, 2015 at 7:32

Re: error: value read is not a member of org.apache.spark.sql.SQLContext

Hi George, does spark version that you use on the cluster matches the one zeppelin is build with ? API that you use was introduced only in spark 1.4 and it is not the default version yet

Re: Zeppelin in multi user environment

Hi, thank you for asking, indeed, as Moon mentioned, we are working on making a standalone tool available that is a reverse proxy, capable of launching separate docker container per-user for the chosen spark\hadoop version, implementing the A. architecture from above. -- Alex On Mon, Jun 29, 2

Re: Zeppelin Interpreter end

Hi, right now, I'm not aware of such configuration in Zeppelin (please, feel free to open the issue\submit a patch). AFAIK dynamic YARN resource allocation is up to the user and is not configured by default right now, which looks like one possible solution to the problem you describe (at least cp

Re: Paragraphs do not run

Hi Nitay, can you please try building the Zeppelin archive distribution locally by mvn install -DskipTests -Dspark.version=1.3.0 -Dhadoop.version=2.6.0 -Pbuild-distr and then cp the tar.gz archive from zeppelin-distribution/target/ to the server, unpack and run zeppelin-daemon.sh there again?

Re: Provide binaries

Hi, thank you for asking! We definitely looking into providing a convenience binaries for the release, as soon as it is out. Stay tuned! On Fri, Jul 10, 2015 at 7:30 AM, Illu Ying wrote: > +1 > > On Thu, Jul 9, 2015 at 3:28 PM, Abhi Basu <9000r...@gmail.com> wrote: >> >> >> Can you please prov

Re: Not able to see registered table records and Pyspark not working

Hi, please mind that flag -Pyspark will download full spark binary distribution, so it might take a while for the first time you do it. That was the main reason behind hiding it under the separate profile. On Thu, Jul 9, 2015 at 11:53 PM, moon soo Lee wrote: > You can still manually configure

Re: google charts for zeppelin

Hi Axel, I think the repo you are pointing out is outdated and is not useful for the current Apache Zeppelin (incubating) codebase. That being said, there is an engineer here on the list, Madhuka (in CC) who is working on adding more charts to Zeppelin i.e https://issues.apache.org/jira/browse/ZE

Re: Does zeppelin work on windows?

Hi Puneet, thank you for your interest in Zeppelin. Right now we officially do not support windows platform, but there are at least two ways to get Zeppelin running there: - build using cygwin - or follow this procedure described by one of the community members http://madhukaudantha.blogspot.kr

Re: a small question about zeppelin-manager

Hi, thank you for your interest in the project! It seems like the best way to get Zeppelin up and running in your case would be to build it manually with relevant Spark\Hadoop options as described here http://zeppelin.incubator.apache.org/docs/install/install.html Please, let me know if that hel

Re: a small question about zeppelin-manager

-DskipTests -Dspark.version=1.3.0 > -Dhadoop.version=2.0.0-cdh4.5.0 > (did zeppelin support cdh4.5.0) > Should i have to do the custom built spark > like(-Dspark.version=1.1.0-Custom) > 4.modify my master spark://...:7077 > Is it completed? or i lost something please tell me. > t

Re: Using Trello to Show Mid to High Level features in Apache Zeppelin

Guys, thank you for great suggestions! Am I right that you suggest using Trello not instead of ASF hosted JIRA, but together with it, and are volunteering to support it as a tool for prioritizing user's feedback? Also, how do you think, should we then move further discussion to the d...@zeppelin

Re: Spark memory configuration

Hi, thank you for your interest in Zeppelin! You just have to set the 'Spark' interpreter properties in 'Interpreters' menu: CPU spark.cores.max: 24 Mem spark.executor.memory 22g You actually can use any of the http://spark.apache.org/docs/latest/configuration.html#application-properties th

Re: Anybody has Zeppelin working against AWS EMR 4.0?

HI Francis, thank you for your interest in using Zeppelin with AWS EMR, and please keep sharing it. The reason you have "disconnected" state is that before https://github.com/apache/incubator-zeppelin/pull/170 as it is mentioned here https://github.com/apache/incubator-zeppelin#run Zeppelin neede

Re: how to configure yarn client mode with Zeppelin

Indeed! I think there also should be something like `export HADOOP_CONF_DIR=$HADOOP_CONF_DIR` pointing to YARN-configured hadoop setup, to pick a ResourceManager address. Hope this helps! -- BR, Alexander. On Wed, Jul 29, 2015 at 10:48 AM, Jongyoul Lee wrote: > Hi, > > 1. Copy your configura

Re: reload spark context

Hi, I'm not sure if that exactly 'reload spark context' is, but if you go to 'Interpreters' and hit 'restart' button for the spark interpreter that will restart Spark and create a new context. Other 2 question look like a Spar-specific behaviour, so It might be better to ask Spark community direc

Re: java.util.concurrent.TimeoutException: Futures timed out after [10000 milliseconds]‏

Hi Ankit, did you manage to overcome the difficulties that you descibe? I saw couple other people struggling with the same issue: java.lang.VerifyError: (class: org/jboss/netty/channel/socket/nio/NioWorkerPool, method: createWorker signature: (Ljava/util/concurrent/ Executor;)Lorg/jboss/netty/ch

Re: zeppelin tar file size

Hi, thank you for you interest in Zeppelin project! Yes, by default a build that you did includes a lot of different interpreters like Spark, Flink, Lens, etc so that is why the size is quite substantial. In case you are about to use existing Spark\Hadoop - as of https://issues.apache.org/jira/b

Re: sql interpreter not found

Hi, that is a bit wired, as there is no separate sql interpreter (it is spark one) - you check the interpreter bindings using wrench icon on the right and make sure spark-local is activated and is the first (default) one. Can you also send spark interpret logs, they should be in a separate file,

Re: Spark context configs

Hi, thank you for your interest and welcome to Zeppelin community! The simplest way to set these properties for Spark is thought Interpreter properties. In "Interpreters" menu pick one that is bided to you notebook (spark or spark-local, or, create a new one) and set them w/ '+' sign. Interprete

Re: spark worker log stderr

Hi, I think at this point it might be worth creating an issue to track this and bring it to attention dev@ Thanks! On Wed, Sep 2, 2015 at 12:14 PM, zhao selery wrote: > I run scala code from zeppelin notebook, when I look at spark log from > spark/work/app-20150901193944-0015/0/stderr > Log fi

Re: Build Zeppelin for Spark 1.5 on OSX

Hi, thank you for interest in Zeppelin! It looks like frontend webapp build failed on executing the grunt task (a build system we use in web app). Can you try running it manually (instead of using maven) ``` cd zepelin-web ./grunt ``` and let me know if that works? It suppose to print smth lik

Re: Zeppelin for Windows

Hi thank you for your interest in Zeppelin project! Sure, Zeppelin is a Java applicatoin, so you can run\build it on windows i.e like this http://madhukaudantha.blogspot.kr/2015/04/building-zeppelin-in-windows-8.html On Fri, Sep 18, 2015 at 9:08 AM, Sourav Mazumder < sourav.mazumde...@gmail.co

Re: Zeppelin server can get very slow when logs/ folder is too big

Hi, thank you for bringing it to our attention! What was the rough size of the logs when it started to give you troubles? Indeed muting or explicitly configuring log verbosity makes a lot of sense. May be you could also create an issue in jira to track the progress? Thank you! -- BR, Alex On Su

Re: Help with loading a CSV using Spark-SQL & Spark-CSV

Hi, thank you for your interested in Zeppelin! Couple of things I noticed: as you probably already know , %dep and %spark parts should always be in separate paragraphs. %spark already exposes sql context though `sqlc` variable, so you better use sqlc.load("...") instead. And of course to be abl

Re: temp dirs in Zeppelin - best practice

Hi Leonardo, /tmp is always a safe bet, but notebook directory might be an option as well, although there are no guarantees that it will be preserved there by Zeppelin. Also, probably details on interpreter implementation are not very interesting to all the readers of users@ list so we better mov

Re: Help with loading a CSV using Spark-SQL & Spark-CSV

I clicked save again to >> make sure, then ran it again. I am getting this error: >> >> :17: error: not found: value sqlc >> sqlc.load("com.databricks.spark.csv", Map("path" -> crimeData, "header" -> >> "true")).registerTempTable(

Re: How to export/backup a notebook?

Hi, the simplest way to archive that would be to setup a second notebook storage on s3. To do so you need to add one more argument to ZEPPELIN_NOTEBOOK_STORAGE, org.apache.zeppelin.notebook.repo.S3NotebookRepo and setup ZEPPELIN_NOTEBOOK_S3_BUCKET\USER in the zeppelin-env.sh Alex. On Wed, Oct 7,

Re: Problem Installing Zeppelin

Hi, this is the maven plugin doing a Grunt build of the frontend webapplication failing somehow. For us to investigate the reason, could you post the OS you are using (`uname -a`, `cat /etc/issue`), as well as results of running the same mvn command but with `-e` switch please? Another thing to

Re: Meet Moon soo Lee

Well done, Moon! And thanks a lot for sharing the video ;) On Sat, Oct 31, 2015 at 6:30 PM, Dongjoon Hyun wrote: > Thank you for sharing. > > Cheers, > Dongjoon. > > On Sat, Oct 31, 2015 at 6:05 PM, tog wrote: > >> Hi there, >> >> In case you were not in AMS, here is the video ;-) >> https://m

Re: Get data from Oracle Database using Apache Zeppelin

Great post, thank you fro sharing Alexander! On Fri, Oct 30, 2015, 19:07 Alexander Kardapolov wrote: > Hi everyone! > > Get data from Oracle Database using Apache Zeppelin #Russia #habrahabr > #apachezeppelin @ZeppelinHub @Jetinfosystems > > http://habrahabr.ru/company/jetinfosystems/blog/269769

Re: [ANNOUNCE] Apache Zeppelin 0.5.5-incubating released

Great job, thanks to everybody envolved! Looking forward futher time-based releases of Zeppelin. On Fri, Nov 20, 2015, 09:00 Pablo Torre wrote: > Congrats!! > > Good job guys, as user of Zeppelin I appreciate a lot this effort. > > Best, > > 2015-11-20 0:46 GMT+01:00 임정택 : > >> Congrats! >> >>

Re: Notebook feature - "Link this paragraph"

Thank you Damien for pointing it out. Indeed, it has been taken care of recently, and should be a part of the next release. Please let me know if that still does not work somehow - would be glad to help. -- Alex On Wed, Dec 2, 2015 at 9:14 AM, Corneau Damien wrote: > Hi, > > This bug has been

Re: Zeppelin notes version control, scheduler and external deps

Hi, sorry for the late reply, answering only your first question: >1. How do we version control Zeppelin notes? Now, as https://github.com/apache/incubator-zeppelin/pull/497 has landed to the master - you can enable versioning of the notebooks using Git. Need to build latest Zeppelin though, o

Re: Keep track notebooks

Hi, recently a new, Git notebooks storage [1] was introduced that keeps all the notebooks in the single repository under version control. [1] http://zeppelin.incubator.apache.org/docs/0.6.0-incubating-SNAPSHOT/storage/storage.html#Git Please let me know if that helps! On Tue, Dec 1, 2015 at

Re: Keep track notebooks

ookRepo > notebook persistence layer implementation > > > > 2015-12-10 14:48 GMT+01:00 Pablo Torre : > >> Thanks Alexander! I will take a look. Appreciate your help! >> >> 2015-12-10 12:52 GMT+01:00 Alexander Bezzubov : >> >>> Hi, >>> &g

Re: Zeppelin build fails

CI on master is also failing https://travis-ci.org/apache/incubator-zeppelin Worth posting to dev@ and creating an issue Could this PR interfere with some Karma tests? master fixing z-index for all modals, backdrop and popups ### What is this PR for? This fixes z-index for all modals, backdrop.

Re: Too many open files exception

Hi, wellcome to the Zeppelin community! It looks like you are doing everything right but have some platform-specific issue, that Spark is hitting the limit of open files on your OS. This should not happen, so could you please check what is the current open file limit on your environment/OS and (

2015: year in review

Dear fellow Zeppelin developers and useres, the year 2015 is about to end so I wanted to say thank you to everybody here - its been a great year for the project indeed! Wish you a happy new year and want to share a small review of Zeppelin in 2015 I did https://medium.com/@bzz_/apache-zeppelin-in

[ANNOUNCE] Apache Zeppelin 0.5.6-incubating released

The Apache Zeppelin (incubating) community is pleased to announce the availability of the 0.5.6-incubating release. The community puts significant effort into improving Apache Zeppelin since the last release, focusing on having better API, new backends, improvements on stability and project docume

Re: Incoming conference for Zeppelin

Great stuff, thank you for sharing! On Thu, Feb 11, 2016 at 7:58 AM, DuyHai Doan wrote: > Update done, I have submitted the talk to other conferences too (Devoxx > UK, Devoxx France, GeeCon Poland ...) I'll update and notify as soon as I > receive confirmation that the talk is accepted > > On We

Re: Anyone at Spark Summit East this week?

Hi Silvio, thanks for sharing your plans, that sounds awesome. I was interested in coming to Spark Summit East this year and talking about Zeppelin usecases that we have with our customers, as well as sharing about what I'v been working on regarding integrating Zeppelin with other products like Z

Re: R Interpreter

Hi Ankur, community is working on accepting https://github.com/elbamos/Zeppelin-With-R contribution as a part of Zeppelin codebase before the next release. -- Alex On Tue, Feb 9, 2016, 06:48 DuyHai Doan wrote: > Look at the discussion on the second PR (#702) about this subject of > having 2 PR

Re: zeppelin multi user mode?

Benjamin, z-manager consists of 2 independant applications - installer and multitenancy. You can use only the second one that Hyung Sung pointed out with any spark/zeppelin version. If you have further questions, please do not hesitate to ask at z-mana...@googlegroups.com https://groups.google.co

Re: Unable to start Zeppelin

Hi Ankur, Zeppelin has pluggable Notebook storage implementation , configured i.e though `conf/zeppelin-env.sh` using 'export ZEPPELIN_NOTEBOOK_STORAGE= "org.apache.zeppelin.notebook.repo.VFSNotebookRepo"' (t

Re: Zeppelin server hangs due to websocket deadlock bug in Jetty 8

Hi, thank you Eric, upgrading Jetty sounds like a great idea! Prasad, I think braodcastAll and synchronization of note<->client_connection is used by default to achieve the ability to collaborate over analysis with multiple people at same Note in realtime - to notify all other clients who have th

Re: Zeppelin server hangs due to websocket deadlock bug in Jetty 8

oteInterpreterLoader.getInterpreterSettings(NoteInterpreterLoader.java:60) > at > org.apache.zeppelin.notebook.NoteInterpreterLoader.get(NoteInterpreterLoader.java:77) > at org.apache.zeppelin.notebook.Note.runAll(Note.java:409) > - locked <0x0006c34a12c0> (a java.util.ArrayList) > at o

Re: IDE

Hi, right, maven integration in eclipse works, or you can also use old-school way (with some optimization flags to save time) of generating eclipse projects: mvn eclipse:eclipse -Dcheckstyle.skip=true -Drat.skip=true -Denforcer.skip=true -DskipTests -Pr -pl \!zeppelin-web and then just "Import e