Re: Scala from Jupyter

2016-02-16 Thread Rajeev Reddy
Hello, As andy mentioned spark notebook works great out of the box and also you can create your own custom spark config (memory stuff, injecting custom jars into notebook, etc) to run for each notebook. I have been using it to write and test my production level spark applications using a huge chun

Re: Scala from Jupyter

2016-02-16 Thread andy petrella
That's great man. Note, if you don't want to struggle too much that you just have to download the version you need here http://spark-notebook.io/ It can be whatever you want zip, tgz, docker or even deb ^^. So pick the flavor you like the most. I'd recommend you two things: 1. build on master to

Re: Scala from Jupyter

2016-02-16 Thread Teng Qiu
Hi Gourav, Hi Alex, you can try this https://github.com/zalando/spark-appliance this docker image (registry.opensource.zalan.do/bi/spark:1.6.0-1) is integrated with Jupyter notebook, plugins (kernels) for spark and R are installed, some python libs, like NumPy,SciPy and matplotlib are already inst

Re: Scala from Jupyter

2016-02-16 Thread Gourav Sengupta
take a look here as well http://zeppelin-project.org/ it executes Scala and Python and Markup document in the same notebook and draws beautiful visualisations as well. It comes built in AWS EMR as well. Regards, Gourav On Tue, Feb 16, 2016 at 12:43 PM, Aleksandr Modestov < aleksandrmodes...@gmai

Re: Scala from Jupyter

2016-02-16 Thread Aleksandr Modestov
Thank you! I will test Spark Notebook. On Tue, Feb 16, 2016 at 3:37 PM, andy petrella wrote: > Hello Alex! > > Rajeev is right, come over the spark notebook gitter room, you'll be > helped by many experienced people if you have some troubles: > https://gitter.im/andypetrella/spark-notebook > > T

Re: Scala from Jupyter

2016-02-16 Thread andy petrella
Hello Alex! Rajeev is right, come over the spark notebook gitter room, you'll be helped by many experienced people if you have some troubles: https://gitter.im/andypetrella/spark-notebook The spark notebook has many integrated, reactive (scala) and extendable (scala) plotting capabilities. cheer

Re: Scala from Jupyter

2016-02-16 Thread Gourav Sengupta
Apache Zeppelin will be the right solution with in built plugins for python and visualizations as well. Are you planning to use this in EMR? Regards, Gourav On Tue, Feb 16, 2016 at 12:04 PM, Rajeev Reddy wrote: > Hello, > > Let me understand your query correctly. > > Case 1. You have a jupyte

Re: Scala from Jupyter

2016-02-16 Thread Rajeev Reddy
Hello, Let me understand your query correctly. Case 1. You have a jupyter installation for python and you want to use it for scala. Solution: You can install kernels other than python Ref Case 2. You want to use spark