Re: Add hot-deploy capability in Spark Shell

2016-06-06 Thread Kai Chen
in RDD and > temporary view creation in SQL. > > On Mon, Jun 6, 2016 at 3:40 PM, S. Kai Chen > wrote: > >> Hi, >> >> We use spark-shell heavily for ad-hoc data analysis as well as iterative >> development of the analytics code. A common workflow consists the f

Add hot-deploy capability in Spark Shell

2016-06-06 Thread S. Kai Chen
Hi, We use spark-shell heavily for ad-hoc data analysis as well as iterative development of the analytics code. A common workflow consists the following steps: 1. Write a small Scala module, assemble the fat jar 2. Start spark-shell with the assembly jar file 3. Try out some ideas in the