Hi, Reynold from the Shark team at Berkeley here.
I haven't tried this on Windows myself, but for single node testing, if you have a bash shell (e.g. Cygwin), and you are able to launch Shark using the bash script, then it should work. The biggest unknown factor is whether the Hive metastore would work on Windows. We do rely on the Hive code path to read from the metastore. -- Reynold Xin AMPLab, UC Berkeley http://www.cs.berkeley.edu/~rxin/ On Wed, Nov 14, 2012 at 3:20 PM, Mark Grover <grover.markgro...@gmail.com>wrote: > All yours! > > ---------- Forwarded message ---------- > From: Dean Wampler <dean.wamp...@thinkbiganalytics.com> > Date: Wed, Nov 14, 2012 at 3:17 PM > Subject: Run Shark on Windows? > To: user <user@hive.apache.org> > > > Since we had two requests today for help on using Hive in > Cygwin/Windows, which doesn't work, I wonder if anyone has tried Shark > on Windows? Shark is the port of Hive to Spark, which supports a local > mode that just might work fine for testing and debugging on windows. > > I've only tried Shark on the Mac and I used it with HDFS and my > pseudo-distributed mode Hadoop installation, so I have no idea if this > will work on Windows and work well. However, I would try it if I were > a Windows user ;) > > Note that Shark is not feature complete with Hive at this time. Also, > it might just be easier to bite the bullet and install a virtual > machine image of Hadoop on Linux running in VMWare or VirtualBox, > anyway. > > dean > > -- > Dean Wampler, Ph.D. > thinkbiganalytics.com > +1-312-339-1330 > >
