Workflow manager tool for scheduling spark jobs on cassandra

2015-08-06 Thread Vikram Kone
Hi, I'm looking for open source workflow tools/engines that allow us to schedule spark jobs on a cassandra cluster. Since there are tonnes of alternatives out there like Ozzie, Azkaban, Luigi , Chronos etc, I wanted to check with people here to see what they are using today. Some of the requiremen

Re: Need advice for Spark newbie

2015-02-26 Thread Vikram Kone
r data into a wasb you can try all three > methods and see which one works best for you. HDInsights works well for > mixing & matching tools. > > > > HTH, > > - SteveN > > > > -Original Message- > From: Dean Wampler [mailto:deanwamp..

Re: Need advice for Spark newbie

2015-02-26 Thread Vikram Kone
> @deanwampler <http://twitter.com/deanwampler> > http://polyglotprogramming.com > > On Thu, Feb 26, 2015 at 1:56 AM, Vikram Kone > wrote: > >> Hi, >> I'm a newbie when it comes to Spark and Hadoop eco system in general. Our >> team has been predominant

Need advice for Spark newbie

2015-02-25 Thread Vikram Kone
Hi, I'm a newbie when it comes to Spark and Hadoop eco system in general. Our team has been predominantly a Microsoft shop that uses MS stack for most of their BI needs. So we are talking SQL server for storing relational data and SQL Server Analysis services for building MOLAP cubes for sub-secon