Re: Job Scheduling in Hadoop-Hive

Hi Ronak, Pentaho has been our scheduling/workflow management tool of choice. Previously we had used cloudera's bundled oozie in cdh3u2. Jordan Hambleton ASUP Data Processing & Services [CFT] From: Ronak Bhatt mailto:ronakb...@gmail.com>> Reply-To: "user@hive.apache.org

RE: Job Scheduling in Hadoop-Hive

Hey, We use hadoop/hive for processing our access logs and we run a daily cronjob (python script) which does the parsing jobs and some partitioning etc. The results from those jobs are then queried on by other jobs which generate the results the management team wants to see :-) From: Ronak Bh

Re: Job Scheduling in Hadoop-Hive

Spring batch with a basic tasklet for querying the hive db should be of help. :) On 26.05.2012, at 17:48, Ronak Bhatt wrote: Hello - For those users whose setup is somewhat production, what do you use for job scheduling and dependency management? *thanks, ronak* * * * *

Re: Job Scheduling in Hadoop-Hive

On 26 May 2012, at 18:52, Senthilvel Rangaswamy wrote: > On Sat, May 26, 2012 at 7:48 AM, Ronak Bhatt wrote: > Hello - > > For those users whose setup is somewhat production, what do you use for job > scheduling and dependency management? > > > > Oozie has both job scheduling and dependen

Re: Job Scheduling in Hadoop-Hive

On Sat, May 26, 2012 at 7:48 AM, Ronak Bhatt wrote: > Hello - > > For those users whose setup is somewhat production, what do you use for > job scheduling and dependency management? > > ** > Oozie has both job scheduling and dependency management. You can also use something like rundeck if you

Re: Job Scheduling in Hadoop-Hive

Oozie for workflow pipelines, manually triggered but would use a cron. Maven for everything, including packaging oozie stuff. All open source so can point you at it if you want to poke around? Tim, Sent from my iPhone (which makes terrible auto-correct spelling mistakes) On 26 May 2012, at 16:4

Re: Job Scheduling in Hadoop-Hive

Try Oozie. Regards, Abhishek On Sat, May 26, 2012 at 7:48 AM, Ronak Bhatt wrote: > Hello - > > For those users whose setup is somewhat production, what do you use for > job scheduling and dependency management? > > *thanks, ronak* > * > * > * > * > >