Re: [WAS Re: periodic execution] Oozie Hive action

oozie-core.jar, instead can we have the >>> hive-default.xml is the same folder of workflow.xml in the hdfs, so when I >>> change the hive-default.xml I don’t have to bundle the jar again. >>> >>> >>> >>> Regards, >>> >>> Balaji >&g

[WAS Re: periodic execution] Oozie Hive action

fault.xml I don’t have to bundle the jar again. >> >> >> >> Regards, >> >> Balaji >> >> >> >> *From:* Alejandro Abdelnur [mailto:t...@cloudera.com] >> *Sent:* Thursday, February 10, 2011 3:12 AM >> *To:* user@hive.apache.org >&

RE: periodic execution

[mailto:t...@cloudera.com] Sent: Thursday, February 10, 2011 2:22 PM To: Balaji Rajagopalan Cc: user@hive.apache.org; oozie-users Subject: Re: periodic execution Hi Balaji, The latest patch of the Hive action does not bundle hive-default.xml (got same feedback from Carl), you'll be responsibl

Re: [Oozie-users] Re: periodic execution

again. >> >> >> >> Regards, >> >> Balaji >> >> >> >> *From:* Alejandro Abdelnur [mailto:t...@cloudera.com] >> *Sent:* Thursday, February 10, 2011 3:12 AM >> *To:* user@hive.apache.org >> *Subject:* Re: periodic execution &g

Re: periodic execution

i > > > > *From:* Alejandro Abdelnur [mailto:t...@cloudera.com] > *Sent:* Thursday, February 10, 2011 3:12 AM > *To:* user@hive.apache.org > *Subject:* Re: periodic execution > > > > Hi Cam, > > > > A bit of information that may be useful for you,

RE: periodic execution

ubject: Re: periodic execution Hi Cam, A bit of information that may be useful for you, Cloudera's Oozie has a Hive action that you can use from workflow jobs. Cheers Alejandro On Wed, Feb 9, 2011 at 11:44 AM, Cam Bazz mailto:camb...@gmail.com>> wrote: Hello, I am looking over ooz

Re: periodic execution

Hi Cam, A bit of information that may be useful for you, Cloudera's Oozie has a Hive action that you can use from workflow jobs. Cheers Alejandro On Wed, Feb 9, 2011 at 11:44 AM, Cam Bazz wrote: > Hello, > > I am looking over oozie's coordinator. But meanwhile, I managed to > write a simple j

Re: periodic execution

Try Azkaban - We use it here @ngmoco to run MR Jobs (not Hive Queries) and its pretty good - http://sna-projects.com/azkaban/ Also, it is faster learning / easy to setup. I have never worked on Oozie so I can't compare but you can google it. On Feb 8, 2011, at 7:44 PM, Cam Bazz wrote: > Hello

Re: periodic execution

Hello, I am looking over oozie's coordinator. But meanwhile, I managed to write a simple java program to connect to hive using jdbc. I can import data and execute queries. I was wondering, somewhat for doing workflows, one needs to keep metadata, i.e. which was the last file, partition processed

Re: periodic execution

Hey Cam, You should use Oozie's Coordinator: https://github.com/yahoo/oozie/wiki/Oozie-Coord-Use-Cases. Regards, Jeff On Tue, Feb 8, 2011 at 4:29 PM, Cam Bazz wrote: > Hello, > > What kind of strategy must i follow, in order to periodically run > certain things. > > For example, each hour, i w

periodic execution

Hello, What kind of strategy must i follow, in order to periodically run certain things. For example, each hour, i want to look up log files from certain dir, and for new files, i need to run: load data local inpath '/home/cam/logs/log.2011310120' into table item_view_raw partition (date_hour=20