MiniOozie for local dryrun or other options for doing dryrun of oozie workflows?

Hi, did anyone make it work property in his project? I need to do dry run for my workflows. The usecase is: User writes workflow and wants to: 1. Check if it valid 2. do dryrun, see how it flows without executing steps. Let say I have wflow with three steps: 1. disctp data from $A to $B 2. run sp

[ANNOUNCE] Apache Oozie 4.3.0 released

Hello Oozie Community, The Apache Oozie team is pleased to announce the release of Oozie 4.3.0. Oozie 4.3.0 includes new features, bug fixes and minor improvements. The details of the release and download location can be found at http://oozie.apache.org/ The full release notes can be found at t

Re: MiniOozie for local dryrun or other options for doing dryrun of oozie workflows?

Hi Serega, It turns out that LocalOozieClient is missing some methods that it should be implementing to call DagEngine (see OOZIE-2751 ). One of those is the dryrun method, which is why that's not working for you. For now, calling DagEngine direc

Re: [ANNOUNCE] Apache Oozie 4.3.0 released

Congrats on the release! Thanks to everyone who helped and contributed. It's good to have a new release after so long (June 2015). - Robert On Fri, Dec 2, 2016 at 5:28 AM, Abhishek Bafna wrote: > Hello Oozie Community, > > The Apache Oozie team is pleased to announce the release of Oozie 4.3.0.

Oozie : Run a spark job when data is available in kafka topic

Hi team , is it possible to launch a spark job using oozie when data is available in kafka topic ? Regards Prateek

Re: Oozie : Run a spark job when data is available in kafka topic

Currently, Oozie can look at data dependencies in hcat, hdfs, but do not have support for kafka topics. You can have a java action which can keep on checking for topic in kafka (probably using some REST APIs available in kafka. I don't know much about kafka) and once the topic is available go to th