Any body has anything to share here? Thanks, Som
On Mon, Jun 17, 2013 at 3:25 PM, Som Satpathy <[email protected]> wrote: > Hi, > > I had a question regarding a use case where a user might want to design > and execute workflows on YARN/Mesos which runs hadoop and spark in > parallel. Does Oozie currently support or will it support in future actions > that can execute in a framework agnostic manner? > > For simplicity let's consider an example - a user defines a workflow as > follows: > > Step1: Mapreduce over hadoop job to do some initial data processing > (Input: data from s3, output: data into s3) > Step2: Spark job to further process the data (Input: data from s3, output: > data into s3) > > Here assumption is both hadoop and spark are running in the same cluster > managed by YARN/Mesos. > > Can oozie support such a usecase today? > > Thanks, > Som >
