RE: External Application Run Status

2015-04-30 Thread Nastooh Avessta (navesta)
t; – Privacy<http://www.cisco.com/web/siteassets/legal/privacy.html> From: Akhil Das [mailto:ak...@sigmoidanalytics.com] Sent: Thursday, April 30, 2015 1:16 AM To: Nastooh Avessta (navesta) Cc: user@spark.apache.org Subject: Re: External Application Run Status One way you could try would be, Inside

Re: External Application Run Status

2015-04-30 Thread Akhil Das
One way you could try would be, Inside the map, you can have a synchronized thread and you can block the map till the thread finishes up processing. Thanks Best Regards On Wed, Apr 29, 2015 at 9:38 AM, Nastooh Avessta (navesta) < nave...@cisco.com> wrote: > Hi > > In a multi-node setup, I am in

External Application Run Status

2015-04-28 Thread Nastooh Avessta (navesta)
Hi In a multi-node setup, I am invoking a number external apps, through Runtime.getRuntime.exec from rdd.map function, and would like to track their completion status. Evidently, such calls spawn a separate thread, which is not tracked by the standalone scheduler, i.e., reduce or collect are cal