starting is easy, just use a lazy val. stopping is harder. i do not think executors have a cleanup hook currently...
On Sun, Aug 9, 2015 at 5:29 AM, Daniel Haviv < [email protected]> wrote: > Hi, > I'd like to start a service with each Spark Executor upon initalization > and have the disributed code reference that service locally. > What I'm trying to do is to invoke torch7 computations without reloading > the model for each row by starting Lua http handler that will recieve http > requests for each row in my data. > > Can this be achieved with Spark ? > > Thank you. > Daniel >
