It might kind of work, but you are effectively making all of your workers into mini, separate Spark drivers in their own right. This might cause snags down the line as this isn't the normal thing to do.
On Tue, Oct 28, 2014 at 12:11 AM, Localhost shell <[email protected]> wrote: > Hey lordjoe, > > Apologies for the late reply. > > I followed your threadlocal approach and it worked fine. I will update the > thread if I get to know more on this. > (Don't know how Spark Scala does it but what I wanted to achieve in java is > quiet common in many spark-scala github gists) > > Thanks. > --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
