You'd need the jar file (holding class definitions etc.) to do the deserialisation on the executor.
On 18 June 2015 at 03:48, Shiyao Ma <[email protected]> wrote: > Hi, > > Looking from my executor logs, the submitted application jar is > transmitted to each executors? > > Why does spark do the above? To my understanding, the tasks to be run > are already serialized with TaskDescription. > > > Regards. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
