Re: Question on Task Chaining

2015-11-07 Thread Isha Arkatkar
Thanks Stephan! That helps :) Regards, Isha On Sat, Nov 7, 2015 at 7:08 AM, Stephan Ewen wrote: > Hi! > > Chained tasks run in the same thread, and there is no serialization > involved. The FilterFunction is directly called on the result of the > MapFunction. > > Records between non-chained tas

Re: Question on Task Chaining

2015-11-07 Thread Stephan Ewen
Hi! Chained tasks run in the same thread, and there is no serialization involved. The FilterFunction is directly called on the result of the MapFunction. Records between non-chained tasks always go through the serialization stack. Even in the case of non-chained tasks, the different operators sh