We have custom join's that leverage it. It is used to get to direct shuffle'ed iterator - without needing sort/aggregate/etc.
IIRC the only way to get to it from ShuffleHandle is via shuffle manager. Regards, Mridul On Wed, Mar 16, 2016 at 3:36 PM, Reynold Xin <r...@databricks.com> wrote: > > On Wed, Mar 16, 2016 at 3:29 PM, Mridul Muralidharan <mri...@gmail.com> > wrote: >> >> b) Shuffle manager (to get shuffle reader) > > > What's the use case for shuffle manager/reader? This seems like using super > internal APIs in applications. > > --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
