If you use any shuffle service before 2.0 it should be compatible with
all previous releases.
The 2.0 version has currently an incompatibility that we should
probably patch before releasing 2.0, to support this kind of use case
(among others).
On Fri, Mar 18, 2016 at 7:25 PM, Koert Kuipers wrote
On 19 Mar 2016, at 02:25, Koert Kuipers
mailto:ko...@tresata.com>> wrote:
spark on yarn is nice because i can bring my own spark. i am worried that the
shuffle service forces me to use some "sanctioned" spark version that is
officially "installed" on the cluster.
so... can i safely install th
spark on yarn is nice because i can bring my own spark. i am worried that
the shuffle service forces me to use some "sanctioned" spark version that
is officially "installed" on the cluster.
so... can i safely install the spark 1.3 shuffle service on yarn and use it
with other 1.x versions of spark
