m also seeing in mine, but it's better to track
> > these in a bug instead of e-mail.
> >
> > Please file a bug and attach your logs there, I'll take a look at this.
> >
> > On Thu, Jul 20, 2017 at 2:06 PM, Udit Mehrotra
> > wrote:
> >> Hi M
19, 2017 at 1:10 PM, Udit Mehrotra
> wrote:
> > Is there any additional configuration I need for external shuffle besides
> > setting the following:
> > spark.network.crypto.enabled true
> > spark.network.crypto.saslFallback false
> > spark.authenticate
you install the Spark shuffle service on YARN? It's not
> part of YARN.
>
> If you really have the Spark 2.2 shuffle service jar deployed in your
> YARN service, then perhaps you didn't configure it correctly to use
> the new auth mechanism.
>
> On Wed, Jul 19, 2017 a
!
On Wed, Jul 19, 2017 at 12:03 PM, Marcelo Vanzin
wrote:
> Please include the list on your replies, so others can benefit from
> the discussion too.
>
> On Wed, Jul 19, 2017 at 11:43 AM, Udit Mehrotra
> wrote:
> > Hi Marcelo,
> >
> > Thanks a lot for confirming th
Hi Spark Dev’s,
I am trying out the new Spark’s internal authentication mechanism based off
AES encryption, https://issues.apache.org/jira/browse/SPARK-19139 which has
come up in Spark 2.2.0.
I set the following properties in my spark-defaults:
spark.network.crypto.enabled true
spark.network.cryp
