You are right. It worked but I still don't understand why I need to pass that to all executors.
On Fri, May 14, 2021 at 5:03 PM KhajaAsmath Mohammed < [email protected]> wrote: > I am using json only to read properties before calling spark session. I > don't know why we need to pass that to all executors. > > > On Fri, May 14, 2021 at 5:01 PM Longjiang.Yang <[email protected]> > wrote: > >> Could you check whether this file is accessible in executors? (is it in >> HDFS or in the client local FS) >> /appl/common/ftp/conf.json >> >> >> >> >> >> *From: *KhajaAsmath Mohammed <[email protected]> >> *Date: *Friday, May 14, 2021 at 4:50 PM >> *To: *"user @spark" <[email protected]> >> *Subject: *[EXTERNAL] Urgent Help - Py Spark submit error >> >> >> >> /appl/common/ftp/conf.json >> >
