You are right. It worked but I still don't understand why I need to pass that to all executors.
On Fri, May 14, 2021 at 5:03 PM KhajaAsmath Mohammed < mdkhajaasm...@gmail.com> wrote: > I am using json only to read properties before calling spark session. I > don't know why we need to pass that to all executors. > > > On Fri, May 14, 2021 at 5:01 PM Longjiang.Yang <longjiang.y...@target.com> > wrote: > >> Could you check whether this file is accessible in executors? (is it in >> HDFS or in the client local FS) >> /appl/common/ftp/conf.json >> >> >> >> >> >> *From: *KhajaAsmath Mohammed <mdkhajaasm...@gmail.com> >> *Date: *Friday, May 14, 2021 at 4:50 PM >> *To: *"user @spark" <user@spark.apache.org> >> *Subject: *[EXTERNAL] Urgent Help - Py Spark submit error >> >> >> >> /appl/common/ftp/conf.json >> >
