Sorry my bad, it did not resolve the issue. I still have the same issue. can anyone please guide me. I was still running as a client instead of a cluster.
On Fri, May 14, 2021 at 5:05 PM KhajaAsmath Mohammed < [email protected]> wrote: > You are right. It worked but I still don't understand why I need to pass > that to all executors. > > On Fri, May 14, 2021 at 5:03 PM KhajaAsmath Mohammed < > [email protected]> wrote: > >> I am using json only to read properties before calling spark session. I >> don't know why we need to pass that to all executors. >> >> >> On Fri, May 14, 2021 at 5:01 PM Longjiang.Yang <[email protected]> >> wrote: >> >>> Could you check whether this file is accessible in executors? (is it in >>> HDFS or in the client local FS) >>> /appl/common/ftp/conf.json >>> >>> >>> >>> >>> >>> *From: *KhajaAsmath Mohammed <[email protected]> >>> *Date: *Friday, May 14, 2021 at 4:50 PM >>> *To: *"user @spark" <[email protected]> >>> *Subject: *[EXTERNAL] Urgent Help - Py Spark submit error >>> >>> >>> >>> /appl/common/ftp/conf.json >>> >>
