Re: File not found exceptions on S3 while running spark jobs

2020-07-17 Thread Hulio andres
://examples.javacodegeeks.com/java-io-filenotfoundexception-how-to-solve-file-not-found-exception/ > > > > Are you a programmer ? > > > > Regards, > > > > Hulio > > > > > > > > > Sent: Friday, July 17, 2020 at 2:41 AM > > > From: "

Re: File not found exceptions on S3 while running spark jobs

2020-07-17 Thread Slava Rodionov
te: > >> >> https://examples.javacodegeeks.com/java-io-filenotfoundexception-how-to-solve-file-not-found-exception/ >> >> Are you a programmer ? >> >> Regards, >> >> Hulio >> >> >> >> > Sent: Friday, July 17, 2020 at 2:41 A

Re: File not found exceptions on S3 while running spark jobs

2020-07-17 Thread Nagendra Darla
Regards, > > Hulio > > > > > Sent: Friday, July 17, 2020 at 2:41 AM > > From: "Nagendra Darla" > > To: user@spark.apache.org > > Subject: File not found exceptions on S3 while running spark jobs > > > > Hello All, > > I am converting

Re: File not found exceptions on S3 while running spark jobs

2020-07-16 Thread Hulio andres
https://examples.javacodegeeks.com/java-io-filenotfoundexception-how-to-solve-file-not-found-exception/ Are you a programmer ? Regards, Hulio > Sent: Friday, July 17, 2020 at 2:41 AM > From: "Nagendra Darla" > To: user@spark.apache.org > Subject: File not found

File not found exceptions on S3 while running spark jobs

2020-07-16 Thread Nagendra Darla
Hello All, I am converting existing parquet table (size: 50GB) into Delta format. It took around 1hr 45 mins to convert. And I see that there are lot of FileNotFoundExceptions in the logs Caused by: java.io.FileNotFoundException: No such file or directory: s3a://old-data/delta-data/PL1/output/deno