hiļ¼all When I run the spark program locally, there is no problem. But when the spark program is run in spark on yarn mode, the following error will be reported
Application application_1596010477013_0734 failed 2 times due to AM Container for appattempt_1596010477013_0734_000002 exited with exitCode: -1000 Failing this attempt.Diagnostics: [2020-08-21 11:42:48.887]No such file or directory ENOENT: No such file or directory at org.apache.hadoop.io.nativeio.NativeIO$POSIX.chmodImpl(Native Method) at org.apache.hadoop.io.nativeio.NativeIO$POSIX.chmod(NativeIO.java:231) at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:773) at org.apache.hadoop.fs.DelegateToFileSystem.setPermission(DelegateToFileSystem.java:218) at org.apache.hadoop.fs.FilterFs.setPermission(FilterFs.java:266) at org.apache.hadoop.fs.FileContext$11.next(FileContext.java:1008) at org.apache.hadoop.fs.FileContext$11.next(FileContext.java:1004) at org.apache.hadoop.fs.FSLinkResolver.resolve(FSLinkResolver.java:90) at org.apache.hadoop.fs.FileContext.setPermission(FileContext.java:1011) at org.apache.hadoop.yarn.util.FSDownload$3.run(FSDownload.java:483) at org.apache.hadoop.yarn.util.FSDownload$3.run(FSDownload.java:481) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875) at org.apache.hadoop.yarn.util.FSDownload.changePermissions(FSDownload.java:481) at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:419) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer$FSDownloadWrapper.doDownloadCall(ContainerLocalizer.java:242) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer$FSDownloadWrapper.call(ContainerLocalizer.java:235) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer$FSDownloadWrapper.call(ContainerLocalizer.java:223) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Can someone help me solve it? wowtua...@gmail.com
