Hi, a DEBUG log of the client would indeed be nice. Can you adjust this file:
conf/log4j-cli.properties to the following contents: (basically TRACE logging with netty logs enabled) ################################################################################ # Licensed to the Apache Software Foundation (ASF) under one # or more contributor license agreements. See the NOTICE file # distributed with this work for additional information # regarding copyright ownership. The ASF licenses this file # to you under the Apache License, Version 2.0 (the # "License"); you may not use this file except in compliance # with the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. ################################################################################ # Allows this configuration to be modified at runtime. The file will be checked every 30 seconds. monitorInterval=30 rootLogger.level = TRACE rootLogger.appenderRef.file.ref = FileAppender # Log all infos in the given file appender.file.name = FileAppender appender.file.type = FILE appender.file.append = false appender.file.fileName = ${sys:log.file} appender.file.layout.type = PatternLayout appender.file.layout.pattern = %d{yyyy-MM-dd HH:mm:ss,SSS} %-5p %-60c %x - %m%n # Log output from org.apache.flink.yarn to the console. This is used by the # CliFrontend class when using a per-job YARN cluster. logger.yarn.name = org.apache.flink.yarn logger.yarn.level = INFO logger.yarn.appenderRef.console.ref = ConsoleAppender logger.yarncli.name = org.apache.flink.yarn.cli.FlinkYarnSessionCli logger.yarncli.level = INFO logger.yarncli.appenderRef.console.ref = ConsoleAppender logger.hadoop.name = org.apache.hadoop logger.hadoop.level = INFO logger.hadoop.appenderRef.console.ref = ConsoleAppender # Make sure hive logs go to the file. logger.hive.name = org.apache.hadoop.hive logger.hive.level = INFO logger.hive.additivity = false logger.hive.appenderRef.file.ref = FileAppender # Log output from org.apache.flink.kubernetes to the console. logger.kubernetes.name = org.apache.flink.kubernetes logger.kubernetes.level = INFO logger.kubernetes.appenderRef.console.ref = ConsoleAppender appender.console.name = ConsoleAppender appender.console.type = CONSOLE appender.console.layout.type = PatternLayout appender.console.layout.pattern = %d{yyyy-MM-dd HH:mm:ss,SSS} %-5p %-60c %x - %m%n # suppress the warning that hadoop native libraries are not loaded (irrelevant for the client) logger.hadoopnative.name = org.apache.hadoop.util.NativeCodeLoader logger.hadoopnative.level = OFF # Suppress the irrelevant (wrong) warnings from the Netty channel handler #logger.netty.name = org.apache.flink.shaded.akka.org.jboss.netty.channel.DefaultChannelPipeline #logger.netty.level = OFF And then submit a job locally, and send me the respective log file (containing the "client" string in the file name). Thanks a lot, and stay healthy through the pandemic! Best, Robert On Thu, Apr 15, 2021 at 9:12 PM Klemens Muthmann <klemens.muthm...@cyface.de> wrote: > Hi, > > Since kindergarden time is shortened due to the pandemic I only get four > hours of work into each day and I am supposed to do eight. So unfortunately > I will not be able to develop a fix at the moment. -.- I am happy to > provide any debug log you need or test adaptations and provide fixes as > pull requests. But I will sadly have no time to do any research into the > problem. :( So for now I guess I will be using one of our Linux servers to > test the Flink Pipelines until Silicon is supported. > > Nevertheless, thanks for your answer. If there is anything I can provide > you to narrow down the problem, I am happy to help. > > Regards > Klemens > > Am 15.04.2021 um 20:59 schrieb Robert Metzger <rmetz...@apache.org>: > > Hey Klemens, > > I'm sorry that you are running into this. Looks like you are the first (of > probably many people) who use Flink on a M1 chip. > > If you are up for it, we would really appreciate a fix for this issue, as > a contribution to Flink. > Maybe you can distill the problem into an integration test, so that you > can look into fixes right from your IDE. (It seems that the RestClient is > causing the problems. The client is used by the command line interface to > upload the job to the cluster (that's not happening when executing the job > from the IDE)) > My first guess is that a newer netty version might be required? Or maybe > there's some DEBUG log output that's helpful in understanding the issue? > > > > > On Tue, Apr 13, 2021 at 5:34 PM Klemens Muthmann < > klemens.muthm...@cyface.de> wrote: > >> Hi, >> >> I've just tried to run the basic example for Apache Flink >> <https://ci.apache.org/projects/flink/flink-docs-release-1.12/try-flink/local_installation.html> >> on >> an Apple Mac Pro with the new M1 Processor. I only need this for >> development purposes. The actual thing is going to run on a Linux server >> later on, so I would not mind if it only runs using the Rosetta >> compatibility layer. Unfortunately it failed with the following Stack Trace: >> >> flink-1.12.2 ./bin/flink run examples/streaming/WordCount.jar >> Executing WordCount example with default input data set. >> Use --input to specify file input. >> Printing result to stdout. Use --output to specify output path. >> WARNING: An illegal reflective access operation has occurred >> WARNING: Illegal reflective access by >> org.apache.flink.api.java.ClosureCleaner >> (file:/Users/muthmann/Development/Flink/flink-1.12.2/lib/flink-dist_2.11-1.12.2.jar) >> to field java.lang.String.value >> WARNING: Please consider reporting this to the maintainers of >> org.apache.flink.api.java.ClosureCleaner >> WARNING: Use --illegal-access=warn to enable warnings of further illegal >> reflective access operations >> WARNING: All illegal access operations will be denied in a future release >> >> ------------------------------------------------------------ >> The program finished with the following exception: >> >> org.apache.flink.client.program.ProgramInvocationException: The main method >> caused an error: Failed to execute job 'Streaming WordCount'. >> at >> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:366) >> at >> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:219) >> at >> org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) >> at >> org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:812) >> at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:246) >> at >> org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:1054) >> at >> org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1132) >> at >> org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:28) >> at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1132) >> Caused by: org.apache.flink.util.FlinkException: Failed to execute job >> 'Streaming WordCount'. >> at >> org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:1918) >> at >> org.apache.flink.client.program.StreamContextEnvironment.executeAsync(StreamContextEnvironment.java:135) >> at >> org.apache.flink.client.program.StreamContextEnvironment.execute(StreamContextEnvironment.java:76) >> at >> org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1782) >> at >> org.apache.flink.streaming.examples.wordcount.WordCount.main(WordCount.java:97) >> at >> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native >> Method) >> at >> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >> at >> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.base/java.lang.reflect.Method.invoke(Method.java:566) >> at >> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:349) >> ... 8 more >> Caused by: org.apache.flink.runtime.client.JobSubmissionException: Failed to >> submit JobGraph. >> at >> org.apache.flink.client.program.rest.RestClusterClient.lambda$submitJob$7(RestClusterClient.java:400) >> at >> java.base/java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:986) >> at >> java.base/java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:970) >> at >> java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) >> at >> java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088) >> at >> org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$9(FutureUtils.java:390) >> at >> java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) >> at >> java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837) >> at >> java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) >> at >> java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088) >> at >> org.apache.flink.runtime.rest.RestClient$ClientHandler.channelInactive(RestClient.java:588) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:241) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:81) >> at >> org.apache.flink.shaded.netty4.io.netty.handler.timeout.IdleStateHandler.channelInactive(IdleStateHandler.java:277) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:241) >> at >> org.apache.flink.shaded.netty4.io.netty.handler.stream.ChunkedWriteHandler.channelInactive(ChunkedWriteHandler.java:138) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:241) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:81) >> at >> org.apache.flink.shaded.netty4.io.netty.handler.codec.MessageAggregator.channelInactive(MessageAggregator.java:438) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:241) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelInactive(CombinedChannelDuplexHandler.java:418) >> at >> org.apache.flink.shaded.netty4.io.netty.handler.codec.ByteToMessageDecoder.channelInputClosed(ByteToMessageDecoder.java:389) >> at >> org.apache.flink.shaded.netty4.io.netty.handler.codec.ByteToMessageDecoder.channelInactive(ByteToMessageDecoder.java:354) >> at >> org.apache.flink.shaded.netty4.io.netty.handler.codec.http.HttpClientCodec$Decoder.channelInactive(HttpClientCodec.java:288) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.CombinedChannelDuplexHandler.channelInactive(CombinedChannelDuplexHandler.java:221) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:241) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.DefaultChannelPipeline$HeadContext.channelInactive(DefaultChannelPipeline.java:1405) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:901) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannel$AbstractUnsafe$8.run(AbstractChannel.java:818) >> at >> org.apache.flink.shaded.netty4.io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164) >> at >> org.apache.flink.shaded.netty4.io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:500) >> at >> org.apache.flink.shaded.netty4.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) >> at >> org.apache.flink.shaded.netty4.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) >> at java.base/java.lang.Thread.run(Thread.java:834) >> Caused by: org.apache.flink.runtime.concurrent.FutureUtils$RetryException: >> Could not complete the operation. Number of retries has been exhausted. >> at >> org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$9(FutureUtils.java:386) >> ... 41 more >> Caused by: java.util.concurrent.CompletionException: >> org.apache.flink.runtime.rest.ConnectionClosedException: Channel became >> inactive. >> at >> java.base/java.util.concurrent.CompletableFuture.encodeRelay(CompletableFuture.java:367) >> at >> java.base/java.util.concurrent.CompletableFuture.completeRelay(CompletableFuture.java:376) >> at >> java.base/java.util.concurrent.CompletableFuture$UniRelay.tryFire(CompletableFuture.java:1019) >> ... 39 more >> Caused by: org.apache.flink.runtime.rest.ConnectionClosedException: Channel >> became inactive. >> ... 37 more >> >> Without Rosetta I get: >> >> ./bin/flink run ./examples/streaming/WordCount.jar >> Executing WordCount example with default input data set. >> Use --input to specify file input. >> Printing result to stdout. Use --output to specify output path. >> WARNING: An illegal reflective access operation has occurred >> WARNING: Illegal reflective access by >> org.apache.flink.api.java.ClosureCleaner >> (file:/Users/muthmann/Development/Flink/flink-1.12.2/lib/flink-dist_2.11-1.12.2.jar) >> to field java.lang.String.value >> WARNING: Please consider reporting this to the maintainers of >> org.apache.flink.api.java.ClosureCleaner >> WARNING: Use --illegal-access=warn to enable warnings of further illegal >> reflective access operations >> WARNING: All illegal access operations will be denied in a future release >> >> ------------------------------------------------------------ >> The program finished with the following exception: >> >> org.apache.flink.client.program.ProgramInvocationException: The main >> method caused an error: Failed to execute job 'Streaming WordCount'. >> at >> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:366) >> at >> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:219) >> at >> org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) >> at >> org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:812) >> at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:246) >> at >> org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:1054) >> at >> org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1132) >> at >> org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:28) >> at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1132) >> Caused by: org.apache.flink.util.FlinkException: Failed to execute job >> 'Streaming WordCount'. >> at >> org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:1918) >> at >> org.apache.flink.client.program.StreamContextEnvironment.executeAsync(StreamContextEnvironment.java:135) >> at >> org.apache.flink.client.program.StreamContextEnvironment.execute(StreamContextEnvironment.java:76) >> at >> org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1782) >> at >> org.apache.flink.streaming.examples.wordcount.WordCount.main(WordCount.java:97) >> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native >> Method) >> at >> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >> at >> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.base/java.lang.reflect.Method.invoke(Method.java:566) >> at >> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:349) >> ... 8 more >> Caused by: org.apache.flink.runtime.client.JobSubmissionException: Failed >> to submit JobGraph. >> at >> org.apache.flink.client.program.rest.RestClusterClient.lambda$submitJob$7(RestClusterClient.java:400) >> at >> java.base/java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:986) >> at >> java.base/java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:970) >> at >> java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) >> at >> java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088) >> at >> org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$9(FutureUtils.java:390) >> at >> java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) >> at >> java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837) >> at >> java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) >> at >> java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088) >> at >> org.apache.flink.runtime.rest.RestClient$ClientHandler.exceptionCaught(RestClient.java:613) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:302) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:281) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:273) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireExceptionCaught(CombinedChannelDuplexHandler.java:424) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.ChannelHandlerAdapter.exceptionCaught(ChannelHandlerAdapter.java:92) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.CombinedChannelDuplexHandler$1.fireExceptionCaught(CombinedChannelDuplexHandler.java:145) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.ChannelInboundHandlerAdapter.exceptionCaught(ChannelInboundHandlerAdapter.java:143) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.CombinedChannelDuplexHandler.exceptionCaught(CombinedChannelDuplexHandler.java:231) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:302) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:281) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:273) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.DefaultChannelPipeline$HeadContext.exceptionCaught(DefaultChannelPipeline.java:1377) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:302) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:281) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.DefaultChannelPipeline.fireExceptionCaught(DefaultChannelPipeline.java:907) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.handleReadException(AbstractNioByteChannel.java:125) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:174) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) >> at >> org.apache.flink.shaded.netty4.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) >> at >> org.apache.flink.shaded.netty4.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) >> at java.base/java.lang.Thread.run(Thread.java:834) >> Caused by: >> org.apache.flink.runtime.concurrent.FutureUtils$RetryException: Could not >> complete the operation. Number of retries has been exhausted. >> at >> org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$9(FutureUtils.java:386) >> ... 29 more >> Caused by: java.util.concurrent.CompletionException: java.io.IOException: >> Connection reset by peer >> at >> java.base/java.util.concurrent.CompletableFuture.encodeRelay(CompletableFuture.java:367) >> at >> java.base/java.util.concurrent.CompletableFuture.completeRelay(CompletableFuture.java:376) >> at >> java.base/java.util.concurrent.CompletableFuture$UniRelay.tryFire(CompletableFuture.java:1019) >> ... 27 more >> Caused by: java.io.IOException: Connection reset by peer >> at java.base/sun.nio.ch.FileDispatcherImpl.read0(Native Method) >> at java.base/sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) >> at java.base/sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:276) >> at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:233) >> at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:223) >> at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:358) >> at >> org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253) >> at >> org.apache.flink.shaded.netty4.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350) >> at >> org.apache.flink.shaded.netty4.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148) >> ... 7 more >> >> Funny thing is, I am able to execute a Flink Pipeline from within my >> IntelliJ IDE, so I thought it should be possible somehow. >> >> >> So my question is, did anyone get this to run? Is there any chance of >> executing Flink jobs on Apple Silicon? >> >> I’ve posted the same question on StackOverflow >> <https://stackoverflow.com/questions/67071254/running-apache-flink-1-12-jobs-on-apple-m1-silicon>. >> So If you’d like some points there you are free to head over and post a >> reply. ;) >> >> Thanks and Regards >> Klemens Muthmann >> >> >> >> >
