Hey, I'm trying to build Flink and failing. I'm running Ubuntu 20.04.1 in a virtual machine on Windows 10. I'm using OpenJDK 11.0.8. I'm on the master branch, commit 9eae578ae592254d54bc51c679644e8e84c65152.
The command I'm using: apache-maven-3.2.5/bin/mvn clean verify The output: [INFO] Flink : Tests ...................................... FAILURE [14:38 min] [INFO] Flink : Streaming Scala ............................ SKIPPED [INFO] Flink : Connectors : HCatalog ...................... SKIPPED [INFO] Flink : Connectors : Base .......................... SKIPPED [INFO] Flink : Connectors : Files ......................... SKIPPED [INFO] Flink : Table : .................................... SKIPPED [INFO] Flink : Table : Common ............................. SKIPPED [INFO] Flink : Table : API Java ........................... SKIPPED [INFO] Flink : Table : API Java bridge .................... SKIPPED [INFO] Flink : Table : API Scala .......................... SKIPPED [INFO] Flink : Table : API Scala bridge ................... SKIPPED [INFO] Flink : Table : SQL Parser ......................... SKIPPED [INFO] Flink : Libraries : ................................ SKIPPED [INFO] Flink : Libraries : CEP ............................ SKIPPED [INFO] Flink : Table : Planner ............................ SKIPPED [INFO] Flink : Table : SQL Parser Hive .................... SKIPPED [INFO] Flink : Table : Runtime Blink ...................... SKIPPED [INFO] Flink : Table : Planner Blink ...................... SKIPPED [INFO] Flink : Metrics : JMX .............................. SKIPPED [INFO] Flink : Formats : .................................. SKIPPED [INFO] Flink : Formats : Json ............................. SKIPPED [INFO] Flink : Connectors : Kafka base .................... SKIPPED [INFO] Flink : Connectors : Elasticsearch base ............ SKIPPED [INFO] Flink : Connectors : Elasticsearch 5 ............... SKIPPED [INFO] Flink : Connectors : Elasticsearch 6 ............... SKIPPED [INFO] Flink : Connectors : Elasticsearch 7 ............... SKIPPED [INFO] Flink : Connectors : HBase base .................... SKIPPED [INFO] Flink : Connectors : HBase 1.4 ..................... SKIPPED [INFO] Flink : Connectors : HBase 2.2 ..................... SKIPPED [INFO] Flink : Formats : Hadoop bulk ...................... SKIPPED [INFO] Flink : Formats : Orc .............................. SKIPPED [INFO] Flink : Formats : Orc nohive ....................... SKIPPED [INFO] Flink : Formats : Avro ............................. SKIPPED [INFO] Flink : Formats : Parquet .......................... SKIPPED [INFO] Flink : Formats : Csv .............................. SKIPPED [INFO] Flink : Connectors : Hive .......................... SKIPPED [INFO] Flink : Connectors : JDBC .......................... SKIPPED [INFO] Flink : Connectors : RabbitMQ ...................... SKIPPED [INFO] Flink : Connectors : Twitter ....................... SKIPPED [INFO] Flink : Connectors : Nifi .......................... SKIPPED [INFO] Flink : Connectors : Cassandra ..................... SKIPPED [INFO] Flink : Connectors : Filesystem .................... SKIPPED [INFO] Flink : Connectors : Kafka ......................... SKIPPED [INFO] Flink : Connectors : Google PubSub ................. SKIPPED [INFO] Flink : Connectors : Kinesis ....................... SKIPPED [INFO] Flink : Connectors : SQL : Elasticsearch 6 ......... SKIPPED [INFO] Flink : Connectors : SQL : Elasticsearch 7 ......... SKIPPED [INFO] Flink : Connectors : SQL : HBase 1.4 ............... SKIPPED [INFO] Flink : Connectors : SQL : HBase 2.2 ............... SKIPPED [INFO] Flink : Connectors : SQL : Hive 1.2.2 .............. SKIPPED [INFO] Flink : Connectors : SQL : Hive 2.2.0 .............. SKIPPED [INFO] Flink : Connectors : SQL : Hive 2.3.6 .............. SKIPPED [INFO] Flink : Connectors : SQL : Hive 3.1.2 .............. SKIPPED [INFO] Flink : Connectors : SQL : Kafka ................... SKIPPED [INFO] Flink : Formats : Avro confluent registry .......... SKIPPED [INFO] Flink : Formats : Sequence file .................... SKIPPED [INFO] Flink : Formats : Compress ......................... SKIPPED [INFO] Flink : Formats : SQL Orc .......................... SKIPPED [INFO] Flink : Formats : SQL Parquet ...................... SKIPPED [INFO] Flink : Formats : SQL Avro ......................... SKIPPED [INFO] Flink : Examples : Streaming ....................... SKIPPED [INFO] Flink : Examples : Table ........................... SKIPPED [INFO] Flink : Examples : Build Helper : .................. SKIPPED [INFO] Flink : Examples : Build Helper : Streaming Twitter SKIPPED [INFO] Flink : Examples : Build Helper : Streaming State machine SKIPPED [INFO] Flink : Examples : Build Helper : Streaming Google PubSub SKIPPED [INFO] Flink : Container .................................. SKIPPED [INFO] Flink : Queryable state : Runtime .................. SKIPPED [INFO] Flink : Mesos ...................................... SKIPPED [INFO] Flink : Kubernetes ................................. SKIPPED [INFO] Flink : Yarn ....................................... SKIPPED [INFO] Flink : Libraries : Gelly .......................... SKIPPED [INFO] Flink : Libraries : Gelly scala .................... SKIPPED [INFO] Flink : Libraries : Gelly Examples ................. SKIPPED [INFO] Flink : External resources : ....................... SKIPPED [INFO] Flink : External resources : GPU ................... SKIPPED [INFO] Flink : Metrics : Dropwizard ....................... SKIPPED [INFO] Flink : Metrics : Graphite ......................... SKIPPED [INFO] Flink : Metrics : InfluxDB ......................... SKIPPED [INFO] Flink : Metrics : Prometheus ....................... SKIPPED [INFO] Flink : Metrics : StatsD ........................... SKIPPED [INFO] Flink : Metrics : Datadog .......................... SKIPPED [INFO] Flink : Metrics : Slf4j ............................ SKIPPED [INFO] Flink : Libraries : CEP Scala ...................... SKIPPED [INFO] Flink : Table : Uber ............................... SKIPPED [INFO] Flink : Table : Uber Blink ......................... SKIPPED [INFO] Flink : Python ..................................... SKIPPED [INFO] Flink : Table : SQL Client ......................... SKIPPED [INFO] Flink : Libraries : State processor API ............ SKIPPED [INFO] Flink : ML : ....................................... SKIPPED [INFO] Flink : ML : API ................................... SKIPPED [INFO] Flink : ML : Lib ................................... SKIPPED [INFO] Flink : ML : Uber .................................. SKIPPED [INFO] Flink : Scala shell ................................ SKIPPED [INFO] Flink : Dist ....................................... SKIPPED [INFO] Flink : Yarn Tests ................................. SKIPPED [INFO] Flink : E2E Tests : ................................ SKIPPED [INFO] Flink : E2E Tests : CLI ............................ SKIPPED [INFO] Flink : E2E Tests : Parent Child classloading program SKIPPED [INFO] Flink : E2E Tests : Parent Child classloading lib-package SKIPPED [INFO] Flink : E2E Tests : Dataset allround ............... SKIPPED [INFO] Flink : E2E Tests : Dataset Fine-grained recovery .. SKIPPED [INFO] Flink : E2E Tests : Datastream allround ............ SKIPPED [INFO] Flink : E2E Tests : Batch SQL ...................... SKIPPED [INFO] Flink : E2E Tests : Stream SQL ..................... SKIPPED [INFO] Flink : E2E Tests : Bucketing sink ................. SKIPPED [INFO] Flink : E2E Tests : Distributed cache via blob ..... SKIPPED [INFO] Flink : E2E Tests : High parallelism iterations .... SKIPPED [INFO] Flink : E2E Tests : Stream stateful job upgrade .... SKIPPED [INFO] Flink : E2E Tests : Queryable state ................ SKIPPED [INFO] Flink : E2E Tests : Local recovery and allocation .. SKIPPED [INFO] Flink : E2E Tests : Elasticsearch 5 ................ SKIPPED [INFO] Flink : E2E Tests : Elasticsearch 6 ................ SKIPPED [INFO] Flink : Quickstart : ............................... SKIPPED [INFO] Flink : Quickstart : Java .......................... SKIPPED [INFO] Flink : Quickstart : Scala ......................... SKIPPED [INFO] Flink : E2E Tests : Quickstart ..................... SKIPPED [INFO] Flink : E2E Tests : Confluent schema registry ...... SKIPPED [INFO] Flink : E2E Tests : Stream state TTL ............... SKIPPED [INFO] Flink : E2E Tests : SQL client ..................... SKIPPED [INFO] Flink : E2E Tests : Streaming file sink ............ SKIPPED [INFO] Flink : E2E Tests : State evolution ................ SKIPPED [INFO] Flink : E2E Tests : RocksDB state memory control ... SKIPPED [INFO] Flink : E2E Tests : Common ......................... SKIPPED [INFO] Flink : E2E Tests : Metrics availability ........... SKIPPED [INFO] Flink : E2E Tests : Metrics reporter prometheus .... SKIPPED [INFO] Flink : E2E Tests : Heavy deployment ............... SKIPPED [INFO] Flink : E2E Tests : Connectors : Google PubSub ..... SKIPPED [INFO] Flink : E2E Tests : Streaming Kafka base ........... SKIPPED [INFO] Flink : E2E Tests : Streaming Kafka ................ SKIPPED [INFO] Flink : E2E Tests : Plugins : ...................... SKIPPED [INFO] Flink : E2E Tests : Plugins : Dummy fs ............. SKIPPED [INFO] Flink : E2E Tests : Plugins : Another dummy fs ..... SKIPPED [INFO] Flink : E2E Tests : TPCH ........................... SKIPPED [INFO] Flink : E2E Tests : Streaming Kinesis .............. SKIPPED [INFO] Flink : E2E Tests : Elasticsearch 7 ................ SKIPPED [INFO] Flink : E2E Tests : Common Kafka ................... SKIPPED [INFO] Flink : E2E Tests : TPCDS .......................... SKIPPED [INFO] Flink : E2E Tests : Netty shuffle memory control ... SKIPPED [INFO] Flink : E2E Tests : Python ......................... SKIPPED [INFO] Flink : E2E Tests : HBase .......................... SKIPPED [INFO] Flink : State backends : Heap spillable ............ SKIPPED [INFO] Flink : Contrib : .................................. SKIPPED [INFO] Flink : Contrib : Connectors : Wikiedits ........... SKIPPED [INFO] Flink : FileSystems : Tests ........................ SKIPPED [INFO] Flink : Docs ....................................... SKIPPED [INFO] Flink : Walkthrough : .............................. SKIPPED [INFO] Flink : Walkthrough : Common ....................... SKIPPED [INFO] Flink : Walkthrough : Datastream Java .............. SKIPPED [INFO] Flink : Walkthrough : Datastream Scala ............. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 36:49 min [INFO] Finished at: 2020-10-19T18:24:46+03:00 [INFO] Final Memory: 179M/614M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.22.1:test (integration-tests) on project flink-tests: There are test failures. [ERROR] [ERROR] Please refer to /home/juha/git/apache-flink/flink-tests/target/surefire-reports for the individual test results. [ERROR] Please refer to dump files (if any exist) [date].dump, [date]-jvmRun[N].dump and [date].dumpstream. [ERROR] ExecutionException The forked VM terminated without properly saying goodbye. VM crash or System.exit called? [ERROR] Command was /bin/sh -c cd /home/juha/git/apache-flink/flink-tests/target && /usr/lib/jvm/java-11-openjdk-amd64/bin/java -Xms256m -Xmx2048m -Dmvn.forkNumber=3 -XX:+UseG1GC -jar /home/juha/git/apache-flink/flink-tests/target/surefire/surefirebooter11703198505285401478.jar /home/juha/git/apache-flink/flink-tests/target/surefire 2020-10-19T17-48-02_394-jvmRun3 surefire14859194279791928992tmp surefire_122313349068739873924160tmp [ERROR] Error occurred in starting fork, check output in log [ERROR] Process Exit Code: 137 [ERROR] Crashed tests: [ERROR] org.apache.flink.test.checkpointing.EventTimeWindowCheckpointingITCase [ERROR] org.apache.maven.surefire.booter.SurefireBooterForkException: ExecutionException The forked VM terminated without properly saying goodbye. VM crash or System.exit called? [ERROR] Command was /bin/sh -c cd /home/juha/git/apache-flink/flink-tests/target && /usr/lib/jvm/java-11-openjdk-amd64/bin/java -Xms256m -Xmx2048m -Dmvn.forkNumber=3 -XX:+UseG1GC -jar /home/juha/git/apache-flink/flink-tests/target/surefire/surefirebooter11703198505285401478.jar /home/juha/git/apache-flink/flink-tests/target/surefire 2020-10-19T17-48-02_394-jvmRun3 surefire14859194279791928992tmp surefire_122313349068739873924160tmp [ERROR] Error occurred in starting fork, check output in log [ERROR] Process Exit Code: 137 [ERROR] Crashed tests: [ERROR] org.apache.flink.test.checkpointing.EventTimeWindowCheckpointingITCase [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510) [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457) [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298) [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246) [ERROR] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183) [ERROR] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011) [ERROR] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857) [ERROR] at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132) [ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208) [ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) [ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) [ERROR] at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116) [ERROR] at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80) [ERROR] at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) [ERROR] at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120) [ERROR] at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:355) [ERROR] at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155) [ERROR] at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584) [ERROR] at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:216) [ERROR] at org.apache.maven.cli.MavenCli.main(MavenCli.java:160) [ERROR] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [ERROR] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [ERROR] at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [ERROR] at java.base/java.lang.reflect.Method.invoke(Method.java:566) [ERROR] at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) [ERROR] at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) [ERROR] at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) [ERROR] at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) [ERROR] Caused by: org.apache.maven.surefire.booter.SurefireBooterForkException: The forked VM terminated without properly saying goodbye. VM crash or System.exit called? [ERROR] Command was /bin/sh -c cd /home/juha/git/apache-flink/flink-tests/target && /usr/lib/jvm/java-11-openjdk-amd64/bin/java -Xms256m -Xmx2048m -Dmvn.forkNumber=3 -XX:+UseG1GC -jar /home/juha/git/apache-flink/flink-tests/target/surefire/surefirebooter11703198505285401478.jar /home/juha/git/apache-flink/flink-tests/target/surefire 2020-10-19T17-48-02_394-jvmRun3 surefire14859194279791928992tmp surefire_122313349068739873924160tmp [ERROR] Error occurred in starting fork, check output in log [ERROR] Process Exit Code: 137 [ERROR] Crashed tests: [ERROR] org.apache.flink.test.checkpointing.EventTimeWindowCheckpointingITCase [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:669) [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.access$600(ForkStarter.java:115) [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter$2.call(ForkStarter.java:444) [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter$2.call(ForkStarter.java:420) [ERROR] at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) [ERROR] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [ERROR] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [ERROR] at java.base/java.lang.Thread.run(Thread.java:834) [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :flink-tests The jvmdump-files look like this: # Created at 2020-10-19T18:14:22.869 java.io.IOException: Stream closed at java.base/java.io.BufferedInputStream.getBufIfOpen(BufferedInputStream.java:176) at java.base/java.io.BufferedInputStream.read1(BufferedInputStream.java:289) at java.base/java.io.BufferedInputStream.read(BufferedInputStream.java:351) at java.base/sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) at java.base/sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) at java.base/sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) at java.base/java.io.InputStreamReader.read(InputStreamReader.java:185) at java.base/java.io.Reader.read(Reader.java:189) at java.base/java.util.Scanner.readInput(Scanner.java:882) at java.base/java.util.Scanner.findWithinHorizon(Scanner.java:1796) at java.base/java.util.Scanner.hasNextLine(Scanner.java:1610) at org.apache.maven.surefire.booter.PpidChecker$ProcessInfoConsumer.execute(PpidChecker.java:354) at org.apache.maven.surefire.booter.PpidChecker.unix(PpidChecker.java:190) at org.apache.maven.surefire.booter.PpidChecker.isProcessAlive(PpidChecker.java:123) at org.apache.maven.surefire.booter.ForkedBooter$2.run(ForkedBooter.java:214) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) # Created at 2020-10-19T18:14:22.870 System.exit() or native command error interrupted process checker. java.lang.IllegalStateException: error [STOPPED] to read process 898133 at org.apache.maven.surefire.booter.PpidChecker.checkProcessInfo(PpidChecker.java:145) at org.apache.maven.surefire.booter.PpidChecker.isProcessAlive(PpidChecker.java:124) at org.apache.maven.surefire.booter.ForkedBooter$2.run(ForkedBooter.java:214) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) I found some JIRA tickets with " The forked VM terminated without properly saying goodbye": https://issues.apache.org/jira/browse/FLINK-18375 https://issues.apache.org/jira/browse/FLINK-2466 I don't see how these could explain the issue I'm witnessing.... I wonder if the issue is related to the VM running "too hot". 'top' shows very high load averages. The crash can be reproduced. Regards, Juha
