Hey, One reason could be that a resource-intensive test was killed by oom killer. You can inspect /var/log/kern.log for the related messages in your VM.
Regards, Roman On Mon, Oct 19, 2020 at 5:57 PM Juha Mynttinen <juha.myntti...@gmail.com> wrote: > > Hey, > > I'm trying to build Flink and failing. I'm running Ubuntu 20.04.1 in > a virtual machine on Windows 10. I'm using OpenJDK 11.0.8. I'm on the > master branch, commit 9eae578ae592254d54bc51c679644e8e84c65152. > > The command I'm using: > > apache-maven-3.2.5/bin/mvn clean verify > > The output: > > [INFO] Flink : Tests ...................................... FAILURE [14:38 > min] > [INFO] Flink : Streaming Scala ............................ SKIPPED > [INFO] Flink : Connectors : HCatalog ...................... SKIPPED > [INFO] Flink : Connectors : Base .......................... SKIPPED > [INFO] Flink : Connectors : Files ......................... SKIPPED > [INFO] Flink : Table : .................................... SKIPPED > [INFO] Flink : Table : Common ............................. SKIPPED > [INFO] Flink : Table : API Java ........................... SKIPPED > [INFO] Flink : Table : API Java bridge .................... SKIPPED > [INFO] Flink : Table : API Scala .......................... SKIPPED > [INFO] Flink : Table : API Scala bridge ................... SKIPPED > [INFO] Flink : Table : SQL Parser ......................... SKIPPED > [INFO] Flink : Libraries : ................................ SKIPPED > [INFO] Flink : Libraries : CEP ............................ SKIPPED > [INFO] Flink : Table : Planner ............................ SKIPPED > [INFO] Flink : Table : SQL Parser Hive .................... SKIPPED > [INFO] Flink : Table : Runtime Blink ...................... SKIPPED > [INFO] Flink : Table : Planner Blink ...................... SKIPPED > [INFO] Flink : Metrics : JMX .............................. SKIPPED > [INFO] Flink : Formats : .................................. SKIPPED > [INFO] Flink : Formats : Json ............................. SKIPPED > [INFO] Flink : Connectors : Kafka base .................... SKIPPED > [INFO] Flink : Connectors : Elasticsearch base ............ SKIPPED > [INFO] Flink : Connectors : Elasticsearch 5 ............... SKIPPED > [INFO] Flink : Connectors : Elasticsearch 6 ............... SKIPPED > [INFO] Flink : Connectors : Elasticsearch 7 ............... SKIPPED > [INFO] Flink : Connectors : HBase base .................... SKIPPED > [INFO] Flink : Connectors : HBase 1.4 ..................... SKIPPED > [INFO] Flink : Connectors : HBase 2.2 ..................... SKIPPED > [INFO] Flink : Formats : Hadoop bulk ...................... SKIPPED > [INFO] Flink : Formats : Orc .............................. SKIPPED > [INFO] Flink : Formats : Orc nohive ....................... SKIPPED > [INFO] Flink : Formats : Avro ............................. SKIPPED > [INFO] Flink : Formats : Parquet .......................... SKIPPED > [INFO] Flink : Formats : Csv .............................. SKIPPED > [INFO] Flink : Connectors : Hive .......................... SKIPPED > [INFO] Flink : Connectors : JDBC .......................... SKIPPED > [INFO] Flink : Connectors : RabbitMQ ...................... SKIPPED > [INFO] Flink : Connectors : Twitter ....................... SKIPPED > [INFO] Flink : Connectors : Nifi .......................... SKIPPED > [INFO] Flink : Connectors : Cassandra ..................... SKIPPED > [INFO] Flink : Connectors : Filesystem .................... SKIPPED > [INFO] Flink : Connectors : Kafka ......................... SKIPPED > [INFO] Flink : Connectors : Google PubSub ................. SKIPPED > [INFO] Flink : Connectors : Kinesis ....................... SKIPPED > [INFO] Flink : Connectors : SQL : Elasticsearch 6 ......... SKIPPED > [INFO] Flink : Connectors : SQL : Elasticsearch 7 ......... SKIPPED > [INFO] Flink : Connectors : SQL : HBase 1.4 ............... SKIPPED > [INFO] Flink : Connectors : SQL : HBase 2.2 ............... SKIPPED > [INFO] Flink : Connectors : SQL : Hive 1.2.2 .............. SKIPPED > [INFO] Flink : Connectors : SQL : Hive 2.2.0 .............. SKIPPED > [INFO] Flink : Connectors : SQL : Hive 2.3.6 .............. SKIPPED > [INFO] Flink : Connectors : SQL : Hive 3.1.2 .............. SKIPPED > [INFO] Flink : Connectors : SQL : Kafka ................... SKIPPED > [INFO] Flink : Formats : Avro confluent registry .......... SKIPPED > [INFO] Flink : Formats : Sequence file .................... SKIPPED > [INFO] Flink : Formats : Compress ......................... SKIPPED > [INFO] Flink : Formats : SQL Orc .......................... SKIPPED > [INFO] Flink : Formats : SQL Parquet ...................... SKIPPED > [INFO] Flink : Formats : SQL Avro ......................... SKIPPED > [INFO] Flink : Examples : Streaming ....................... SKIPPED > [INFO] Flink : Examples : Table ........................... SKIPPED > [INFO] Flink : Examples : Build Helper : .................. SKIPPED > [INFO] Flink : Examples : Build Helper : Streaming Twitter SKIPPED > [INFO] Flink : Examples : Build Helper : Streaming State machine SKIPPED > [INFO] Flink : Examples : Build Helper : Streaming Google PubSub SKIPPED > [INFO] Flink : Container .................................. SKIPPED > [INFO] Flink : Queryable state : Runtime .................. SKIPPED > [INFO] Flink : Mesos ...................................... SKIPPED > [INFO] Flink : Kubernetes ................................. SKIPPED > [INFO] Flink : Yarn ....................................... SKIPPED > [INFO] Flink : Libraries : Gelly .......................... SKIPPED > [INFO] Flink : Libraries : Gelly scala .................... SKIPPED > [INFO] Flink : Libraries : Gelly Examples ................. SKIPPED > [INFO] Flink : External resources : ....................... SKIPPED > [INFO] Flink : External resources : GPU ................... SKIPPED > [INFO] Flink : Metrics : Dropwizard ....................... SKIPPED > [INFO] Flink : Metrics : Graphite ......................... SKIPPED > [INFO] Flink : Metrics : InfluxDB ......................... SKIPPED > [INFO] Flink : Metrics : Prometheus ....................... SKIPPED > [INFO] Flink : Metrics : StatsD ........................... SKIPPED > [INFO] Flink : Metrics : Datadog .......................... SKIPPED > [INFO] Flink : Metrics : Slf4j ............................ SKIPPED > [INFO] Flink : Libraries : CEP Scala ...................... SKIPPED > [INFO] Flink : Table : Uber ............................... SKIPPED > [INFO] Flink : Table : Uber Blink ......................... SKIPPED > [INFO] Flink : Python ..................................... SKIPPED > [INFO] Flink : Table : SQL Client ......................... SKIPPED > [INFO] Flink : Libraries : State processor API ............ SKIPPED > [INFO] Flink : ML : ....................................... SKIPPED > [INFO] Flink : ML : API ................................... SKIPPED > [INFO] Flink : ML : Lib ................................... SKIPPED > [INFO] Flink : ML : Uber .................................. SKIPPED > [INFO] Flink : Scala shell ................................ SKIPPED > [INFO] Flink : Dist ....................................... SKIPPED > [INFO] Flink : Yarn Tests ................................. SKIPPED > [INFO] Flink : E2E Tests : ................................ SKIPPED > [INFO] Flink : E2E Tests : CLI ............................ SKIPPED > [INFO] Flink : E2E Tests : Parent Child classloading program SKIPPED > [INFO] Flink : E2E Tests : Parent Child classloading lib-package SKIPPED > [INFO] Flink : E2E Tests : Dataset allround ............... SKIPPED > [INFO] Flink : E2E Tests : Dataset Fine-grained recovery .. SKIPPED > [INFO] Flink : E2E Tests : Datastream allround ............ SKIPPED > [INFO] Flink : E2E Tests : Batch SQL ...................... SKIPPED > [INFO] Flink : E2E Tests : Stream SQL ..................... SKIPPED > [INFO] Flink : E2E Tests : Bucketing sink ................. SKIPPED > [INFO] Flink : E2E Tests : Distributed cache via blob ..... SKIPPED > [INFO] Flink : E2E Tests : High parallelism iterations .... SKIPPED > [INFO] Flink : E2E Tests : Stream stateful job upgrade .... SKIPPED > [INFO] Flink : E2E Tests : Queryable state ................ SKIPPED > [INFO] Flink : E2E Tests : Local recovery and allocation .. SKIPPED > [INFO] Flink : E2E Tests : Elasticsearch 5 ................ SKIPPED > [INFO] Flink : E2E Tests : Elasticsearch 6 ................ SKIPPED > [INFO] Flink : Quickstart : ............................... SKIPPED > [INFO] Flink : Quickstart : Java .......................... SKIPPED > [INFO] Flink : Quickstart : Scala ......................... SKIPPED > [INFO] Flink : E2E Tests : Quickstart ..................... SKIPPED > [INFO] Flink : E2E Tests : Confluent schema registry ...... SKIPPED > [INFO] Flink : E2E Tests : Stream state TTL ............... SKIPPED > [INFO] Flink : E2E Tests : SQL client ..................... SKIPPED > [INFO] Flink : E2E Tests : Streaming file sink ............ SKIPPED > [INFO] Flink : E2E Tests : State evolution ................ SKIPPED > [INFO] Flink : E2E Tests : RocksDB state memory control ... SKIPPED > [INFO] Flink : E2E Tests : Common ......................... SKIPPED > [INFO] Flink : E2E Tests : Metrics availability ........... SKIPPED > [INFO] Flink : E2E Tests : Metrics reporter prometheus .... SKIPPED > [INFO] Flink : E2E Tests : Heavy deployment ............... SKIPPED > [INFO] Flink : E2E Tests : Connectors : Google PubSub ..... SKIPPED > [INFO] Flink : E2E Tests : Streaming Kafka base ........... SKIPPED > [INFO] Flink : E2E Tests : Streaming Kafka ................ SKIPPED > [INFO] Flink : E2E Tests : Plugins : ...................... SKIPPED > [INFO] Flink : E2E Tests : Plugins : Dummy fs ............. SKIPPED > [INFO] Flink : E2E Tests : Plugins : Another dummy fs ..... SKIPPED > [INFO] Flink : E2E Tests : TPCH ........................... SKIPPED > [INFO] Flink : E2E Tests : Streaming Kinesis .............. SKIPPED > [INFO] Flink : E2E Tests : Elasticsearch 7 ................ SKIPPED > [INFO] Flink : E2E Tests : Common Kafka ................... SKIPPED > [INFO] Flink : E2E Tests : TPCDS .......................... SKIPPED > [INFO] Flink : E2E Tests : Netty shuffle memory control ... SKIPPED > [INFO] Flink : E2E Tests : Python ......................... SKIPPED > [INFO] Flink : E2E Tests : HBase .......................... SKIPPED > [INFO] Flink : State backends : Heap spillable ............ SKIPPED > [INFO] Flink : Contrib : .................................. SKIPPED > [INFO] Flink : Contrib : Connectors : Wikiedits ........... SKIPPED > [INFO] Flink : FileSystems : Tests ........................ SKIPPED > [INFO] Flink : Docs ....................................... SKIPPED > [INFO] Flink : Walkthrough : .............................. SKIPPED > [INFO] Flink : Walkthrough : Common ....................... SKIPPED > [INFO] Flink : Walkthrough : Datastream Java .............. SKIPPED > [INFO] Flink : Walkthrough : Datastream Scala ............. SKIPPED > [INFO] > ------------------------------------------------------------------------ > [INFO] BUILD FAILURE > [INFO] > ------------------------------------------------------------------------ > [INFO] Total time: 36:49 min > [INFO] Finished at: 2020-10-19T18:24:46+03:00 > [INFO] Final Memory: 179M/614M > [INFO] > ------------------------------------------------------------------------ > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-surefire-plugin:2.22.1:test > (integration-tests) on project flink-tests: There are test failures. > [ERROR] > [ERROR] Please refer to > /home/juha/git/apache-flink/flink-tests/target/surefire-reports for the > individual test results. > [ERROR] Please refer to dump files (if any exist) [date].dump, > [date]-jvmRun[N].dump and [date].dumpstream. > [ERROR] ExecutionException The forked VM terminated without properly > saying goodbye. VM crash or System.exit called? > [ERROR] Command was /bin/sh -c cd > /home/juha/git/apache-flink/flink-tests/target && > /usr/lib/jvm/java-11-openjdk-amd64/bin/java -Xms256m -Xmx2048m > -Dmvn.forkNumber=3 -XX:+UseG1GC -jar > /home/juha/git/apache-flink/flink-tests/target/surefire/surefirebooter11703198505285401478.jar > /home/juha/git/apache-flink/flink-tests/target/surefire > 2020-10-19T17-48-02_394-jvmRun3 surefire14859194279791928992tmp > surefire_122313349068739873924160tmp > [ERROR] Error occurred in starting fork, check output in log > [ERROR] Process Exit Code: 137 > [ERROR] Crashed tests: > [ERROR] > org.apache.flink.test.checkpointing.EventTimeWindowCheckpointingITCase > [ERROR] org.apache.maven.surefire.booter.SurefireBooterForkException: > ExecutionException The forked VM terminated without properly saying > goodbye. VM crash or System.exit called? > [ERROR] Command was /bin/sh -c cd > /home/juha/git/apache-flink/flink-tests/target && > /usr/lib/jvm/java-11-openjdk-amd64/bin/java -Xms256m -Xmx2048m > -Dmvn.forkNumber=3 -XX:+UseG1GC -jar > /home/juha/git/apache-flink/flink-tests/target/surefire/surefirebooter11703198505285401478.jar > /home/juha/git/apache-flink/flink-tests/target/surefire > 2020-10-19T17-48-02_394-jvmRun3 surefire14859194279791928992tmp > surefire_122313349068739873924160tmp > [ERROR] Error occurred in starting fork, check output in log > [ERROR] Process Exit Code: 137 > [ERROR] Crashed tests: > [ERROR] > org.apache.flink.test.checkpointing.EventTimeWindowCheckpointingITCase > [ERROR] at > org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510) > [ERROR] at > org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457) > [ERROR] at > org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298) > [ERROR] at > org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246) > [ERROR] at > org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183) > [ERROR] at > org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011) > [ERROR] at > org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857) > [ERROR] at > org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132) > [ERROR] at > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208) > [ERROR] at > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) > [ERROR] at > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) > [ERROR] at > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116) > [ERROR] at > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80) > [ERROR] at > org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) > [ERROR] at > org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120) > [ERROR] at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:355) > [ERROR] at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155) > [ERROR] at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584) > [ERROR] at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:216) > [ERROR] at org.apache.maven.cli.MavenCli.main(MavenCli.java:160) > [ERROR] at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native > Method) > [ERROR] at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > [ERROR] at > java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > [ERROR] at java.base/java.lang.reflect.Method.invoke(Method.java:566) > [ERROR] at > org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) > [ERROR] at > org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) > [ERROR] at > org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) > [ERROR] at > org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) > [ERROR] Caused by: > org.apache.maven.surefire.booter.SurefireBooterForkException: The forked VM > terminated without properly saying goodbye. VM crash or System.exit called? > [ERROR] Command was /bin/sh -c cd > /home/juha/git/apache-flink/flink-tests/target && > /usr/lib/jvm/java-11-openjdk-amd64/bin/java -Xms256m -Xmx2048m > -Dmvn.forkNumber=3 -XX:+UseG1GC -jar > /home/juha/git/apache-flink/flink-tests/target/surefire/surefirebooter11703198505285401478.jar > /home/juha/git/apache-flink/flink-tests/target/surefire > 2020-10-19T17-48-02_394-jvmRun3 surefire14859194279791928992tmp > surefire_122313349068739873924160tmp > [ERROR] Error occurred in starting fork, check output in log > [ERROR] Process Exit Code: 137 > [ERROR] Crashed tests: > [ERROR] > org.apache.flink.test.checkpointing.EventTimeWindowCheckpointingITCase > [ERROR] at > org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:669) > [ERROR] at > org.apache.maven.plugin.surefire.booterclient.ForkStarter.access$600(ForkStarter.java:115) > [ERROR] at > org.apache.maven.plugin.surefire.booterclient.ForkStarter$2.call(ForkStarter.java:444) > [ERROR] at > org.apache.maven.plugin.surefire.booterclient.ForkStarter$2.call(ForkStarter.java:420) > [ERROR] at > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) > [ERROR] at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > [ERROR] at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > [ERROR] at java.base/java.lang.Thread.run(Thread.java:834) > [ERROR] -> [Help 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the > -e switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, > please read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException > [ERROR] > [ERROR] After correcting the problems, you can resume the build with the > command > [ERROR] mvn <goals> -rf :flink-tests > > The jvmdump-files look like this: > > # Created at 2020-10-19T18:14:22.869 > java.io.IOException: Stream closed > at > java.base/java.io.BufferedInputStream.getBufIfOpen(BufferedInputStream.java:176) > at > java.base/java.io.BufferedInputStream.read1(BufferedInputStream.java:289) > at > java.base/java.io.BufferedInputStream.read(BufferedInputStream.java:351) > at > java.base/sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) > at > java.base/sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) > at java.base/sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) > at > java.base/java.io.InputStreamReader.read(InputStreamReader.java:185) > at java.base/java.io.Reader.read(Reader.java:189) > at java.base/java.util.Scanner.readInput(Scanner.java:882) > at java.base/java.util.Scanner.findWithinHorizon(Scanner.java:1796) > at java.base/java.util.Scanner.hasNextLine(Scanner.java:1610) > at > org.apache.maven.surefire.booter.PpidChecker$ProcessInfoConsumer.execute(PpidChecker.java:354) > at > org.apache.maven.surefire.booter.PpidChecker.unix(PpidChecker.java:190) > at > org.apache.maven.surefire.booter.PpidChecker.isProcessAlive(PpidChecker.java:123) > at > org.apache.maven.surefire.booter.ForkedBooter$2.run(ForkedBooter.java:214) > at > java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) > at > java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) > at > java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) > at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > at java.base/java.lang.Thread.run(Thread.java:834) > > > # Created at 2020-10-19T18:14:22.870 > System.exit() or native command error interrupted process checker. > java.lang.IllegalStateException: error [STOPPED] to read process 898133 > at > org.apache.maven.surefire.booter.PpidChecker.checkProcessInfo(PpidChecker.java:145) > at > org.apache.maven.surefire.booter.PpidChecker.isProcessAlive(PpidChecker.java:124) > at > org.apache.maven.surefire.booter.ForkedBooter$2.run(ForkedBooter.java:214) > at > java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) > at > java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) > at > java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) > at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > at java.base/java.lang.Thread.run(Thread.java:834) > > > I found some JIRA tickets with " The forked VM terminated without properly > saying goodbye": > > https://issues.apache.org/jira/browse/FLINK-18375 > https://issues.apache.org/jira/browse/FLINK-2466 > > I don't see how these could explain the issue I'm witnessing.... > > I wonder if the issue is related to the VM running "too hot". 'top' shows > very high load averages. > > The crash can be reproduced. > > Regards, > Juha > >
