[ https://issues.apache.org/jira/browse/FLINK-24137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dian Fu updated FLINK-24137: ---------------------------- Description: https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23443&view=logs&j=9cada3cb-c1d3-5621-16da-0f718fb86602&t=c67e71ed-6451-5d26-8920-5a8cf9651901&l=24681 {code} Sep 01 02:26:21 E Caused by: java.lang.RuntimeException: Failed to create stage bundle factory! INFO:root:Initializing python harness: /__w/1/s/flink-python/pyflink/fn_execution/beam/beam_boot.py --id=1-1 --provision_endpoint=localhost:44544 Sep 01 02:26:21 E Sep 01 02:26:21 E at org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.createStageBundleFactory(BeamPythonFunctionRunner.java:566) Sep 01 02:26:21 E at org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.open(BeamPythonFunctionRunner.java:255) Sep 01 02:26:21 E at org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator.open(AbstractPythonFunctionOperator.java:131) Sep 01 02:26:21 E at org.apache.flink.streaming.api.operators.python.AbstractOneInputPythonFunctionOperator.open(AbstractOneInputPythonFunctionOperator.java:116) Sep 01 02:26:21 E at org.apache.flink.streaming.api.operators.python.PythonProcessOperator.open(PythonProcessOperator.java:59) Sep 01 02:26:21 E at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:110) Sep 01 02:26:21 E at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreGates(StreamTask.java:691) Sep 01 02:26:21 E at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55) Sep 01 02:26:21 E at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:667) Sep 01 02:26:21 E at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:639) Sep 01 02:26:21 E at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958) Sep 01 02:26:21 E at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927) Sep 01 02:26:21 E at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:766) Sep 01 02:26:21 E at org.apache.flink.runtime.taskmanager.Task.run(Task.java:575) Sep 01 02:26:21 E at java.lang.Thread.run(Thread.java:748) Sep 01 02:26:21 E Caused by: org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.UncheckedExecutionException: java.lang.IllegalStateException: Process died with exit code 0 Sep 01 02:26:21 E at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2050) Sep 01 02:26:21 E at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.get(LocalCache.java:3952) Sep 01 02:26:21 E at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3974) Sep 01 02:26:21 E at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4958) Sep 01 02:26:21 E at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4964) Sep 01 02:26:21 E at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.<init>(DefaultJobBundleFactory.java:451) Sep 01 02:26:21 E at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.<init>(DefaultJobBundleFactory.java:436) Sep 01 02:26:21 E at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:303) Sep 01 02:26:21 E at org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.createStageBundleFactory(BeamPythonFunctionRunner.java:564) Sep 01 02:26:21 E ... 14 more Sep 01 02:26:21 E Caused by: java.lang.IllegalStateException: Process died with exit code 0 Sep 01 02:26:21 E at org.apache.beam.runners.fnexecution.environment.ProcessManager$RunningProcess.isAliveOrThrow(ProcessManager.java:75) Sep 01 02:26:21 E at org.apache.beam.runners.fnexecution.environment.ProcessEnvironmentFactory.createEnvironment(ProcessEnvironmentFactory.java:112) Sep 01 02:26:21 E at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:252) Sep 01 02:26:21 E at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:231) Sep 01 02:26:21 E at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3528) Sep 01 02:26:21 E at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2277) Sep 01 02:26:21 E at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2154) Sep 01 02:26:21 E at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2044) {code} was: https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23443&view=logs&j=9cada3cb-c1d3-5621-16da-0f718fb86602&t=c67e71ed-6451-5d26-8920-5a8cf9651901&l=24681 {code} Sep 03 02:40:11 pyflink/table/tests/test_udtf.py::PyFlinkStreamUserDefinedFunctionTests::test_execute_from_json_plan Sep 03 02:40:11 /__w/2/s/flink-python/.tox/py38-cython/lib/python3.8/site-packages/_pytest/threadexception.py:75: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs Sep 03 02:40:11 Sep 03 02:40:11 Traceback (most recent call last): Sep 03 02:40:11 File "/__w/2/s/flink-python/dev/.conda/envs/3.8/lib/python3.8/threading.py", line 932, in _bootstrap_inner Sep 03 02:40:11 self.run() Sep 03 02:40:11 File "/__w/2/s/flink-python/dev/.conda/envs/3.8/lib/python3.8/threading.py", line 870, in run Sep 03 02:40:11 self._target(*self._args, **self._kwargs) Sep 03 02:40:11 File "/__w/2/s/flink-python/.tox/py38-cython/lib/python3.8/site-packages/apache_beam/runners/worker/data_plane.py", line 598, in <lambda> Sep 03 02:40:11 target=lambda: self._read_inputs(elements_iterator), Sep 03 02:40:11 File "/__w/2/s/flink-python/.tox/py38-cython/lib/python3.8/site-packages/apache_beam/runners/worker/data_plane.py", line 581, in _read_inputs Sep 03 02:40:11 for elements in elements_iterator: Sep 03 02:40:11 File "/__w/2/s/flink-python/.tox/py38-cython/lib/python3.8/site-packages/grpc/_channel.py", line 426, in __next__ Sep 03 02:40:11 return self._next() Sep 03 02:40:11 File "/__w/2/s/flink-python/.tox/py38-cython/lib/python3.8/site-packages/grpc/_channel.py", line 826, in _next Sep 03 02:40:11 raise self Sep 03 02:40:11 grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with: Sep 03 02:40:11 status = StatusCode.CANCELLED Sep 03 02:40:11 details = "Multiplexer hanging up" Sep 03 02:40:11 debug_error_string = "{"created":"@1630636798.176694842","description":"Error received from peer ipv4:127.0.0.1:37661","file":"src/core/lib/surface/call.cc","file_line":1070,"grpc_message":"Multiplexer hanging up","grpc_status":1}" Sep 03 02:40:11 > {code} > Python tests fail with "Exception in thread read_grpc_client_inputs" > -------------------------------------------------------------------- > > Key: FLINK-24137 > URL: https://issues.apache.org/jira/browse/FLINK-24137 > Project: Flink > Issue Type: Bug > Components: API / Python > Affects Versions: 1.14.0 > Reporter: Dawid Wysakowicz > Priority: Blocker > Labels: test-stability > Fix For: 1.14.0 > > > https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23443&view=logs&j=9cada3cb-c1d3-5621-16da-0f718fb86602&t=c67e71ed-6451-5d26-8920-5a8cf9651901&l=24681 > {code} > Sep 01 02:26:21 E Caused by: java.lang.RuntimeException: > Failed to create stage bundle factory! INFO:root:Initializing python harness: > /__w/1/s/flink-python/pyflink/fn_execution/beam/beam_boot.py --id=1-1 > --provision_endpoint=localhost:44544 > Sep 01 02:26:21 E > Sep 01 02:26:21 E at > org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.createStageBundleFactory(BeamPythonFunctionRunner.java:566) > Sep 01 02:26:21 E at > org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.open(BeamPythonFunctionRunner.java:255) > Sep 01 02:26:21 E at > org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator.open(AbstractPythonFunctionOperator.java:131) > Sep 01 02:26:21 E at > org.apache.flink.streaming.api.operators.python.AbstractOneInputPythonFunctionOperator.open(AbstractOneInputPythonFunctionOperator.java:116) > Sep 01 02:26:21 E at > org.apache.flink.streaming.api.operators.python.PythonProcessOperator.open(PythonProcessOperator.java:59) > Sep 01 02:26:21 E at > org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:110) > Sep 01 02:26:21 E at > org.apache.flink.streaming.runtime.tasks.StreamTask.restoreGates(StreamTask.java:691) > Sep 01 02:26:21 E at > org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55) > Sep 01 02:26:21 E at > org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:667) > Sep 01 02:26:21 E at > org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:639) > Sep 01 02:26:21 E at > org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958) > Sep 01 02:26:21 E at > org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927) > Sep 01 02:26:21 E at > org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:766) > Sep 01 02:26:21 E at > org.apache.flink.runtime.taskmanager.Task.run(Task.java:575) > Sep 01 02:26:21 E at java.lang.Thread.run(Thread.java:748) > Sep 01 02:26:21 E Caused by: > org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.UncheckedExecutionException: > java.lang.IllegalStateException: Process died with exit code 0 > Sep 01 02:26:21 E at > org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2050) > Sep 01 02:26:21 E at > org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.get(LocalCache.java:3952) > Sep 01 02:26:21 E at > org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3974) > Sep 01 02:26:21 E at > org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4958) > Sep 01 02:26:21 E at > org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4964) > Sep 01 02:26:21 E at > org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.<init>(DefaultJobBundleFactory.java:451) > Sep 01 02:26:21 E at > org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.<init>(DefaultJobBundleFactory.java:436) > Sep 01 02:26:21 E at > org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:303) > Sep 01 02:26:21 E at > org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.createStageBundleFactory(BeamPythonFunctionRunner.java:564) > Sep 01 02:26:21 E ... 14 more > Sep 01 02:26:21 E Caused by: > java.lang.IllegalStateException: Process died with exit code 0 > Sep 01 02:26:21 E at > org.apache.beam.runners.fnexecution.environment.ProcessManager$RunningProcess.isAliveOrThrow(ProcessManager.java:75) > Sep 01 02:26:21 E at > org.apache.beam.runners.fnexecution.environment.ProcessEnvironmentFactory.createEnvironment(ProcessEnvironmentFactory.java:112) > Sep 01 02:26:21 E at > org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:252) > Sep 01 02:26:21 E at > org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:231) > Sep 01 02:26:21 E at > org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3528) > Sep 01 02:26:21 E at > org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2277) > Sep 01 02:26:21 E at > org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2154) > Sep 01 02:26:21 E at > org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2044) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)