[
https://issues.apache.org/jira/browse/BEAM-9793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kyle Weaver updated BEAM-9793:
------------------------------
Comment: was deleted
(was: I'm not sure if ...ReverseArtifactRetrievalService is the root cause.
There is also the following error in the Docker logs:
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/usr/local/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/data_plane.py",
line 545, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/data_plane.py",
line 528, in _read_inputs
for elements in elements_iterator:
File "/usr/local/lib/python3.7/site-packages/grpc/_channel.py", line 388, in
__next__
return self._next()
File "/usr/local/lib/python3.7/site-packages/grpc/_channel.py", line 365, in
_next
raise self
grpc._channel._Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "DNS resolution failed"
debug_error_string =
"{"created":"@1587426512.443144965","description":"Failed to pick
subchannel","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":3876,"referenced_errors":[{"created":"@1587426512.443142363","description":"Resolver
transient
failure","file":"src/core/ext/filters/client_channel/resolving_lb_policy.cc","file_line":263,"referenced_errors":[{"created":"@1587426512.443141313","description":"DNS
resolution
failed","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/dns_resolver_ares.cc","file_line":357,"grpc_status":14,"referenced_errors":[{"created":"@1587426512.443136986","description":"C-ares
status is not ARES_SUCCESS: Misformatted domain
name","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":244,"referenced_errors":[{"created":"@1587426512.443126564","description":"C-ares
status is not ARES_SUCCESS: Misformatted domain
name","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":244}]}]}]}]}"
>
)
> Method not found:
> org.apache.beam.model.job_management.v1.ArtifactStagingService/ReverseArtifactRetrievalService
> ----------------------------------------------------------------------------------------------------------------
>
> Key: BEAM-9793
> URL: https://issues.apache.org/jira/browse/BEAM-9793
> Project: Beam
> Issue Type: Bug
> Components: runner-spark
> Reporter: Kyle Weaver
> Priority: Major
> Labels: portability-spark
>
> This affects both the Flink and Spark portable runners. It does not appear to
> cause pipelines to fail.
> 13:24:17 ERROR:grpc._channel:Exception iterating requests!
> 13:24:17 Traceback (most recent call last):
> 13:24:17 File
> "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python2_PVR_Flink_Commit/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py",
> line 195, in consume_request_iterator
> 13:24:17 request = next(request_iterator)
> 13:24:17 File "apache_beam/runners/portability/artifact_service.py", line
> 316, in __next__
> 13:24:17 raise self._queue.get()
> 13:24:17 _MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
> terminated with:
> 13:24:17 status = StatusCode.UNIMPLEMENTED
> 13:24:17 details = "Method not found:
> org.apache.beam.model.job_management.v1.ArtifactStagingService/ReverseArtifactRetrievalService"
> 13:24:17 debug_error_string =
> "{"created":"@1588008257.670646906","description":"Error received from peer
> ipv4:127.0.0.1:37747","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Method
> not found:
> org.apache.beam.model.job_management.v1.ArtifactStagingService/ReverseArtifactRetrievalService","grpc_status":12}"
> 13:24:17 >
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
