[
https://issues.apache.org/jira/browse/BEAM-9971?focusedWorklogId=437870&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-437870
]
ASF GitHub Bot logged work on BEAM-9971:
----------------------------------------
Author: ASF GitHub Bot
Created on: 27/May/20 15:55
Start Date: 27/May/20 15:55
Worklog Time Spent: 10m
Work Description: ibzib commented on a change in pull request #11784:
URL: https://github.com/apache/beam/pull/11784#discussion_r431252300
##########
File path:
runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/NativeTransforms.java
##########
@@ -46,7 +46,9 @@
* Returns true if an only if the Runner understands this transform and can
handle it directly.
*/
public static boolean isNative(RunnerApi.PTransform pTransform) {
- Iterator<IsNativeTransform> matchers =
ServiceLoader.load(IsNativeTransform.class).iterator();
+ Iterator<IsNativeTransform> matchers =
Review comment:
```suggestion
// TODO(BEAM-10109) Use default (context) classloader.
Iterator<IsNativeTransform> matchers =
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 437870)
Time Spent: 1h 20m (was: 1h 10m)
> beam_PostCommit_Java_PVR_Spark_Batch flakes (no such file)
> ----------------------------------------------------------
>
> Key: BEAM-9971
> URL: https://issues.apache.org/jira/browse/BEAM-9971
> Project: Beam
> Issue Type: Bug
> Components: test-failures
> Reporter: Kyle Weaver
> Assignee: Kyle Weaver
> Priority: P2
> Labels: portability-spark
> Fix For: 2.22.0
>
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> This happens sporadically. One time the issue affected 14 tests; another time
> it affected 112 tests.
> It looks like the ClassLoader is sometimes contaminated with jars from
> /tmp/spark-*, which have already been deleted.
> 20/05/21 13:54:27 ERROR org.apache.beam.runners.jobsubmission.JobInvocation:
> Error during job invocation
> pipelinetest0testidentitytransform-kcweaver-0521205426-f4de06c4_51aced77-c171-4842-be1f-6c79226872e5.
> java.util.ServiceConfigurationError:
> org.apache.beam.runners.core.construction.NativeTransforms$IsNativeTransform:
> Error reading configuration file
> at java.util.ServiceLoader.fail(ServiceLoader.java:232)
> at java.util.ServiceLoader.parse(ServiceLoader.java:309)
> at java.util.ServiceLoader.access$200(ServiceLoader.java:185)
> at
> java.util.ServiceLoader$LazyIterator.hasNextService(ServiceLoader.java:357)
> at java.util.ServiceLoader$LazyIterator.hasNext(ServiceLoader.java:393)
> at java.util.ServiceLoader$1.hasNext(ServiceLoader.java:474)
> at
> org.apache.beam.runners.core.construction.NativeTransforms.isNative(NativeTransforms.java:50)
> at
> org.apache.beam.runners.core.construction.graph.QueryablePipeline.isPrimitiveTransform(QueryablePipeline.java:189)
> at
> org.apache.beam.runners.core.construction.graph.QueryablePipeline.getPrimitiveTransformIds(QueryablePipeline.java:137)
> at
> org.apache.beam.runners.core.construction.graph.QueryablePipeline.forPrimitivesIn(QueryablePipeline.java:90)
> at
> org.apache.beam.runners.core.construction.graph.GreedyPipelineFuser.<init>(GreedyPipelineFuser.java:67)
> at
> org.apache.beam.runners.core.construction.graph.GreedyPipelineFuser.fuse(GreedyPipelineFuser.java:90)
> at
> org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:94)
> at
> org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:83)
> at
> org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
> at
> org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
> at
> org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.io.FileNotFoundException:
> /tmp/spark-5e8a8a9a-22d6-48d5-b398-1a4f5582d954/userFiles-ec74cac1-21b5-4127-b764-540636b733d0/beam-runners-core-construction-java-2.22.0-SNAPSHOT-tests.jar
> (No such file or directory)
> at java.util.zip.ZipFile.open(Native Method)
> at java.util.zip.ZipFile.<init>(ZipFile.java:230)
> at java.util.zip.ZipFile.<init>(ZipFile.java:155)
> at java.util.jar.JarFile.<init>(JarFile.java:167)
> at java.util.jar.JarFile.<init>(JarFile.java:104)
> at sun.net.www.protocol.jar.URLJarFile.<init>(URLJarFile.java:93)
> at sun.net.www.protocol.jar.URLJarFile.getJarFile(URLJarFile.java:69)
> at sun.net.www.protocol.jar.JarFileFactory.get(JarFileFactory.java:84)
> at
> sun.net.www.protocol.jar.JarURLConnection.connect(JarURLConnection.java:122)
> at
> sun.net.www.protocol.jar.JarURLConnection.getInputStream(JarURLConnection.java:152)
> at java.net.URL.openStream(URL.java:1045)
> at java.util.ServiceLoader.parse(ServiceLoader.java:304)
> ... 18 more
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
