[
https://issues.apache.org/jira/browse/BEAM-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17017519#comment-17017519
]
Aaron Dixon edited comment on BEAM-8388 at 1/16/20 9:51 PM:
------------------------------------------------------------
Just to add more context/help here. The exception I see after upgrading from
Beam 2.16->2.17 is this (running in Dataflow):
{code:java}
<span">java.lang.NoClassDefFoundError:
org/apache/avro/data/TimeConversions$TimestampConversion</span"> #
at org.apache.beam.sdk.coders.AvroCoder.<init> (AvroCoder.java:269) at
org.apache.beam.sdk.coders.AvroCoder.of (AvroCoder.java:121) at
org.apache.beam.sdk.io.kafka.KafkaUnboundedSource.getCheckpointMarkCoder
(KafkaUnboundedSource.java:131) at
org.apache.beam.runners.dataflow.worker.WorkerCustomSources$UnboundedReader.iterator
(WorkerCustomSources.java:419) at
org.apache.beam.runners.dataflow.worker.util.common.worker.ReadOperation.runReadLoop
(ReadOperation.java:178) at
org.apache.beam.runners.dataflow.worker.util.common.worker.ReadOperation.start
(ReadOperation.java:159) at
org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute
(MapTaskExecutor.java:77) at
org.apache.beam.runners.dataflow.worker.StreamingDataflowWorker.process
(StreamingDataflowWorker.java:1320) at
org.apache.beam.runners.dataflow.worker.StreamingDataflowWorker.access$1000
(StreamingDataflowWorker.java:151) at
org.apache.beam.runners.dataflow.worker.StreamingDataflowWorker$6.run
(StreamingDataflowWorker.java:1053) at
java.util.concurrent.ThreadPoolExecutor.runWorker
(ThreadPoolExecutor.java:1142) at
java.util.concurrent.ThreadPoolExecutor$Worker.run
(ThreadPoolExecutor.java:617) at java.lang.Thread.run (Thread.java:748)
Caused by: <span">java.lang.ClassNotFoundException:
org.apache.avro.data.TimeConversions$TimestampConversion</span"> # at
java.net.URLClassLoader.findClass (URLClassLoader.java:381) at
java.lang.ClassLoader.loadClass (ClassLoader.java:424) at
sun.misc.Launcher$AppClassLoader.loadClass (Launcher.java:335) at
java.lang.ClassLoader.loadClass (ClassLoader.java:357) {code}
was (Author: atdixon):
Just to add more context/help here. The exception I see after upgrading from
Beam 2.16->2.17 is this (running in Dataflow):
{code:java}
<span">java.lang.NoClassDefFoundError:
org/apache/avro/data/TimeConversions$TimestampConversion</span"> #
at org.apache.beam.sdk.coders.AvroCoder.<init> (AvroCoder.java:269) at
org.apache.beam.sdk.coders.AvroCoder.of (AvroCoder.java:121) at
org.apache.beam.sdk.io.kafka.KafkaUnboundedSource.getCheckpointMarkCoder
(KafkaUnboundedSource.java:131) at
org.apache.beam.runners.dataflow.worker.WorkerCustomSources$UnboundedReader.iterator
(WorkerCustomSources.java:419) at
org.apache.beam.runners.dataflow.worker.util.common.worker.ReadOperation.runReadLoop
(ReadOperation.java:178) at
org.apache.beam.runners.dataflow.worker.util.common.worker.ReadOperation.start
(ReadOperation.java:159) at
org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute
(MapTaskExecutor.java:77) at
org.apache.beam.runners.dataflow.worker.StreamingDataflowWorker.process
(StreamingDataflowWorker.java:1320) at
org.apache.beam.runners.dataflow.worker.StreamingDataflowWorker.access$1000
(StreamingDataflowWorker.java:151) at
org.apache.beam.runners.dataflow.worker.StreamingDataflowWorker$6.run
(StreamingDataflowWorker.java:1053) at
java.util.concurrent.ThreadPoolExecutor.runWorker
(ThreadPoolExecutor.java:1142) at
java.util.concurrent.ThreadPoolExecutor$Worker.run
(ThreadPoolExecutor.java:617) at java.lang.Thread.run (Thread.java:748)
Caused by: <span">java.lang.ClassNotFoundException:
org.apache.avro.data.TimeConversions$TimestampConversion</span"> # at
java.net.URLClassLoader.findClass (URLClassLoader.java:381) at
java.lang.ClassLoader.loadClass (ClassLoader.java:424) at
sun.misc.Launcher$AppClassLoader.loadClass (Launcher.java:335) at
java.lang.ClassLoader.loadClass (ClassLoader.java:357) {code}
#
##
## ```
> Update Avro to 1.9.1 from 1.8.2
> -------------------------------
>
> Key: BEAM-8388
> URL: https://issues.apache.org/jira/browse/BEAM-8388
> Project: Beam
> Issue Type: Improvement
> Components: io-java-avro
> Reporter: Jordanna Chord
> Assignee: Jordanna Chord
> Priority: Major
> Original Estimate: 24h
> Time Spent: 3h 20m
> Remaining Estimate: 20h 40m
>
> Update build dependency to 1.9.1
--
This message was sent by Atlassian Jira
(v8.3.4#803005)