Hi, I cut a PR that should fix this issue for Avrohugger: https://github.com/apache/flink/pull/9565 <https://github.com/apache/flink/pull/9565>
Would you be able to build this and see if it solves your problem? Best, Aljoscha > On 30. Aug 2019, at 09:02, Debasish Ghosh <ghosh.debas...@gmail.com> wrote: > > From https://stackoverflow.com/a/56104518 > <https://stackoverflow.com/a/56104518> .. > > AFAIK the only solution is to update Flink to use avro's non-reflection-based > constructors in AvroInputFormat > <https://github.com/apache/flink/blob/master/flink-formats/flink-avro/src/main/java/org/apache/flink/formats/avro/AvroInputFormat.java#L116> > (compare > <https://github.com/apache/avro/blob/master/lang/java/avro/src/main/java/org/apache/avro/specific/SpecificDatumReader.java#L37-L46>). > > Would love to know if there has been some plans towards fixing this issue .. > > regards. > > On Thu, Aug 29, 2019 at 8:23 PM Debasish Ghosh <ghosh.debas...@gmail.com > <mailto:ghosh.debas...@gmail.com>> wrote: > Any update on this ? > > regards. > > On Tue, May 14, 2019 at 2:22 PM Tzu-Li (Gordon) Tai <tzuli...@apache.org > <mailto:tzuli...@apache.org>> wrote: > Hi, > > Aljoscha opened a JIRA just recently for this issue: > https://issues.apache.org/jira/browse/FLINK-12501 > <https://issues.apache.org/jira/browse/FLINK-12501>. > > Do you know if this is a regression from previous Flink versions? > I'm asking just to double check, since from my understanding of the issue, > the problem should have already existed before. > > Thanks, > Gordon > > On Sun, May 12, 2019 at 3:53 PM Debasish Ghosh <ghosh.debas...@gmail.com > <mailto:ghosh.debas...@gmail.com>> wrote: > Hello - > > Facing an issue with avro serialization with Scala case classes generated > through avrohugger .. > Scala case classes generated by avrohugger has the avro schema in the > companion object. This is a sample generated class (details elided) .. > > case class Data(var id: Int, var name: String) extends > org.apache.avro.specific.SpecificRecordBase { > def this() = this(0, "") > def get(field$: Int): AnyRef = { > //.. > } > def put(field$: Int, value: Any): Unit = { > //.. > } > def getSchema(): org.apache.avro.Schema = Data.SCHEMA$ > } > object Data { > val SCHEMA$ = new > org.apache.avro.Schema.Parser().parse("{\"type\":\"record\",\"name\":\"Data\",\"namespace\":\"pipelines.flink.avro\",\"fields\":[{\"name\":\"id\",\"type\":\"int\"},{\"name\":\"name\",\"type\":\"string\"}]}") > } > > Flink 1.8 avro serializer fails on this as Avro looks for a SCHEMA$ property > in the class & is unable 2 use Java reflection 2 identify the SCHEMA$ in the > companion object. The exception that I get is the following .. > > java.lang.RuntimeException: Serializing the source elements failed: > avro.shaded.com.google.common.util.concurrent.UncheckedExecutionException: > org.apache.avro.AvroRuntimeException: Not a Specific class: class > pipelines.flink.avro.Data > > Any help or workaround will be appreciated .. > > regards. > > -- > Debasish Ghosh > http://manning.com/ghosh2 <http://manning.com/ghosh2> > http://manning.com/ghosh <http://manning.com/ghosh> > > Twttr: @debasishg > Blog: http://debasishg.blogspot.com <http://debasishg.blogspot.com/> > Code: http://github.com/debasishg <http://github.com/debasishg> > > -- > Debasish Ghosh > http://manning.com/ghosh2 <http://manning.com/ghosh2> > http://manning.com/ghosh <http://manning.com/ghosh> > > Twttr: @debasishg > Blog: http://debasishg.blogspot.com <http://debasishg.blogspot.com/> > Code: http://github.com/debasishg <http://github.com/debasishg> > > -- > Debasish Ghosh > http://manning.com/ghosh2 <http://manning.com/ghosh2> > http://manning.com/ghosh <http://manning.com/ghosh> > > Twttr: @debasishg > Blog: http://debasishg.blogspot.com <http://debasishg.blogspot.com/> > Code: http://github.com/debasishg <http://github.com/debasishg>
