Hi Fabian, I have created the issue, https://issues.apache.org/jira/browse/FLINK-10525
Thx ! > On 10 Oct 2018, at 16:47, Fabian Hueske <fhue...@gmail.com> wrote: > > Hi Rinat, > > Thanks for discussing this idea. Yes, I think this would be a good feature. > Can you open a Jira issue and describe the feature? > > Thanks, Fabian > > Am Do., 4. Okt. 2018 um 19:28 Uhr schrieb Rinat <r.shari...@cleverdata.ru > <mailto:r.shari...@cleverdata.ru>>: > Hi mates, in accordance with the contract of > org.apache.flink.formats.avro.DeserializationSchema, it should return null > value, when content couldn’t be deserialized. > But in most cases (for example > org.apache.flink.formats.avro.AvroDeserializationSchema) method fails if data > is corrupted. > > We’ve implemented our own SerDe class, that returns null, if data doesn’t > satisfy avro schema, but it’s rather hard to maintain this functionality > during migration to the latest Flink version. > What do you think, maybe it’ll be useful if we will support optional skip of > failed records in avro and other Deserializers in the source code ? > > Sincerely yours, > Rinat Sharipov > Software Engineer at 1DMP CORE Team > > email: r.shari...@cleverdata.ru <mailto:a.totma...@cleverdata.ru> > mobile: +7 (925) 416-37-26 > > CleverDATA > make your data clever > Sincerely yours, Rinat Sharipov Software Engineer at 1DMP CORE Team email: r.shari...@cleverdata.ru <mailto:a.totma...@cleverdata.ru> mobile: +7 (925) 416-37-26 CleverDATA make your data clever
