Re: Un-ignored Parsing Exceptions in the CsvFormat

2020-10-26 Thread Khachatryan Roman
Hey Austin, I assigned the ticket, that would be great if you could fix it! Regards, Roman On Thu, Oct 22, 2020 at 5:08 PM Austin Cawley-Edwards < austin.caw...@gmail.com> wrote: > Hey Roman, > > Sorry to miss this -- thanks for the confirmation and making the ticket. > I'm happy to propose a

Re: Un-ignored Parsing Exceptions in the CsvFormat

2020-10-22 Thread Austin Cawley-Edwards
Hey Roman, Sorry to miss this -- thanks for the confirmation and making the ticket. I'm happy to propose a fix if someone is able to assign the ticket to me. Best, Austin On Mon, Oct 19, 2020 at 6:56 AM Khachatryan Roman < khachatryan.ro...@gmail.com> wrote: > Hey Austin, > > I think you are ri

Re: Un-ignored Parsing Exceptions in the CsvFormat

2020-10-19 Thread Khachatryan Roman
Hey Austin, I think you are right. The problematic row contains an odd number of delimiters in which case skipFields will return -1, which in turn leads to an exception. I opened a bug ticket https://issues.apache.org/jira/browse/FLINK-19711 to fix it. Regards, Roman On Fri, Oct 16, 2020 at 8:

Un-ignored Parsing Exceptions in the CsvFormat

2020-10-16 Thread Austin Cawley-Edwards
Hey all, I'm ingesting CSV files with Flink 1.10.2 using SQL and the CSV Format[1]. Even with the `ignoreParseErrors()` set, the job fails when it encounters some types of malformed rows. The root cause is indeed a `ParseException`, so I'm wondering if there's anything more I need to do to ignore