Re: Help needed to locate the csv parser (for Spark bug reporting/fixing)

2022-02-10 Thread Marnix van den Broek
one case the parser is asked to read all fields, in the other, to skip one. > The pushdown helps efficiency but something is going wrong. > > On Thu, Feb 10, 2022 at 10:34 AM Marnix van den Broek < > marnix.van.den.br...@bundlesandbatches.io> wrote: > >> hi all, >> >

Help needed to locate the csv parser (for Spark bug reporting/fixing)

2022-02-10 Thread Marnix van den Broek
hi all, Yesterday I filed a CSV parsing bug [1] for Spark, that leads to data incorrectness when data contains sequences similar to the one in the report. I wanted to take a look at the parsing logic to see if I could spot the error to update the issue with more information and to possibly contri