I am integrating Arrow with another C++ library. For this, I wrote an input stream which feeds CSV data into the streaming reader. It fails for very large files with the error messages like - "CSV parser got out of sync with chunker".
I have tried various things like - * Look at the stream to see if the data is being fed properly. It is. * Added a call back to future to ensure that I close streams etc. only after the StreamingReader is done. * Check and ensure csv options are ok. * Read the docs and understand as much as possible. Debugged through the arrow code as well. However the error still remains. I would like to get some ideas on anything to look for in debug. Please suggest. Thanks for your help, HK
