Hi Elisa,
One option is to preprocess the file and add the missing columns.
You can do this using two passes (reading once to determine the number of
columns
and once writing out the lines filled out to the right number of columns)
This does not need to take a lot of memory as you can read line
No, there is no way to load CSV files with irregular dimensions, and we
don't have any plans currently to support them. Sorry :-(
Regards
Antoine.
Le 19/11/2019 à 05:54, Micah Kornfield a écrit :
> +dev@arrow to see if there is a more definitive answer, but I don't believe
> this type of fun
+dev@arrow to see if there is a more definitive answer, but I don't believe
this type of functionality is supported currently.
On Fri, Nov 15, 2019 at 1:42 AM Elisa Scandellari <
elisa.scandell...@gmail.com> wrote:
> Hi,
> I'm trying to improve the performance of my program that loads csv data