Re: Reading parquet files in Calc

2022-10-11 Thread Jacek Pliszka
Thank you. Actually the main issue would be the scope. If it would be just minimal reading of full single file parquet files - it should be relatively easy. But the next interesting feature would be out-of-memory reading of large single file parquet files - some kind of filter for rows and colum

Re: Reading parquet files in Calc

2022-10-10 Thread Kohei Yoshida
On 06.10.2022 19:06, Kohei Yoshida wrote: I would have been very happy to take a closer look at the arrow library. But right now I'm trying to finish up all the features that need to go into the next release of orcus, so I won't be able to do that anytime soon unfortunately. I've created a rem

Re: Reading parquet files in Calc

2022-10-07 Thread Kohei Yoshida
Hi Jacek, On 06.10.2022 05:54, Jacek Pliszka wrote: I found an old thread about adding it to Orcus library instead. Is it the best approach? It is an approach. But I wouldn't say it's the best approach. Orcus library has traditionally been geared more toward supporting text-file based fil

Reading parquet files in Calc

2022-10-06 Thread Jacek Pliszka
Hi! Is there any work/idea on reading parquet files in Calc? I found an old thread about adding it to Orcus library instead. Is it the best approach? If Orcus could use arrow library then it should be relatively easy. similar to .csv files. BR J