Re: [C++][Parquet] Unable to read memory??

2023-11-16 Thread Bryce Mecum
Your code is correct so I think something else is going on. Can you give us more details about your environment, such as how you're getting the Arrow C++ DLLs (nuget, conda, building from source) and how you're compiling your program? On Thu, Nov 16, 2023 at 4:27 AM wrote: > > Hi, > > > > I’m t

Re: [Python/C++] pyarrow.parquet.read_table stopped working in version 12.0.0

2023-11-16 Thread Jacek Pliszka
OK, partially answering myself - pq.ParquetDataset was used and filter expression in the new format does not work here. import pyarrow as pa import pyarrow.parquet as pq import numpy as np t = pa.table({"d": pa.array([1, 2, 1000]).cast(pa.decimal128(38,10))}) f = pa.BufferOutputStream() pq.write_

[C++][Parquet] Unable to read memory??

2023-11-16 Thread nick.snels
Hi, I'm trying to get Parquet to work in C++. I have the following code: #include "arrow/io/api.h" #include "parquet/arrow/reader.h" #include "arrow/io/file.h" #include "parquet/stream_reader.h" int main() { std::shared_ptr infile; PARQUET_ASSIGN_OR_THROW( infi

[Python/C++] pyarrow.parquet.read_table stopped working in version 12.0.0

2023-11-16 Thread Jacek Pliszka
Hi! I found that after upgrading from 11.0.0. to 12.0.0 (or anything above) read_table filters with int64 on decimal columns stopped working. a1.pq parquet file containing: pyarrow.Table dec: decimal128(38, 10) dec: [[8024.00,8010.00]] pq.read_table("a1.pq", filters=[['dec',