Re: [VOTE][RUST] Release Apache Arrow Rust Object Store 0.5.0 RC1

2022-09-11 Thread Andrew Lamb
Hi Jeremy, Thank you for the report. It appears that while quick-xml 0.24 was yanked, they have subsequently released 0.24.1 (see discussion on [1]). I just ran the verification script and it passed again for me. Can you please re-test? Andrew [1] https://github.com/tafia/quick-xml/issues/475 O

Re: [VOTE][RUST] Release Apache Arrow Rust Object Store 0.5.0 RC1

2022-09-11 Thread Jeremy Dyer
Change vote to +1 (non-binding) Right, looks like I tried it at just the wrong time yesterday. 0.24.1 was definitely not in crates.io when I tried. Now that 0.24.1 is there everything is working as expected. - Validated through both release script and manually Jeremy Dyer On Sun, Sep 11, 2022 a

PyArrow build problem

2022-09-11 Thread Yaron Gvili
Hi All, I got the error below while running "cd python/ && python setup.py build_ext --inplace", after successfully building and installing a recent master version (a63e60bad89b41266d155bc496eb383765702492) of Arrow C++ under a pyarrow-dev Conda environment, as in the Python dev doc (https://a

Re: Transactional semantics in Acero

2022-09-11 Thread Micah Kornfield
Delta Lake has rust bindings which should in theory be linkable into native code. Iceberg is actively developing a python library and there has been talk of Rust/native bindings. I'd like to see a C++ implementation that can be incorporated into Datasets but don't currently have bandwidth to wor

Re: Transactional semantics in Acero

2022-09-11 Thread Jayjeet Chakraborty
Thanks a lot, Micah On Sun, Sep 11, 2022 at 10:11 PM Micah Kornfield wrote: > Delta Lake has rust bindings which should in theory be linkable into > native code. > > Iceberg is actively developing a python library and there has been talk of > Rust/native bindings. I'd like to see a C++ impleme

Re: PyArrow build problem

2022-09-11 Thread Yaron Gvili
After spending a bit more time on this, it looks like the problem may be related to the structure of PyArrow and its build system being changed since the previous time I synced. I found PyArrow C++ source has moved to `python/pyarrow/src` and has a separate `CMakeLists.txt` root. However, I cou

RE: Re: PyArrow build problem

2022-09-11 Thread Anja Boskovic
Hi Yaron! This tripped me up, too. It seems to have started around this commit: https://github.com/apache/arrow/commit/93b63e8f3b4880927ccbd5522c967df79e926cda . I ended up needing to wipe my checkout from hidden build files using `git clean -Xfd .` and then rebuilding/reinstalling Arrow C++

Re: PyArrow build problem

2022-09-11 Thread Sutou Kouhei
Hi, It seems that /miniconda3/envs/pyarrow-dev/lib/cmake/Arrow/ArrowConfig.cmake isn't used. Could you share a build log with PYARROW_CMAKE_OPTIONS="-DCMAKE_FIND_DEBUG_MODE=ON" environment variable? You may need to export CMAKE_PREFIX_PATH=/miniconda3/envs/pyarrow-dev environment variable but the

Re: [VOTE][RUST] Release Apache Arrow Rust Object Store 0.5.0 RC1

2022-09-11 Thread Andrew Lamb
With 8 +1 votes (3 binding) the release is approved. Thanks all! The release is available here: https://dist.apache.org/repos/dist/release/arrow/arrow-object-store-rs-0.5.0 It has also been published to crates.io: https://crates.io/crates/object_store/0.5.0 Thanks again, Andrew On Sun, Sep 11,