Re: Timeline for 0.13 Arrow release

2019-03-16 Thread Kouhei Sutou
Hi, > Submitted the packaging builds: > https://github.com/kszucs/crossbow/branches/all?utf8=%E2%9C%93&query=build-452 I've fixed .deb/.rpm packages: https://github.com/apache/arrow/pull/3934 It has been merged. So .deb/.rpm packages are ready for release. Thanks, -- kou In "Re: Timeline for

Re: Passing File Descriptors in the Low-Level API

2019-03-16 Thread Brian Bowman
Thanks Wes! I'm working on the integrating and testing the necessary changes in our dev environment. I'll submit a PR once things are working. Best, Brian On 3/16/19, 4:24 PM, "Wes McKinney" wrote: EXTERNAL hi Brian, Please feel free to submit a PR to add the requisi

Parquet test files with all data types

2019-03-16 Thread Andy Grove
Hi, The currently available Parquet files in the Arrow repository don't seem to be sufficient for unit testing support for all date/time data types. For example the "alltypes_plain.parquet" only has one time column and it uses the deprecated INT96 encoding. I guess I'm volunteering to try and cre

[jira] [Created] (ARROW-4929) [GLib] Add garrow_array_count_values()

2019-03-16 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-4929: --- Summary: [GLib] Add garrow_array_count_values() Key: ARROW-4929 URL: https://issues.apache.org/jira/browse/ARROW-4929 Project: Apache Arrow Issue Type: New Fea

[jira] [Created] (ARROW-4928) [Python] Hypothesis test failures

2019-03-16 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-4928: --- Summary: [Python] Hypothesis test failures Key: ARROW-4928 URL: https://issues.apache.org/jira/browse/ARROW-4928 Project: Apache Arrow Issue Type: Bug

Re: Passing File Descriptors in the Low-Level API

2019-03-16 Thread Wes McKinney
hi Brian, Please feel free to submit a PR to add the requisite APIs that you need for your application. Antoine or I or others should be able to give prompt feedback since we know this code pretty well. Thanks Wes On Sat, Mar 16, 2019 at 11:40 AM Brian Bowman wrote: > > Hi Wes, > > Thanks for t

[R] Improving documentation and transparency for Arrow build and packaging work for R

2019-03-16 Thread Wes McKinney
hi folks, I have noticed there is work under way to prepare Apache Arrow for submission to the CRAN package manager for R users. I'm slightly concerned about the lack of information and documentation in the project regarding what is involved with this effort. This patch in particular raised some e

Re: CMake refactor Heads-up

2019-03-16 Thread Suvayu Ali
Hi Uwe, On Sat, Mar 16, 2019 at 04:31:32PM +0100, Uwe L. Korn wrote: > > > 2. I don't know if this is intentional, but jemalloc and rapidjson aren't > > detected on my system. > > > > Not sure if it is detected or not as this is missing from the log above. That > log lists only the bundled ve

Re: Passing File Descriptors in the Low-Level API

2019-03-16 Thread Brian Bowman
Hi Wes, Thanks for the quick reply! To be clear, the usage I'm working on needs to own both the Open FileDescriptor and corresponding mapped memory. In other words ... SAS component does both open() and mmap() which could be for READ or WRITE. -> Calls low-level Parquet APIs to read an exist

[jira] [Created] (ARROW-4927) [Rust] Update top level README

2019-03-16 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4927: - Summary: [Rust] Update top level README Key: ARROW-4927 URL: https://issues.apache.org/jira/browse/ARROW-4927 Project: Apache Arrow Issue Type: Improvement

Re: CMake refactor Heads-up

2019-03-16 Thread Uwe L. Korn
Hello, > Am 16.03.2019 um 14:30 schrieb Suvayu Ali : > > Hello Uwe, > >> On Fri, Mar 15, 2019 at 10:38:32AM -0400, Uwe L. Korn wrote: >> >> we have merged the CMake refactor yesterday >> https://github.com/apache/arrow/pull/3688 and this means that the build >> system behaves a bit different.

[jira] [Created] (ARROW-4926) [Rust] [DataFusion] Update README for 0.13.0 release

2019-03-16 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4926: - Summary: [Rust] [DataFusion] Update README for 0.13.0 release Key: ARROW-4926 URL: https://issues.apache.org/jira/browse/ARROW-4926 Project: Apache Arrow Issue Typ

[jira] [Created] (ARROW-4925) [Rust] [DataFusion] Remove duplicate implementations of collect_expr

2019-03-16 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4925: - Summary: [Rust] [DataFusion] Remove duplicate implementations of collect_expr Key: ARROW-4925 URL: https://issues.apache.org/jira/browse/ARROW-4925 Project: Apache Arrow

Re: CMake refactor Heads-up

2019-03-16 Thread Suvayu Ali
Hello Uwe, On Fri, Mar 15, 2019 at 10:38:32AM -0400, Uwe L. Korn wrote: > > we have merged the CMake refactor yesterday > https://github.com/apache/arrow/pull/3688 and this means that the build > system behaves a bit different. The main differences are: > A few more comments: 1. There was an e

[jira] [Created] (ARROW-4924) [Ruby] Add Decimal128#to_s(scale=nil)

2019-03-16 Thread Yosuke Shiro (JIRA)
Yosuke Shiro created ARROW-4924: --- Summary: [Ruby] Add Decimal128#to_s(scale=nil) Key: ARROW-4924 URL: https://issues.apache.org/jira/browse/ARROW-4924 Project: Apache Arrow Issue Type: New Feat

Re: CMake refactor Heads-up

2019-03-16 Thread Suvayu Ali
On Sat, Mar 16, 2019 at 04:35:32AM -0400, Uwe L. Korn wrote: > Hello Suvayu, > > On Fri, Mar 15, 2019, at 10:08 PM, Suvayu Ali wrote: > > Is there a recommended way to choose between Python versions? Fedora > > repos often provide several Python versions, e.g. on F28 I have 2.7 > > (default), 3

[jira] [Created] (ARROW-4923) Expose setters for Decimal vector that take long and double inputs

2019-03-16 Thread Thippana Vamsi Kalyan (JIRA)
Thippana Vamsi Kalyan created ARROW-4923: Summary: Expose setters for Decimal vector that take long and double inputs Key: ARROW-4923 URL: https://issues.apache.org/jira/browse/ARROW-4923 Proj

[jira] [Created] (ARROW-4922) [Packaging] Use system libraris for .deb and .rpm

2019-03-16 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-4922: --- Summary: [Packaging] Use system libraris for .deb and .rpm Key: ARROW-4922 URL: https://issues.apache.org/jira/browse/ARROW-4922 Project: Apache Arrow Issue Ty

Re: CMake refactor Heads-up

2019-03-16 Thread Uwe L. Korn
Hello Suvayu, On Fri, Mar 15, 2019, at 10:08 PM, Suvayu Ali wrote: > Is there a recommended way to choose between Python versions? Fedora > repos often provide several Python versions, e.g. on F28 I have 2.7 > (default), 3.6, and 3.7. The correct Python version was detected for > me with: >

[jira] [Created] (ARROW-4921) [GLib] Add support for arrow::SparseUnionBuilder

2019-03-16 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-4921: --- Summary: [GLib] Add support for arrow::SparseUnionBuilder Key: ARROW-4921 URL: https://issues.apache.org/jira/browse/ARROW-4921 Project: Apache Arrow Issue Typ

[jira] [Created] (ARROW-4920) [GLib] Add support for arrow::DenseUnionBuilder

2019-03-16 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-4920: --- Summary: [GLib] Add support for arrow::DenseUnionBuilder Key: ARROW-4920 URL: https://issues.apache.org/jira/browse/ARROW-4920 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-4919) [GLib] Add support for arrow::DictionaryBuilder

2019-03-16 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-4919: --- Summary: [GLib] Add support for arrow::DictionaryBuilder Key: ARROW-4919 URL: https://issues.apache.org/jira/browse/ARROW-4919 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-4918) [C++] Add cmake-format to pre-commit

2019-03-16 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4918: -- Summary: [C++] Add cmake-format to pre-commit Key: ARROW-4918 URL: https://issues.apache.org/jira/browse/ARROW-4918 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-4917) [C++] orc_ep fails in cpp-alpine docker

2019-03-16 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4917: -- Summary: [C++] orc_ep fails in cpp-alpine docker Key: ARROW-4917 URL: https://issues.apache.org/jira/browse/ARROW-4917 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-4916) [C++] Add clang-format to pre-commit hook

2019-03-16 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4916: -- Summary: [C++] Add clang-format to pre-commit hook Key: ARROW-4916 URL: https://issues.apache.org/jira/browse/ARROW-4916 Project: Apache Arrow Issue Type: Task

[jira] [Created] (ARROW-4915) [GLib] Add support for arrow::NullBuilder

2019-03-16 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-4915: --- Summary: [GLib] Add support for arrow::NullBuilder Key: ARROW-4915 URL: https://issues.apache.org/jira/browse/ARROW-4915 Project: Apache Arrow Issue Type: New

[jira] [Created] (ARROW-4914) [Rust] Array slice returns incorrect bitmask

2019-03-16 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-4914: - Summary: [Rust] Array slice returns incorrect bitmask Key: ARROW-4914 URL: https://issues.apache.org/jira/browse/ARROW-4914 Project: Apache Arrow Issue Typ