[NIGHTLY] Arrow Build Report for Job nightly-2020-04-22-0

2020-04-22 Thread Crossbow
Arrow Build Report for Job nightly-2020-04-22-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-22-0 Failed Tasks: - test-conda-python-3.7-turbodbc-latest: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-22-0-circle-test-cond

[jira] [Created] (ARROW-8553) [C++] Reimplement BitmapAnd using Bitmap::VisitWords

2020-04-22 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-8553: - Summary: [C++] Reimplement BitmapAnd using Bitmap::VisitWords Key: ARROW-8553 URL: https://issues.apache.org/jira/browse/ARROW-8553 Project: Apache Arrow I

Re: [DISCUSS] Reducing scope of work for Arrow 1.0.0 release

2020-04-22 Thread Wes McKinney
hi Micah, I'm not saying that I think the work definitely will not be completed, but rather that we should put a date on the calendar as the target date for 1.0.0 and stick to it. If the work gets done, that's great. 10 to 12 weeks from now would mean releasing 1.0.0 either the week of June 29 or

Re: [C++] Big-endian support

2020-04-22 Thread Wes McKinney
On Wed, Apr 22, 2020 at 12:05 AM Micah Kornfield wrote: > > > > > That said, if big-endian developers would assist with > > other parts of the C++ project as a sort of "quid-pro-quo" to balance > > the time spent on code review relating to big-endian that would be > > helpful. > > I think setting/

Re: [C++] Big-endian support

2020-04-22 Thread Wes McKinney
hi Kazuaki On Wed, Apr 22, 2020 at 12:41 AM Kazuaki Ishizaki wrote: > > Thank you for your comments. I see that the developers would assist of > other parts, too. > > For developing OSS on big-endian, here are resource for an environment and > CI. They would be helpful for code review, too. > A t

Re: [C++] Revamping approach to Arrow compute kernel development

2020-04-22 Thread Wes McKinney
On Wed, Apr 22, 2020 at 12:41 AM Micah Kornfield wrote: > > Hi Wes, > I haven't had time to read the doc, but wanted to ask some questions on > points raised on the thread. > > * For efficiency, kernels used for array-expr evaluation should write > > into preallocated memory as their default mode.

Re: [VOTE] Release Apache Arrow 0.17.0 - RC0

2020-04-22 Thread Wes McKinney
FTR it seems that the compiler error on VS 2017 on Windows is showing up elsewhere https://dev.azure.com/conda-forge/feedstock-builds/_build/results?buildId=147598&view=logs&j=e5cdccbf-4751-5a24-7406-185c9d30d021&t=1a956d00-e7ee-5aca-9899-9cb1f0a4d4a8&l=1045 If the -DCMAKE_UNITY_BUILD=ON workarou

[jira] [Created] (ARROW-8554) [C++][Benchmark] Fix building error "cannot bind lvalue"

2020-04-22 Thread Jiajia Li (Jira)
Jiajia Li created ARROW-8554: Summary: [C++][Benchmark] Fix building error "cannot bind lvalue" Key: ARROW-8554 URL: https://issues.apache.org/jira/browse/ARROW-8554 Project: Apache Arrow Issue T

Re: 0.17 release blog post: help needed

2020-04-22 Thread Wes McKinney
No, nothing major that needs to be copied over On Tue, Apr 21, 2020 at 5:15 PM Neal Richardson wrote: > > Hope you weren't editing the google doc while I was moving it to > https://github.com/apache/arrow-site/pull/55. If so, would you mind copying > over any relevant changes? > > Neal > > > On T

[jira] [Created] (ARROW-8555) [FlightRPC][Java] Implement Flight DoExchange for Java

2020-04-22 Thread David Li (Jira)
David Li created ARROW-8555: --- Summary: [FlightRPC][Java] Implement Flight DoExchange for Java Key: ARROW-8555 URL: https://issues.apache.org/jira/browse/ARROW-8555 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-8556) [R] Installation fails with `LIBARROW_MINIMAL=false`

2020-04-22 Thread Karl Dunkle Werner (Jira)
Karl Dunkle Werner created ARROW-8556: - Summary: [R] Installation fails with `LIBARROW_MINIMAL=false` Key: ARROW-8556 URL: https://issues.apache.org/jira/browse/ARROW-8556 Project: Apache Arrow

Re: [VOTE] Release Apache Arrow 0.17.0 - RC0

2020-04-22 Thread Neal Richardson
On the post-release tasks, CRAN has accepted the 0.17 release. Homebrew hasn't yet accepted because on initial review, they didn't believe that we'd done the release because the website hadn't been updated yet. Neal On Wed, Apr 22, 2020 at 6:17 AM Wes McKinney wrote: > FTR it seems that the com

[jira] [Created] (ARROW-8557) from pyarrow import parquet fails with AttributeError: type object 'pyarrow._parquet.Statistics' has no attribute '__reduce_cython__'

2020-04-22 Thread Haluk Tokgozoglu (Jira)
Haluk Tokgozoglu created ARROW-8557: --- Summary: from pyarrow import parquet fails with AttributeError: type object 'pyarrow._parquet.Statistics' has no attribute '__reduce_cython__' Key: ARROW-8557 URL: https://i

Re: [VOTE] Release Apache Arrow 0.17.0 - RC0

2020-04-22 Thread Krisztián Szűcs
Which website? On Wed, Apr 22, 2020 at 7:31 PM Neal Richardson wrote: > > On the post-release tasks, CRAN has accepted the 0.17 release. Homebrew > hasn't yet accepted because on initial review, they didn't believe that > we'd done the release because the website hadn't been updated yet. > > Neal

Re: [VOTE] Release Apache Arrow 0.17.0 - RC0

2020-04-22 Thread Neal Richardson
arrow.apache.org. They looked like 30 minutes before you updated it :/ On Wed, Apr 22, 2020 at 11:14 AM Krisztián Szűcs wrote: > Which website? > > On Wed, Apr 22, 2020 at 7:31 PM Neal Richardson > wrote: > > > > On the post-release tasks, CRAN has accepted the 0.17 release. Homebrew > > hasn't

[jira] [Created] (ARROW-8558) [Rust] GitHub Actions missing rustfmt

2020-04-22 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-8558: -- Summary: [Rust] GitHub Actions missing rustfmt Key: ARROW-8558 URL: https://issues.apache.org/jira/browse/ARROW-8558 Project: Apache Arrow Issue Type: New Featur

[jira] [Created] (ARROW-8559) [Rust] Consolidate Record Batch iterator traits in main arrow crate

2020-04-22 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-8559: -- Summary: [Rust] Consolidate Record Batch iterator traits in main arrow crate Key: ARROW-8559 URL: https://issues.apache.org/jira/browse/ARROW-8559 Project: Apache Arrow

[Discuss] [Rust] Common Trait(s) for iterating over RecordBatch's

2020-04-22 Thread paddy horan
Hi All, I just open ARROW-8559 [1] to consolidate the traits for Record Batch iterators. I feel this needs to be done prior to 1.0 as we need to be clear as to what external crates should implement to integrate with the Arrow ecosystem. This might be disruptive though so I wanted to bring it

[jira] [Created] (ARROW-8560) [Rust] Docs for MutableBuffer resize are incorrect

2020-04-22 Thread Paddy Horan (Jira)
Paddy Horan created ARROW-8560: -- Summary: [Rust] Docs for MutableBuffer resize are incorrect Key: ARROW-8560 URL: https://issues.apache.org/jira/browse/ARROW-8560 Project: Apache Arrow Issue Typ

[jira] [Created] (ARROW-8561) [C++][Gandiva] Stop using deprecated google::protobuf::MessageLite::ByteSize()

2020-04-22 Thread Kouhei Sutou (Jira)
Kouhei Sutou created ARROW-8561: --- Summary: [C++][Gandiva] Stop using deprecated google::protobuf::MessageLite::ByteSize() Key: ARROW-8561 URL: https://issues.apache.org/jira/browse/ARROW-8561 Project: A

[jira] [Created] (ARROW-8562) [C++] IO: Parameterize I/O coalescing using S3 storage metrics

2020-04-22 Thread Mayur Srivastava (Jira)
Mayur Srivastava created ARROW-8562: --- Summary: [C++] IO: Parameterize I/O coalescing using S3 storage metrics Key: ARROW-8562 URL: https://issues.apache.org/jira/browse/ARROW-8562 Project: Apache Ar

[VOTE] Add "trivial" RecordBatch body compression to Arrow IPC protocol

2020-04-22 Thread Wes McKinney
Hello, I have proposed adding a simple RecordBatch IPC message body compression scheme (using either LZ4 or ZSTD) to the Arrow IPC protocol in GitHub PR [1] as discussed on the mailing list [2]. This is distinct from separate discussions about adding in-memory encodings (like RLE-encoding) to the

Re: [VOTE] Add "trivial" RecordBatch body compression to Arrow IPC protocol

2020-04-22 Thread Fan Liya
My vote: +1 Best, Liya Fan On Thu, Apr 23, 2020 at 8:24 AM Wes McKinney wrote: > Hello, > > I have proposed adding a simple RecordBatch IPC message body > compression scheme (using either LZ4 or ZSTD) to the Arrow IPC > protocol in GitHub PR [1] as discussed on the mailing list [2]. This > is d

[jira] [Created] (ARROW-8563) Minor change to make newBuilder public

2020-04-22 Thread Amol Umbarkar (Jira)
Amol Umbarkar created ARROW-8563: Summary: Minor change to make newBuilder public Key: ARROW-8563 URL: https://issues.apache.org/jira/browse/ARROW-8563 Project: Apache Arrow Issue Type: Impro