Re: Flight API for c_glib

2020-03-29 Thread Tanveer Ahmad - EWI
Thanks Kou for reply. Regards, Tanveer Ahmad From: Sutou Kouhei Sent: Thursday, March 26, 2020 9:29:28 PM To: dev@arrow.apache.org Subject: Re: Flight API for c_glib Hi, In "Flight API for c_glib" on Thu, 26 Mar 2020 16:01:25 +, Tanveer Ahmad - EWI wr

[NIGHTLY] Arrow Build Report for Job nightly-2020-03-29-0

2020-03-29 Thread Crossbow
Arrow Build Report for Job nightly-2020-03-29-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-03-29-0 Failed Tasks: - centos-7: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-03-29-0-github-centos-7 - conda-linux-gcc-py36: URL

[jira] [Created] (ARROW-8253) [Rust] [DataFusion] Improve ergonomics of registering UDFs

2020-03-29 Thread Andy Grove (Jira)
Andy Grove created ARROW-8253: - Summary: [Rust] [DataFusion] Improve ergonomics of registering UDFs Key: ARROW-8253 URL: https://issues.apache.org/jira/browse/ARROW-8253 Project: Apache Arrow Iss

[jira] [Created] (ARROW-8254) [Rust] [DataFusion] Cannot run SELECT COUNT(*) against CSV

2020-03-29 Thread Andy Grove (Jira)
Andy Grove created ARROW-8254: - Summary: [Rust] [DataFusion] Cannot run SELECT COUNT(*) against CSV Key: ARROW-8254 URL: https://issues.apache.org/jira/browse/ARROW-8254 Project: Apache Arrow Iss

[jira] [Created] (ARROW-8255) [Rust] [DataFusion] COUNT(*) results in confusing error

2020-03-29 Thread Andy Grove (Jira)
Andy Grove created ARROW-8255: - Summary: [Rust] [DataFusion] COUNT(*) results in confusing error Key: ARROW-8255 URL: https://issues.apache.org/jira/browse/ARROW-8255 Project: Apache Arrow Issue

[jira] [Created] (ARROW-8256) [Rust] [DatFusion] Update CLI documentation for 0.17.0 release

2020-03-29 Thread Andy Grove (Jira)
Andy Grove created ARROW-8256: - Summary: [Rust] [DatFusion] Update CLI documentation for 0.17.0 release Key: ARROW-8256 URL: https://issues.apache.org/jira/browse/ARROW-8256 Project: Apache Arrow

[jira] [Created] (ARROW-8257) Clarification regarding the `CDataInterface.rst`

2020-03-29 Thread Anish Biswas (Jira)
Anish Biswas created ARROW-8257: --- Summary: Clarification regarding the `CDataInterface.rst` Key: ARROW-8257 URL: https://issues.apache.org/jira/browse/ARROW-8257 Project: Apache Arrow Issue Typ

[jira] [Created] (ARROW-8258) [Rust] [DataFusion[ SELECT * LIMIT 1 fails with schema error

2020-03-29 Thread Andy Grove (Jira)
Andy Grove created ARROW-8258: - Summary: [Rust] [DataFusion[ SELECT * LIMIT 1 fails with schema error Key: ARROW-8258 URL: https://issues.apache.org/jira/browse/ARROW-8258 Project: Apache Arrow

[jira] [Created] (ARROW-8259) [Rust] [DataFusion] ProjectionPushDownRule does not rewrite LIMIT

2020-03-29 Thread Andy Grove (Jira)
Andy Grove created ARROW-8259: - Summary: [Rust] [DataFusion] ProjectionPushDownRule does not rewrite LIMIT Key: ARROW-8259 URL: https://issues.apache.org/jira/browse/ARROW-8259 Project: Apache Arrow

[jira] [Created] (ARROW-8260) [Rust] [DataFusion] Add validation for unreferenced table in query

2020-03-29 Thread Andy Grove (Jira)
Andy Grove created ARROW-8260: - Summary: [Rust] [DataFusion] Add validation for unreferenced table in query Key: ARROW-8260 URL: https://issues.apache.org/jira/browse/ARROW-8260 Project: Apache Arrow

[jira] [Created] (ARROW-8261) [Rust] [DataFusion] LogicalPlanBuilder.limit() should take a literal argument

2020-03-29 Thread Andy Grove (Jira)
Andy Grove created ARROW-8261: - Summary: [Rust] [DataFusion] LogicalPlanBuilder.limit() should take a literal argument Key: ARROW-8261 URL: https://issues.apache.org/jira/browse/ARROW-8261 Project: Apache

[jira] [Created] (ARROW-8262) [Rust] [DataFusion] Add example that uses LogicalPlanBuilder

2020-03-29 Thread Andy Grove (Jira)
Andy Grove created ARROW-8262: - Summary: [Rust] [DataFusion] Add example that uses LogicalPlanBuilder Key: ARROW-8262 URL: https://issues.apache.org/jira/browse/ARROW-8262 Project: Apache Arrow

[jira] [Created] (ARROW-8263) [Rust] [DataFusion] Add documentation for supported SQL functions

2020-03-29 Thread Andy Grove (Jira)
Andy Grove created ARROW-8263: - Summary: [Rust] [DataFusion] Add documentation for supported SQL functions Key: ARROW-8263 URL: https://issues.apache.org/jira/browse/ARROW-8263 Project: Apache Arrow

[jira] [Created] (ARROW-8264) [Rust] Create utility for printing record batches

2020-03-29 Thread Andy Grove (Jira)
Andy Grove created ARROW-8264: - Summary: [Rust] Create utility for printing record batches Key: ARROW-8264 URL: https://issues.apache.org/jira/browse/ARROW-8264 Project: Apache Arrow Issue Type:

Clarification regarding the `CDataInterface.rst`

2020-03-29 Thread Anish Biswas
I have been trying to wrap my head around the[ CDataInterface.rst| https://github.com/apache/arrow/blob/master/docs/source/format/CDataInterface.rst] document for a few days now. So what I am trying is basically to use the C interface with a minimum dependencies to produce blocks of bytes that pyar

[jira] [Created] (ARROW-8265) [Rust] [DataFusion] Table API collect() should not require context

2020-03-29 Thread Andy Grove (Jira)
Andy Grove created ARROW-8265: - Summary: [Rust] [DataFusion] Table API collect() should not require context Key: ARROW-8265 URL: https://issues.apache.org/jira/browse/ARROW-8265 Project: Apache Arrow

Re: Clarification regarding the `CDataInterface.rst`

2020-03-29 Thread Neal Richardson
Hi Anish, You may be interested in how the Arrow R package uses the C interface to pass data to/from pyarrow. Both sides use the Arrow C++ library's implementation of the C interface. See https://github.com/apache/arrow/blob/master/r/src/py-to-r.cpp and https://github.com/apache/arrow/blob/master/r

Re: Clarification regarding the `CDataInterface.rst`

2020-03-29 Thread Wes McKinney
To add to this, take a look at the C interface functions in pyarrow Reconstruct pyarrow.DataType from C ArrowSchema https://github.com/apache/arrow/blob/b07c2626cb3cdd3498b41da9feedf7c8319baa27/python/pyarrow/types.pxi#L203 Reconstruct pyarrow.Array from C ArrowArray https://github.com/apache/a

[jira] [Created] (ARROW-8266) [C++] Add backup mirrors for external project source downloads

2020-03-29 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-8266: -- Summary: [C++] Add backup mirrors for external project source downloads Key: ARROW-8266 URL: https://issues.apache.org/jira/browse/ARROW-8266 Project: Apache Arro

[jira] [Created] (ARROW-8267) [CI][GLib] Failed to build on Ubuntu 16.04

2020-03-29 Thread Kouhei Sutou (Jira)
Kouhei Sutou created ARROW-8267: --- Summary: [CI][GLib] Failed to build on Ubuntu 16.04 Key: ARROW-8267 URL: https://issues.apache.org/jira/browse/ARROW-8267 Project: Apache Arrow Issue Type: Imp

Re: Coordinating / scheduling C++ Parquet-Arrow nested data work (ARROW-1644 and others)

2020-03-29 Thread Igor Calabria
Hi Micah, Finally got around to doing some work on the reader's side. Like you suggested, I started with https://issues.apache.org/jira/browse/ARROW-7960. I never programmed C++ professionally so I opened the PR https://github.com/apache/arrow/pull/6758 as soon as possible to collect feedback whil

[NIGHTLY] Arrow Build Report for Job nightly-2020-03-29-1

2020-03-29 Thread Crossbow
Arrow Build Report for Job nightly-2020-03-29-1 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-03-29-1 Failed Tasks: - centos-7: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-03-29-1-github-centos-7 - conda-linux-gcc-py36: URL

Re: [NIGHTLY] Arrow Build Report for Job nightly-2020-03-29-1

2020-03-29 Thread Neal Richardson
Most of these are failing because of the failure to download boost, which has been an issue since Friday. Not sure if it is rate limiting on the boostorg bintray account or what. My patch https://github.com/apache/arrow/pull/6734 resolves this; someone more skilled in cmake should sign off on the c

Re: [VOTE] Accept "DoExchange" RPC to Arrow Flight protocol

2020-03-29 Thread Andy Grove
+1 (binding) On Sat, Mar 28, 2020 at 5:08 AM Antoine Pitrou wrote: > > +1 (binding) > > > Le 28/03/2020 à 01:44, Wes McKinney a écrit : > > Hello, > > > > David M Li has proposed adding a "bidirectional" DoExchange RPC [1] to > > the Arrow Flight Protocol [2]. In this client call, datasets (poss

Re: [NIGHTLY] Arrow Build Report for Job nightly-2020-03-29-1

2020-03-29 Thread Wes McKinney
Thanks Neal. I just merged the "Slim Boost" patch so fingers crossed that the builds are looking better tomorrow On Sun, Mar 29, 2020 at 9:58 PM Neal Richardson wrote: > > Most of these are failing because of the failure to download boost, which > has been an issue since Friday. Not sure if it is

[jira] [Created] (ARROW-8268) [Ruby] Test failure due to lack of built ZSTD support

2020-03-29 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-8268: --- Summary: [Ruby] Test failure due to lack of built ZSTD support Key: ARROW-8268 URL: https://issues.apache.org/jira/browse/ARROW-8268 Project: Apache Arrow Issu

[jira] [Created] (ARROW-8269) [Python] Failure in "nopandas" build in test_parquet_row_group_fragments

2020-03-29 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-8269: --- Summary: [Python] Failure in "nopandas" build in test_parquet_row_group_fragments Key: ARROW-8269 URL: https://issues.apache.org/jira/browse/ARROW-8269 Project: Apache

Re: Coordinating / scheduling C++ Parquet-Arrow nested data work (ARROW-1644 and others)

2020-03-29 Thread Micah Kornfield
Hi Igor, It looks like a good start. Thank you! I left feedback on the PR. I should have some time over the next few weeks or so to handle the combinations lists/structs that aren't currently supported in the core reader. As I get further into the code I'll chime in here if there are other areas

[jira] [Created] (ARROW-8270) [Python][Flight] Flight server with TLS's certificate and key is not working

2020-03-29 Thread Ravindra Wagh (Jira)
Ravindra Wagh created ARROW-8270: Summary: [Python][Flight] Flight server with TLS's certificate and key is not working Key: ARROW-8270 URL: https://issues.apache.org/jira/browse/ARROW-8270 Project: A