[jira] [Created] (ARROW-6056) [Java] Handle exceptions when flight service processes put requests

2019-07-27 Thread Liya Fan (JIRA)
Liya Fan created ARROW-6056: --- Summary: [Java] Handle exceptions when flight service processes put requests Key: ARROW-6056 URL: https://issues.apache.org/jira/browse/ARROW-6056 Project: Apache Arrow

Re: [DISCUSS] Release cadence and release vote conventions

2019-07-27 Thread Micah Kornfield
I just wanted to bump this thread. Kou and Krisztián as the last two release managers is there any specific infrastructure that you think might have helped? Thanks, Micah On Wed, Jul 17, 2019 at 11:29 PM Micah Kornfield wrote: > I'd can help as well, but not exactly sure where to start. It se

Re: [C++] Private implementations and virtual interfaces

2019-07-27 Thread Wes McKinney
On Sat, Jul 27, 2019 at 4:38 PM Uwe L. Korn wrote: > > The PIMPL is a thing I would trade a bit of performance as it brings ABI > stability. This is something that will help us making Arrow usage in > thirdparty code much simpler. > I question whether ABI stability (at the level of the shared l

Re: [C++] Private implementations and virtual interfaces

2019-07-27 Thread Uwe L. Korn
The PIMPL is a thing I would trade a bit of performance as it brings ABI stability. This is something that will help us making Arrow usage in thirdparty code much simpler. Simple updates when an API was only extended but the ABI is intact is a great ease on the Arrow consumer side. I know that

Re: BigQuery Storage API now supports Arow

2019-07-27 Thread Micah Kornfield
> > That’s awesome!! It’s pretty surreal to request a feature from google and > have it built out. I hope this is beneficial customers in general. Thank you for filing the request. If I'm reading the code correctly looks like you are transporting the > IPC payload in the protobuf format of the

Re: BigQuery Storage API now supports Arow

2019-07-27 Thread Micah Kornfield
Hi David, > I see the original thread mentioned Flight support, do you think it'd > be possible to support Flight natively? Or conversely, maybe this > could be a candidate for a new Flight "backend" as has been discussed. Right now our main priority is addressing the caveats I mentioned above. A

Re: [C++] Private implementations and virtual interfaces

2019-07-27 Thread Jed Brown
Wes McKinney writes: > The abstract/all-virtual base has some benefits: > > * No need to implement "forwarding" methods to the private implementation > * Do not have to declare "friend" classes in the header for some cases > where other classes need to access the methods of a private > implementa

Re: BigQuery Storage API now supports Arow

2019-07-27 Thread Wes McKinney
Very nice! If I'm reading the code correctly looks like you are transporting the IPC payload in the protobuf format of the bigquery storage API https://github.com/googleapis/google-cloud-python/blob/3d324389b92d43e52486f0fe2aca8b41e950640c/bigquery_storage/google/cloud/bigquery_storage_v1beta1/p

Re: BigQuery Storage API now supports Arow

2019-07-27 Thread Jonathan Chiang
Hi Micah, That’s awesome!! It’s pretty surreal to request a feature from google and have it built out. Thanks, Jonathan > On Jul 26, 2019, at 8:43 PM, Micah Kornfield wrote: > > Hi Arrow Dev, > As a follow-up to an old thread [1] on working with BigQuery and Arrow. I > just wanted to share

[C++] Private implementations and virtual interfaces

2019-07-27 Thread Wes McKinney
hi folks, In some places I have favored using an abstract class interface with exclusively pure virtual functions over the PIMPL pattern. I think it would merit some discussion of why we should use one over the other. First, here's a quick example of the difference https://gist.github.com/wesm/a

[jira] [Created] (ARROW-6055) [C++] Refactor arrow/io/hdfs.h to use common FileSystem API

2019-07-27 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-6055: --- Summary: [C++] Refactor arrow/io/hdfs.h to use common FileSystem API Key: ARROW-6055 URL: https://issues.apache.org/jira/browse/ARROW-6055 Project: Apache Arrow

[jira] [Created] (ARROW-6054) pyarrow.serialize should respect the value of structured dtype of numpy

2019-07-27 Thread Tao He (JIRA)
Tao He created ARROW-6054: - Summary: pyarrow.serialize should respect the value of structured dtype of numpy Key: ARROW-6054 URL: https://issues.apache.org/jira/browse/ARROW-6054 Project: Apache Arrow

Re: BigQuery Storage API now supports Arow

2019-07-27 Thread Fan Liya
@Micah Kornfield Awesome work! Big congratulations! Best, Liya Fan On Sat, Jul 27, 2019 at 9:17 PM David Li wrote: > This is super awesome, thanks for sharing! > > I see the original thread mentioned Flight support, do you think it'd > be possible to support Flight natively? Or conversely, may

Re: BigQuery Storage API now supports Arow

2019-07-27 Thread David Li
This is super awesome, thanks for sharing! I see the original thread mentioned Flight support, do you think it'd be possible to support Flight natively? Or conversely, maybe this could be a candidate for a new Flight "backend" as has been discussed. Best, David On 7/26/19, Micah Kornfield wrote