Join operation on attributes from arrow structs

2020-03-22 Thread Hasara Maithree
Hi all, Assume I have a json file named 'my_data.json' as below. *{"a": [1, 2], "b": {"c": true, "d": "1991-02-03"}} {"a": [3, 4, 5], "b": {"c": false, "d": "2019-04-01"**}}* If I need to do a join operation based on attribute d, can I do it directly from arrow structs? ( or are there any effici

Re: [Discuss][FlightRPC] Extensions to Flight: "DoBidirectional"

2020-03-22 Thread Wes McKinney
hi David, I did a preliminary view and things look to be on the right track there. What do you think about breaking out the protocol changes (and adding appropriate comments) so we can have a vote on that in relatively short order? - Wes On Wed, Mar 18, 2020 at 9:06 AM David Li wrote: > > Follo

Re: [Discuss] Proposal for optimizing Datasets over S3/object storage

2020-03-22 Thread Wes McKinney
On Thu, Mar 19, 2020 at 10:04 AM David Li wrote: > > > That's why it's important that we set ourselves up to do performance > > testing in a realistic environment in AWS rather than simulating it. > > For my clarification, what are the plans for this (if any)? I couldn't > find any prior discussi

[jira] [Created] (ARROW-8183) [c++][FlightRPC] Expose transport error metadata

2020-03-22 Thread Ryan Murray (Jira)
Ryan Murray created ARROW-8183: -- Summary: [c++][FlightRPC] Expose transport error metadata Key: ARROW-8183 URL: https://issues.apache.org/jira/browse/ARROW-8183 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-8182) [Packaging] Increment version detected from the git tags

2020-03-22 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-8182: -- Summary: [Packaging] Increment version detected from the git tags Key: ARROW-8182 URL: https://issues.apache.org/jira/browse/ARROW-8182 Project: Apache Arrow

[NIGHTLY] Arrow Build Report for Job nightly-2020-03-22-0

2020-03-22 Thread Crossbow
Arrow Build Report for Job nightly-2020-03-22-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-03-22-0 Failed Tasks: - debian-stretch: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-03-22-0-github-debian-stretch - gandiva-jar-osx