Re: PyArrow.Table schema.metadata issue

Thanks Maarten, It works. You're really helpfull. Thanks again. Best Regards, Aaron Chu On Wed, Nov 27, 2019 at 10:18 PM Maarten Ballintijn wrote: > Hi Aaron, > > The schema is immutable, add_metadata returns a new schema object which > includes the metadata. > So I think this does what you w

[jira] [Created] (ARROW-7281) AdaptiveIntBuilder::length() does not consider pending_pos_.

Adam Hooper created ARROW-7281: -- Summary: AdaptiveIntBuilder::length() does not consider pending_pos_. Key: ARROW-7281 URL: https://issues.apache.org/jira/browse/ARROW-7281 Project: Apache Arrow

Re: [Discuss][FlightRPC] Extensions to Flight: "DoBidirectional"

I would generally agree with this. Note that you have the possibility to use unions-of-structs to send record batches with different schemas in the same stream, though with some added complexity on each side On Thu, Nov 28, 2019 at 10:37 AM Jacques Nadeau wrote: > > I'd vote for explicitly not su

[jira] [Created] (ARROW-7280) Flight Data Store : memory mapped file [JAVA and Python]

Vinay created ARROW-7280: Summary: Flight Data Store : memory mapped file [JAVA and Python] Key: ARROW-7280 URL: https://issues.apache.org/jira/browse/ARROW-7280 Project: Apache Arrow Issue Type: Tes

[NIGHTLY] Arrow Build Report for Job nightly-2019-11-29-0

Arrow Build Report for Job nightly-2019-11-29-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-11-29-0 Failed Tasks: - gandiva-jar-osx: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-11-29-0-travis-gandiva-jar-osx - test-debian-1

Re: Unions: storing type_ids or type_codes?

> Wes, is the intended usage of type_ids to allow a producer to pass a subset columns of unions without modifying the type codes? Yes On Tue, Nov 26, 2019 at 8:08 PM Fan Liya wrote: > > Hi Antoine, > > For Java, the physical child id is the same as the logical type code, as > the index of each c

[Discuss][Rust] Support for Dictionary Array types

I am noodling with the Dictionary implementation and would like to approve the data design and invite edits. Forgive my unfamiliarity with this mailing list. Given you current design, it would seem best to add a DataType of Dictionary with the two sub-types for the key and values. An array type

[jira] [Created] (ARROW-7279) [C++] Rename UnionArray::type_ids to UnionArray::type_codes

Antoine Pitrou created ARROW-7279: - Summary: [C++] Rename UnionArray::type_ids to UnionArray::type_codes Key: ARROW-7279 URL: https://issues.apache.org/jira/browse/ARROW-7279 Project: Apache Arrow