Re: [C++] output field names in Arrow Substrait

2022-04-20 Thread Phillip Cloud
consumer. If we'd want to > correctly represent those kinds of nodes anyway, we'd already be > dealing with an extension relation, to which we could attach whatever > information we want. > > On Wed, 20 Apr 2022 at 16:05, Phillip Cloud wrote: > > > A third alternativ

Re: [C++] output field names in Arrow Substrait

2022-04-20 Thread Phillip Cloud
A third alternative might be to adjust Arrow to move to field-index based execution instead of storing schemas in its relational operators. I suspect that deserializing the schema on the arrow side is the right solution in at least the near term. Repeating field names where they aren't strictly ne

Re: [JavaScript] Appending Nulls to a Struct (Bug)

2022-02-18 Thread Phillip Cloud
On Fri, Feb 18, 2022 at 3:44 PM Antoine Pitrou wrote: > > Le 18/02/2022 à 21:32, Phillip Cloud a écrit : > > > > I am really struggling to see how anything I've said is inconsistent with > > the spec or what you are saying here. > > > > To recap wh

Re: [JavaScript] Appending Nulls to a Struct (Bug)

2022-02-18 Thread Phillip Cloud
On Fri, Feb 18, 2022 at 2:32 PM Antoine Pitrou wrote: > > Le 18/02/2022 à 20:26, Phillip Cloud a écrit : > > On Fri, Feb 18, 2022 at 2:06 PM Antoine Pitrou > wrote: > > > >> Le 18/02/2022 à 20:01, Phillip Cloud a écrit : > >>> I think I'm confused

Re: [JavaScript] Appending Nulls to a Struct (Bug)

2022-02-18 Thread Phillip Cloud
On Fri, Feb 18, 2022 at 2:06 PM Antoine Pitrou wrote: > > Le 18/02/2022 à 20:01, Phillip Cloud a écrit : > > I think I'm confused by where this appended value lives. Is it only a > > logical value or does the value show up in memory? > > The logical value is null.

Re: [JavaScript] Appending Nulls to a Struct (Bug)

2022-02-18 Thread Phillip Cloud
ength of the > struct is equal to the length of all of its children. > > -Micah > > On Fri, Feb 18, 2022 at 10:39 AM Antoine Pitrou > wrote: > > > > > Le 18/02/2022 à 19:29, Phillip Cloud a écrit : > > > > > > The description underneath the exampl

Re: [JavaScript] Appending Nulls to a Struct (Bug)

2022-02-18 Thread Phillip Cloud
truct), an entire struct slot can be set to null via the validity bitmap. To me this suggests that appending a sentinel value to the values buffer for a field is allowed, but not required. Am I understanding this correctly? > > Best, > Jorge > > > On Fri, Feb 18, 2022 at 7:07 PM

Re: [JavaScript] Appending Nulls to a Struct (Bug)

2022-02-18 Thread Phillip Cloud
My read of the spec for structs [1] is that there is no requirement to have a value in child arrays where there are nulls, which suggests the implementation conforms to the spec here. The example emphasizes this by showing the VarBinary column data as "joemark" as opposed to something like "joemar

Re: [ANNOUNCE] New Arrow PMC member: QP Hou

2022-02-17 Thread Phillip Cloud
Congratulations!! On Thu, Feb 17, 2022 at 5:12 PM Neal Richardson wrote: > Congratulations! > > Neal > > On Thu, Feb 17, 2022 at 4:48 PM Rok Mihevc wrote: > > > Congrats QP! > > > > Rok > > > > On Thu, Feb 17, 2022 at 10:41 PM David Li wrote: > > > > > > Congrats QP! > > > > > > On Thu, Feb 17

Re: [DISCUSS] Binary Values in Key value pairs WAS: Re: [INFO_REQUEST][FLIGHT] - Dynamic schema changes in ArrowFlight streams

2022-02-09 Thread Phillip Cloud
I don't think memcpy is feasible. The bytes may be different for different languages. Many languages' compilers reorder struct fields and pad structs for efficiency reasons so the bytes in metadata coming from language X may be meaningless to language Y. On Wed, Feb 9, 2022, 08:41 Dewey Dunningt

Re: [CI] Fwd: dockerhub limitations - maximum user count reached

2022-01-22 Thread Phillip Cloud
+1 for using ghcr.io. It integrates well with GitHub (e.g., the packages feature) and is generally a better user experience than dockerhub. On Sat, Jan 22, 2022 at 6:27 AM Antoine Pitrou wrote: > > Le 22/01/2022 à 05:20, Sutou Kouhei a écrit : > > Hi, > > > > We use asfjenkins account on apache/

Re: [DISCUSS] Deprecate user@ in favor for github issues/discussions

2021-09-29 Thread Phillip Cloud
On Wed, Sep 29, 2021 at 3:08 PM Antoine Pitrou wrote: > > Le 29/09/2021 à 20:51, Micah Kornfield a écrit : > >> > >> Cons: > >> - Github is a not a mailing-list and does not integrate well in a normal > >> e-mail workflow. > > > > > > Would a mailing list mirror of the issues work for you (I gues

Re: [DISCUSS] Deprecate user@ in favor for github issues/discussions

2021-09-29 Thread Phillip Cloud
I am +1 on steering users towards GitHub issues for support questions. I think there's a lot of value in someone being able to use a search engine to potentially find an answer to their problem. On Wed, Sep 29, 2021 at 2:16 PM Micah Kornfield wrote: > We discussed briefly on the sync this mornin

Re: [JIRA] New "Compute IR" component

2021-09-27 Thread Phillip Cloud
Thanks Antoine. For future reference, can anyone add these labels? On Mon, Sep 27, 2021 at 7:39 AM Antoine Pitrou wrote: > > Hello, > > I've added a JIRA component called "Compute IR". Please use > accordingly for all compute IR-related issues. > > Regards > > Antoine. > > >

Temporal Arithmetic

2021-09-23 Thread Phillip Cloud
Hi all, I wanted to draw some attention to ARROW-11090 [1] in an effort to start getting the implementation going for temporal arithmetic kernels. The supported operation matrix is decently large. I would like to propose that we adopt the behavior of PostgreSQL where things are at first glance a

Re: [ANNOUNCE] New Arrow committer: Nic Crane

2021-09-09 Thread Phillip Cloud
Congrats and welcome! On Thu, Sep 9, 2021, 16:16 Matthew Topol wrote: > Congrats! > > -Original Message- > From: Krisztián Szűcs > Sent: Thursday, September 9, 2021 3:47 PM > To: dev@arrow.apache.org > Subject: Re: [ANNOUNCE] New Arrow committer: Nic Crane > > Congrats Nic! > > On 2021.

Re: [DISCUSS] Developing an "Arrow Compute IR [Intermediate Representation]" to decouple language front ends from Arrow-native compute engines

2021-09-01 Thread Phillip Cloud
t; value here as well. > > So what is the scope of this initiative? If it is just #1 for example > then I don't see any need to put types in the IR (and I've commented > as such in the PR). From a relational perspective isn't a UDF just a > black box Table -> U

Re: [DISCUSS] Developing an "Arrow Compute IR [Intermediate Representation]" to decouple language front ends from Arrow-native compute engines

2021-08-30 Thread Phillip Cloud
ple: it is a python > > >relational operation named X stored in Y that maintains properties > 1,2 > > > and > > >disrupts property 3. Putting just a black box of bytes will > > > substantially > > >reduce the compatibility and extensibili

Re: [DISCUSS] Developing an "Arrow Compute IR [Intermediate Representation]" to decouple language front ends from Arrow-native compute engines

2021-08-26 Thread Phillip Cloud
l serialization of query plans publically >available. > > > [1] > > https://github.com/apache/arrow/pull/10979/files#diff-e40fbc40cf7a131efd2cb098444931774cfad046b8665b38452258ffaa2e3423R34 > [2] > > https://github.com/apache/arrow/commit/611a4b951e24f4f967c3d

Re: [DISCUSS] Developing an "Arrow Compute IR [Intermediate Representation]" to decouple language front ends from Arrow-native compute engines

2021-08-17 Thread Phillip Cloud
n my original > prototype, but I now think that using an enum for "built-ins" would be > superior (because of the code-generated enum interface) and not a > premature optimization. > > [1]: https://github.com/apache/arrow/pull/10934 > > On Fri, Aug 13, 2021 at 11:26 P

Re: [DISCUSS] Developing an "Arrow Compute IR [Intermediate Representation]" to decouple language front ends from Arrow-native compute engines

2021-08-13 Thread Phillip Cloud
sequences of batches. > > Elsethread, someone mentioned the LoLePop concept and the Kohn/Leis/Neuman > paper [1]. The LoLePop concept sounds good for our purposes. > > Julian > > [1] https://db.in.tum.de/~kohn/papers/lolepops-sigmod21.pdf > > > > On Aug 12, 20

Re: [DISCUSS] Splitting out the Arrow format directory

2021-08-13 Thread Phillip Cloud
> (or at least part of one). > > > > On Fri, Aug 13, 2021 at 6:46 AM Jacob Quinn > > wrote: > > > > > > > > > > > I just thought of one other requirement: the format needs to support > > > > arbitrary byte sequences. > > > &g

Re: [DISCUSS] Splitting out the Arrow format directory

2021-08-13 Thread Phillip Cloud
On Fri, Aug 13, 2021 at 11:43 AM Antoine Pitrou wrote: > > Le 13/08/2021 à 17:35, Phillip Cloud a écrit : > > > >> I.e. make the ability to read and write by humans be more important than > >> speed of validation. > > > > I think I differ on whether

Re: [DISCUSS] Splitting out the Arrow format directory

2021-08-13 Thread Phillip Cloud
ovide something like a capital-S Stream where the bytes are consumed asynchronously. Is that what you're after here? > E.g. thrift does not offer async -> parquet-format-rs does not offer async > -> parquet does not offer async -> datafusion wraps all parquet "IO-bo

Re: [DISCUSS] Splitting out the Arrow format directory

2021-08-12 Thread Phillip Cloud
hu, Aug 12, 2021 at 2:05 PM Andrew Lamb > > wrote: > > >> > > >> I support the idea of an independent repo that has the arrow > flatbuffers > > >> format definition files. > > >> > > >> My rationale is that the Rust implementation has a

Re: [DISCUSS] Splitting out the Arrow format directory

2021-08-12 Thread Phillip Cloud
buffers > > format definition files. > > > > My rationale is that the Rust implementation has a copy of the `format` > > directory [1] and potential drift worries me (a bit). Having a single > > source of truth for the format that is not part of the large mono repo

Re: [DISCUSS] Splitting out the Arrow format directory

2021-08-11 Thread Phillip Cloud
ered that point of view, but I think you're right that specs, regardless of wire format should remain together. > On Wed, Aug 11, 2021 at 11:34 AM Antoine Pitrou > wrote: > > > > > > Le 11/08/2021 à 23:06, Phillip Cloud a écrit : > > > On Wed, Aug 11, 2021 at

Re: [DISCUSS] Developing an "Arrow Compute IR [Intermediate Representation]" to decouple language front ends from Arrow-native compute engines

2021-08-11 Thread Phillip Cloud
a consumer, and it's up to the consumer to figure out how to turn that count into something that makes sense for itself. In your example that's a series of partial counts followed by a sum. > > > > > > On Wed, Aug 11, 2021 at 6:10 PM Phillip Cloud wrote: > > > T

Re: [DISCUSS] Splitting out the Arrow format directory

2021-08-11 Thread Phillip Cloud
er that means for the specific language) their library code. End users of, say, ibis never need to think about having flatc around. > > On Wed, Aug 11, 2021, at 16:16, Phillip Cloud wrote: > > On Wed, Aug 11, 2021 at 4:05 PM Antoine Pitrou > wrote: > > > > > > &

Re: [DISCUSS] Splitting out the Arrow format directory

2021-08-11 Thread Phillip Cloud
On Wed, Aug 11, 2021 at 4:22 PM Antoine Pitrou wrote: > > Le 11/08/2021 à 22:16, Phillip Cloud a écrit : > > > > Yeah, that is a drawback here, though I don't see needing to run flatc > as a > > major downside given the upside > > of not having to write a

Re: [DISCUSS] Splitting out the Arrow format directory

2021-08-11 Thread Phillip Cloud
On Wed, Aug 11, 2021 at 4:05 PM Antoine Pitrou wrote: > > Le 11/08/2021 à 22:02, Phillip Cloud a écrit : > > On Wed, Aug 11, 2021 at 3:58 PM Antoine Pitrou > wrote: > > > >> > >> Le 11/08/2021 à 21:56, Phillip Cloud a écrit : > >>> I can see

Re: [DISCUSS] Splitting out the Arrow format directory

2021-08-11 Thread Phillip Cloud
On Wed, Aug 11, 2021 at 3:58 PM Antoine Pitrou wrote: > > Le 11/08/2021 à 21:56, Phillip Cloud a écrit : > > I can see how that might be a bit circular. Let me start from the > > perspective of requirements. We want to be able to reuse the arrow's > types > > and

Re: [DISCUSS] Splitting out the Arrow format directory

2021-08-11 Thread Phillip Cloud
as an option. On Wed, Aug 11, 2021 at 3:52 PM Phillip Cloud wrote: > On Wed, Aug 11, 2021 at 3:51 PM Antoine Pitrou wrote: > >> >> >> Le 11/08/2021 à 21:39, Phillip Cloud a écrit : >> > The benefit is that IR components don't interact much wit

Re: [DISCUSS] Splitting out the Arrow format directory

2021-08-11 Thread Phillip Cloud
On Wed, Aug 11, 2021 at 3:51 PM Antoine Pitrou wrote: > > > Le 11/08/2021 à 21:39, Phillip Cloud a écrit : > > The benefit is that IR components don't interact much with `flatbuffers` > or > > `flatc` directly. > > > [...] > > > > One counter-pro

[DISCUSS] Splitting out the Arrow format directory

2021-08-11 Thread Phillip Cloud
Hi all, I'd like to bring up an idea from a recent thread ([1]) about moving the `format/` directory out of the primary apache/arrow repository. I understand from that thread there are some concerns about using submodules, and I definitely sympathize with those concerns. In talking with David Li

Re: [DISCUSS] Developing an "Arrow Compute IR [Intermediate Representation]" to decouple language front ends from Arrow-native compute engines

2021-08-11 Thread Phillip Cloud
; will get to it as quickly as I can. I will be at VLDB in Copenhagen > next week if anyone would like to chat in person about it, and we can > relay the content of any discussions back to the document/PR/e-mail > thread. > > I know that Phillip Cloud expressed interest in working on

Re: [VOTE] Accept donation of Rust Parquet implementation

2018-12-01 Thread Phillip Cloud
+1 from me. On Sat, Dec 1, 2018, 06:24 Uwe L. Korn +1, nice to see this joining the Apache community > > Uwe > > > Am 01.12.2018 um 10:16 schrieb Antoine Pitrou : > > > > > >> Le 01/12/2018 à 00:50, Wes McKinney a écrit : > >> > >> This vote is to determine if the Arrow PMC is in favor of accepti

Re: [ANNOUNCE] New Arrow PMC member: Krisztián Szűcs

2018-11-10 Thread Phillip Cloud
Huzzah! Welcome! On Fri, Nov 9, 2018, 23:39 Srinivas Reddy wrote: > Congratulations Krisztián.. > > > > -- > Srinivas Reddy > > http://mrsrinivas.com/ > > > (Sent via gmail web) > > > On Fri, 9 Nov 2018 at 03:48, Wes McKinney wrote: > > > The Project Management Committee (PMC) for Apache Arrow

Re: Assign/update : NA bitmap vs sentinel

2018-11-09 Thread Phillip Cloud
a > bitmap is present, there would be more code needed to deal with the NAs > (either way: including the NA group or excluding the NA group), if I > understand correctly. > > On Thu, Nov 8, 2018 at 3:18 PM Phillip Cloud wrote: > > > There is one database that I'm aw

Re: Assign/update : NA bitmap vs sentinel

2018-11-08 Thread Phillip Cloud
There is one database that I'm aware of that uses sentinels _and_ supports complex types with missing values: Kx's KDB+. This has led to some seriously strange choices like the ASCII space character being used as the sentinel value for strings. See https://code.kx.com/wiki/Reference/Datatypes for m

Re: [VOTE] Accept donation of Arrow C# .NET implementation

2018-10-15 Thread Phillip Cloud
+1 On Mon, Oct 15, 2018 at 9:33 PM Kouhei Sutou wrote: > +1 > > In > "[VOTE] Accept donation of Arrow C# .NET implementation" on Mon, 15 Oct > 2018 11:27:59 -0400, > Wes McKinney wrote: > > > hi folks, > > > > Individuals from Feyen Zylstra LLC have developed a C# implementation > > of Apa

Re: Apache Arrow .NET implementation

2018-10-11 Thread Phillip Cloud
+1. I agree that .NET + Arrow is a good match. Generally speaking, I'm not sure there are many systems programming languages whose communities wouldn't benefit from an Arrow implementation. I do think it's worth discussing what to do about the growing numbers of implementations, but that shouldn't

Re: [VOTE] Accept donation of C GLib bindings to Parquet C++ libraries

2018-09-25 Thread Phillip Cloud
+1, nice work. On Tue, Sep 25, 2018 at 10:53 AM Krisztián Szűcs wrote: > +1 > > On Sep 25 2018, at 1:36 pm, Wes McKinney wrote: > > > > hello, > > Kouhei Sutou is proposing to donate C GLib bindings to the Parquet C++ > > libraries (which can read Arrow tables back), designed to work > > togeth

Re: Arrow Sync

2018-08-22 Thread Phillip Cloud
I won't be able to make the call today, I have a conflict. On Wed, Aug 22, 2018 at 11:04 AM Wes McKinney wrote: > No worries. It's 12pm Eastern today at > https://meet.google.com/vtm-teks-phx > > On Wed, Aug 22, 2018 at 10:56 AM, Siddharth Teotia > wrote: > > I have a clash this morning so won'

Re: [VOTE] Combining Arrow C++ development process with Apache Parquet C++

2018-08-21 Thread Phillip Cloud
+1 On Tue, Aug 21, 2018 at 6:26 PM Jacques Nadeau wrote: > +1 > > > > On Tue, Aug 21, 2018 at 3:21 PM Philipp Moritz wrote: > > > +1 for the monorepo plan and push access to Parquet C++ committers > > > > -- Philipp. > > > > On Tue, Aug 21, 2018 at 3:12 PM, Antoine Pitrou > > wrote: > > > > >

Re: [ANNOUNCE] New Arrow PMC member: Antoine Pitrou

2018-08-21 Thread Phillip Cloud
Welcome! Great to have you on the team! On Tue, Aug 21, 2018 at 4:27 PM Wes McKinney wrote: > The Project Management Committee (PMC) for Apache Arrow has invited > Antoine Pitrou to become a PMC member and we are pleased to announce > that he has accepted. > > Congratulations and welcome, Antoin

Re: [VOTE] Accept donation of Gandiva to Apache Arrow

2018-08-16 Thread Phillip Cloud
+1 On Thu, Aug 16, 2018 at 9:26 PM Andy Grove wrote: > +1 > > On Thu, Aug 16, 2018 at 9:56 AM Wes McKinney wrote: > > > Dear all, > > > > The developers of Gandiva, an LLVM-based vectorized expression > > evaluation engine for Arrow columnar memory, are proposing to donate > > the project to Ap

[jira] [Created] (ARROW-3054) [Packaging] Deploy nightlies built using crossbow to the twosigma conda channel

2018-08-14 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-3054: Summary: [Packaging] Deploy nightlies built using crossbow to the twosigma conda channel Key: ARROW-3054 URL: https://issues.apache.org/jira/browse/ARROW-3054

Re: [ANNOUNCE] Apache Arrow 0.10.0 released

2018-08-07 Thread Phillip Cloud
he way, can we remove > https://dist.apache.org/repos/dist/release/arrow/arrow-0.9.0/ ? > > If we can do, can I try doing it? > > > Thanks, > -- > kou > > In > "[ANNOUNCE] Apache Arrow 0.10.0 released" on Tue, 7 Aug 2018 11:59:44 > -0400, > Phillip Cl

Re: [ANNOUNCE] Apache Arrow 0.10.0 released

2018-08-07 Thread Phillip Cloud
@Julian Sorry I misread your first comment. It looks like that's actually missing a link. The sha256/sha512 link is also wrong. On Tue, Aug 7, 2018 at 12:31 PM Phillip Cloud wrote: > @Julian > > First issue: the link should be to the sha256 checksum (we're not > comput

Re: [ANNOUNCE] Apache Arrow 0.10.0 released

2018-08-07 Thread Phillip Cloud
> it? Meanwhile the http://arrow.apache.org/release/0.10.0.html < > http://arrow.apache.org/release/0.10.0.html> has the source release but > no link to the checksums. > > Julian > > > > On Aug 7, 2018, at 9:16 AM, Phillip Cloud wrote: > > > > Congrats on the

Re: [ANNOUNCE] Apache Arrow 0.10.0 released

2018-08-07 Thread Phillip Cloud
Congrats on the release everyone, there was a ton of work that went into it! On Tue, Aug 7, 2018 at 12:10 PM Wes McKinney wrote: > Congrats all! > > On Tue, Aug 7, 2018 at 11:59 AM, Phillip Cloud wrote: > > The Apache Arrow community is pleased to announce the 0.10.0 > &g

[ANNOUNCE] Apache Arrow 0.10.0 released

2018-08-07 Thread Phillip Cloud
The Apache Arrow community is pleased to announce the 0.10.0 release. This is a major release including 470 resolved issues ([1]) since the 0.9.0 release. The release is available now from our website and [2]: http://arrow.apache.org/install/ Changelog http://arrow.apache.org/release/0.10

Re: [RESULT][VOTE] Release Apache Arrow 0.10.0 (RC1)

2018-08-06 Thread Phillip Cloud
separate issue is that I noticed Java doc is comment out from > dev/gen_apidocs/create_documents.sh > (probably due to Java8 lint-checks). I have uncommented it and it works. > (Opened ARROW-3003) > > On Mon, Aug 6, 2018 at 9:33 PM, Phillip Cloud wrote: > > > Excellent.

Re: [RESULT][VOTE] Release Apache Arrow 0.10.0 (RC1)

2018-08-06 Thread Phillip Cloud
https://pypi.org/project/pyarrow/#files > > On Mon, Aug 6, 2018 at 4:38 PM, Phillip Cloud wrote: > > > The release artifacts are uploaded to SVN. > > > > > > On Mon, Aug 6, 2018 at 4:01 PM Wes McKinney > wrote: > > > > We can comment out the JS do

Re: [RESULT][VOTE] Release Apache Arrow 0.10.0 (RC1)

2018-08-06 Thread Phillip Cloud
e-arrow > >> > >> npm ERR! There is likely additional logging output above. > >> > >> > >> npm ERR! Please include the following file with any support request: > >> > >> npm ERR! /apache-arrow/arrow/js/npm-debug.log > >> > >> &g

[RESULT][VOTE] Release Apache Arrow 0.10.0 (RC1)

2018-08-06 Thread Phillip Cloud
With 4 binding +1 votes (myself, Uwe, Wes, Kou), 2 non-binding +1 (Krisztián, Li), and no other votes, the vote passes. Thanks everyone! I will upload the Java packages as per the release management wiki. Would some folks please volunteer to get the Python packaging, documentation and website upd

Re: [VOTE] Release Apache Arrow 0.10.0 (RC1)

2018-08-05 Thread Phillip Cloud
Just updated the pip wheels section On Sat, Aug 4, 2018 at 4:52 PM Phillip Cloud wrote: > I've updated the "Main source release and vote" section. I will update the > section about uploading pip wheels etc tomorrow. > > On Sat, Aug 4, 2018 at 4:37 PM Phillip Cloud w

Re: [VOTE] Release Apache Arrow 0.10.0 (RC1)

2018-08-04 Thread Phillip Cloud
I've updated the "Main source release and vote" section. I will update the section about uploading pip wheels etc tomorrow. On Sat, Aug 4, 2018 at 4:37 PM Phillip Cloud wrote: > Thanks, the edit button is now available. > > On Sat, Aug 4, 2018 at 4:35 PM Wes McKinney

Re: [VOTE] Release Apache Arrow 0.10.0 (RC1)

2018-08-04 Thread Phillip Cloud
Thanks, the edit button is now available. On Sat, Aug 4, 2018 at 4:35 PM Wes McKinney wrote: > I just made you an admin (all PMCs should be admin on this space). I > turned on "Add" permission for pages for all confluence-users. > > On Sat, Aug 4, 2018 at 4:17 PM, Phill

Re: [VOTE] Release Apache Arrow 0.10.0 (RC1)

2018-08-04 Thread Phillip Cloud
t; >> On Fri, Aug 3, 2018, at 5:45 PM, Li Jin wrote: > >> > +1 > >> > > >> > ran ./dev/release/verify-release-candidate.sh on MacOS > >> > * Java 8 > >> > * clang-902.0.39.2 > >> > > >> > On Fri, Aug 3, 2018

Re: [VOTE] Release Apache Arrow 0.10.0 (RC1)

2018-08-03 Thread Phillip Cloud
That should say "2nd" release candidate by the way. Apologies. On Fri, Aug 3, 2018 at 11:29 AM Phillip Cloud wrote: > +1 (binding) > > ran ./dev/release/verify-release-candidate.sh 0.10.0 1 > > * Arch Linux > * java8 > * ruby 2.5.1p57 > * python3.6 > * cl

Re: [VOTE] Release Apache Arrow 0.10.0 (RC1)

2018-08-03 Thread Phillip Cloud
+1 (binding) ran ./dev/release/verify-release-candidate.sh 0.10.0 1 * Arch Linux * java8 * ruby 2.5.1p57 * python3.6 * clang 6.0.0 * node v10.5.0 On Fri, Aug 3, 2018 at 10:55 AM Phillip Cloud wrote: > Hello all, > > I'd like to propose the 1st release candidate (rc1) of Apache

[VOTE] Release Apache Arrow 0.10.0 (RC1)

2018-08-03 Thread Phillip Cloud
Hello all, I'd like to propose the 1st release candidate (rc1) of Apache Arrow version 0.10.0. rc0 was invalidated because of ARROW-2963, the fix for which is incorporated into rc1. This release candidate is distinct from previous releases in that it includes binary artifacts such as python wheel

Re: [VOTE] Release Apache Arrow 0.10.0 (RC0)

2018-08-03 Thread Phillip Cloud
, and a behavior / feature that was just > >implicitly assumed to exist (fork stability). So the regression kinda > >"normal". > >> > >> Marco > >> > >> On August 2, 2018 8:40:05 PM GMT+02:00, Phillip Cloud > > wrote: > >>>

Re: [VOTE] Release Apache Arrow 0.10.0 (RC0)

2018-08-02 Thread Phillip Cloud
Marco, what would be even better is if you would test your application against Antoine's PR before it gets merged. On Thu, Aug 2, 2018 at 2:37 PM Phillip Cloud wrote: > I'll cut another one. Can someone review Antoine's PR, like ASAP, so that > I can cut another RC? > &g

Re: [VOTE] Release Apache Arrow 0.10.0 (RC0)

2018-08-02 Thread Phillip Cloud
I'll cut another one. Can someone review Antoine's PR, like ASAP, so that I can cut another RC? On Thu, Aug 2, 2018 at 2:32 PM Wes McKinney wrote: > -1 > > It's up to Phillip whether he wants to cancel the RC, but note that > releases cannot be vetoed. > > @Marco, thanks for reporting -- is ther

Re: [VOTE] Release Apache Arrow 0.10.0 (RC0)

2018-08-01 Thread Phillip Cloud
+1 (binding) ran dev/release/verify-release-candidate.sh on Arch Linux * clang 6 * jdk8 * ruby 2.5.1p57 * nodejs v10.5.0 -Phillip On Wed, Aug 1, 2018 at 1:35 PM Phillip Cloud wrote: > Hello all, > > I'd like to propose the 1st release candidate (rc0) of Apache Arrow version >

[VOTE] Release Apache Arrow 0.10.0 (RC0)

2018-08-01 Thread Phillip Cloud
Hello all, I'd like to propose the 1st release candidate (rc0) of Apache Arrow version 0.10.0. This is a major release consisting of 454 resolved JIRAs [1]. This release candidate is distinct from previous releases in that it includes binary artifacts such as python wheels, conda packages, and va

[jira] [Created] (ARROW-2961) [C++] Deprecated APIs in parquet-cpp cause pyarrow build failures

2018-08-01 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2961: Summary: [C++] Deprecated APIs in parquet-cpp cause pyarrow build failures Key: ARROW-2961 URL: https://issues.apache.org/jira/browse/ARROW-2961 Project: Apache

[jira] [Created] (ARROW-2960) [Packaging] Fix verify-release-candidate for binary packages and fix release cutting script for lib64 cmake issue

2018-08-01 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2960: Summary: [Packaging] Fix verify-release-candidate for binary packages and fix release cutting script for lib64 cmake issue Key: ARROW-2960 URL: https://issues.apache.org/jira

[jira] [Created] (ARROW-2959) Dockerize verify-release-candidate.{sh,bat}

2018-08-01 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2959: Summary: Dockerize verify-release-candidate.{sh,bat} Key: ARROW-2959 URL: https://issues.apache.org/jira/browse/ARROW-2959 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-2958) Flatbuffers EP fails to compile with GCC 8.1

2018-08-01 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2958: Summary: Flatbuffers EP fails to compile with GCC 8.1 Key: ARROW-2958 URL: https://issues.apache.org/jira/browse/ARROW-2958 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-2942) [Packaging] Allow a user to inspect the status of another user's builds

2018-07-30 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2942: Summary: [Packaging] Allow a user to inspect the status of another user's builds Key: ARROW-2942 URL: https://issues.apache.org/jira/browse/ARROW-2942 Pr

[jira] [Created] (ARROW-2941) [Packaging] Allow a user to kill existing builds

2018-07-30 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2941: Summary: [Packaging] Allow a user to kill existing builds Key: ARROW-2941 URL: https://issues.apache.org/jira/browse/ARROW-2941 Project: Apache Arrow Issue

Re: Working towards 0.10.0 release candidate

2018-07-30 Thread Phillip Cloud
ROW-2937 > https://github.com/apache/arrow/pull/2340 that would be helpful. I > think this is the last code-related patch outstanding > > Thank you, > Wes > > On Mon, Jul 30, 2018 at 9:38 AM, Phillip Cloud wrote: > > Wanted to update everyone here regarding the ability to c

Re: Working towards 0.10.0 release candidate

2018-07-30 Thread Phillip Cloud
Wanted to update everyone here regarding the ability to cut a release candidate for 0.10.0. The last remaining set of tasks is to be able to use the new packaging tool (crossbow.py) to build binary artifacts from a source archive. What this means is that we'll have to move the release scripts into

[jira] [Created] (ARROW-2935) [Packaging] Add verify_binary_artifacts function to verify-release-candidate.sh

2018-07-29 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2935: Summary: [Packaging] Add verify_binary_artifacts function to verify-release-candidate.sh Key: ARROW-2935 URL: https://issues.apache.org/jira/browse/ARROW-2935

[jira] [Created] (ARROW-2934) [Packaging] Add checksums creation to sign subcommand

2018-07-29 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2934: Summary: [Packaging] Add checksums creation to sign subcommand Key: ARROW-2934 URL: https://issues.apache.org/jira/browse/ARROW-2934 Project: Apache Arrow

[jira] [Created] (ARROW-2933) [Packaging] Add a tail subcommand to crossbow to tail the build logs of pending tasks

2018-07-28 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2933: Summary: [Packaging] Add a tail subcommand to crossbow to tail the build logs of pending tasks Key: ARROW-2933 URL: https://issues.apache.org/jira/browse/ARROW-2933

[jira] [Created] (ARROW-2932) [Packaging] crossbow status should output shortened log URLs

2018-07-28 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2932: Summary: [Packaging] crossbow status should output shortened log URLs Key: ARROW-2932 URL: https://issues.apache.org/jira/browse/ARROW-2932 Project: Apache Arrow

[jira] [Created] (ARROW-2931) [Packaging] Windows crossbow builds are attempting to run linux and osx packaging tasks

2018-07-28 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2931: Summary: [Packaging] Windows crossbow builds are attempting to run linux and osx packaging tasks Key: ARROW-2931 URL: https://issues.apache.org/jira/browse/ARROW-2931

[jira] [Created] (ARROW-2929) ARROW-2826 Breaks parquet-cpp 1.4.0 builds

2018-07-28 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2929: Summary: ARROW-2826 Breaks parquet-cpp 1.4.0 builds Key: ARROW-2929 URL: https://issues.apache.org/jira/browse/ARROW-2929 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-2928) [Packaging] AppVeyor crossbow conda builds are picking up boost 1.63.0 instead of the installed version

2018-07-28 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2928: Summary: [Packaging] AppVeyor crossbow conda builds are picking up boost 1.63.0 instead of the installed version Key: ARROW-2928 URL: https://issues.apache.org/jira/browse/ARROW

[jira] [Created] (ARROW-2927) [Packaging] AppVeyor wheel task is failing on initial checkout

2018-07-28 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2927: Summary: [Packaging] AppVeyor wheel task is failing on initial checkout Key: ARROW-2927 URL: https://issues.apache.org/jira/browse/ARROW-2927 Project: Apache Arrow

[jira] [Created] (ARROW-2924) [Java] mvn release fails with an older maven javadoc plugin is installed

2018-07-27 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2924: Summary: [Java] mvn release fails with an older maven javadoc plugin is installed Key: ARROW-2924 URL: https://issues.apache.org/jira/browse/ARROW-2924 Project

RC Cutting

2018-07-25 Thread Phillip Cloud
I'm think I'm still a bit confused about the order in which things need to happen to cut a release candidate. My understanding is that the ordering is: 1. create the source release 2. build packages from the source release (wheels, conda packages, etc) 3. commit source release + binary packages a

Re: [DISCUSS] Contribution of Gandiva to Apache Arrow

2018-07-24 Thread Phillip Cloud
While I'm not a level 83 LLVM wizard like Antoine :) I have a small amount of experience with it and would also be happy to review/merge patches. Having Gandiva in arrow will simplify packaging and building the library, which IME has always been annoying with large cross-platform and cross-languag

Re: Working towards 0.10.0 release candidate

2018-07-24 Thread Phillip Cloud
That sounds great to me. I'll make sure I'm able to build and sign artifacts this week and surface any issues I find along the way. Looking forward to a smooth release! On Tue, Jul 24, 2018 at 11:24 AM Wes McKinney wrote: > hi folks, > > Tuesday's update: it looks like we're going to be able to

[jira] [Created] (ARROW-2874) [Packaging] Forgot to pass job prefix

2018-07-18 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2874: Summary: [Packaging] Forgot to pass job prefix Key: ARROW-2874 URL: https://issues.apache.org/jira/browse/ARROW-2874 Project: Apache Arrow Issue Type: Task

Re: Need a release manager for Arrow 0.10.0 [was Re: Packaging status update]

2018-07-18 Thread Phillip Cloud
I can certainly help with the release vote. I'm out of town from the 20th to the 23rd, so it would be after that. Is there a particular target date we have in mind? On Wed, Jul 18, 2018 at 12:24 PM Wes McKinney wrote: > hi Li, > > Thanks for volunteering -- we need a PMC to sign the source and b

[jira] [Created] (ARROW-2858) Add unit tests for crossbow

2018-07-16 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2858: Summary: Add unit tests for crossbow Key: ARROW-2858 URL: https://issues.apache.org/jira/browse/ARROW-2858 Project: Apache Arrow Issue Type: Task

Re: [VOTE] Close down Arrow Slack channel

2018-07-09 Thread Phillip Cloud
+1 On Mon, Jul 9, 2018 at 2:47 PM Wes McKinney wrote: > hi Paul -- I would suggest operating an unofficial channel for > real-time discussions that don't necessarily concern the project > roadmap and governance of the Arrow project. > > The basic problems with Slack are, to summarize our mailing

[jira] [Created] (ARROW-2783) Importing conda-forge pyarrow fails

2018-07-02 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2783: Summary: Importing conda-forge pyarrow fails Key: ARROW-2783 URL: https://issues.apache.org/jira/browse/ARROW-2783 Project: Apache Arrow Issue Type: Task

Re: Arrow sync at 12pm Eastern today

2018-06-27 Thread Phillip Cloud
I won't be able to make it today. On Wed, Jun 27, 2018 at 10:48 AM Wes McKinney wrote: > https://meet.google.com/vtm-teks-phx >

Re: Gandiva Initiative

2018-06-24 Thread Phillip Cloud
This is super exciting. In particular, I think for ibis ( http://docs.ibis-project.org/) building up expressions and executing them using gandiva would fit nicely as another in-memory backend alongside the pandas backend. I think it would also drive some use cases forward for more complex datatype

Re: [DISCUSS] Concerns about the Arrow Slack channel

2018-06-21 Thread Phillip Cloud
Dhruv, I'm curious why the dev mailing list is considered intrusive. Can you expand a bit on that? I've always thought of mailing lists to be *the* place where people go to ask questions about a project in a way that is open to all. They are also archived and organized in some way that makes it ea

[jira] [Created] (ARROW-2720) [C++] Clean up cmake CXX_STANDARD and PIC flag setting

2018-06-18 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2720: Summary: [C++] Clean up cmake CXX_STANDARD and PIC flag setting Key: ARROW-2720 URL: https://issues.apache.org/jira/browse/ARROW-2720 Project: Apache Arrow

[jira] [Created] (ARROW-2648) [Packaging] Follow up packaging tasks

2018-05-30 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2648: Summary: [Packaging] Follow up packaging tasks Key: ARROW-2648 URL: https://issues.apache.org/jira/browse/ARROW-2648 Project: Apache Arrow Issue Type: Task

Re: Arrow sync at 12pm EDT today

2018-05-16 Thread Phillip Cloud
Meeting notes from the call: Attendees/Topics to discuss - Wes - Packaging - Uwe - Packaging - Simba - Li Two Sigma - Ethan Two Sigma - Josh Two Sigma - Exceptions vs status codes - Class design question

  1   2   3   >