Re: R/arrow update

2018-03-20 Thread Romain François
That sounds good. I’ll make a pull request of what I have once I have something useful in the readme. Things like build are not dealt with at the moment so it might be that this only works on macOS or even (don’t think so) only on my 💻. As long as it’s clearly established that this is wip and

Re: [RESULT] [VOTE] Release Apache Arrow 0.9.0 (RC2)

2018-03-20 Thread Wes McKinney
I haven't been able to draft a release blog post yet. We also have more packaging work to do. I suggest we announce Thursday morning and try to get the packaging completed -- we have conda-forge done as of right now, but pip and Java need to get uploaded. On Tue, Mar 20, 2018 at 2:58 AM, Siddharth

Re: R/arrow update

2018-03-20 Thread Wes McKinney
hi Romain, Cool! I would suggest that we proceed in one of two ways: * Start merging R patches to master (what I would prefer) * Merge patches into an r-devel branch while the R bindings initiative is in early stages I don't really see any benefits to hiding early-stage code in a branch; the REA

Re: Guidelines for use of Status and out parameters

2018-03-20 Thread Wes McKinney
Yes, the general guideline is to use Status (in C++ APIs) for exceptional behavior that is out of the control of the user of the C++ APIs. We have been trying to not use Status to make assertions that the developer has invoked the API correctly -- instead preconditions and other such checks should

Re: Guidelines for use of Status and out parameters

2018-03-20 Thread Uwe L. Korn
Hello, the general rule is: Use a Status as return value when you would throw an exception, otherwise return the value directly. In the case where a DCHECK is sufficient and no method is called that would return a Status, we should get rid of the Status return. For the AddField case it would be

[jira] [Created] (ARROW-2331) [Python] Fix indexing implementations

2018-03-20 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-2331: - Summary: [Python] Fix indexing implementations Key: ARROW-2331 URL: https://issues.apache.org/jira/browse/ARROW-2331 Project: Apache Arrow Issue Type: Bug

Re: [DISCUSS] Arrow 1.0 Compatibility Issues: Union and Interval

2018-03-20 Thread Paul Taylor
Jumping in b/c I did the JS Union implementations. I inferred the behavior from what I understood the C++ and Java to be doing, so I may have misunderstood how they should work. > To that end, we talked about > introducing a "single-primitive" (a.k.a. "javascript") union behavior that > would op

Re: [DISCUSS] Arrow 1.0 Compatibility Issues: Union and Interval

2018-03-20 Thread Jacques Nadeau
> > I may have missed something, but I'm not remembering either the points > re: JavaScript or decimals. My understanding is that we have been > discussing how to handle a union-of-complex-types -- the Union > implementation in Java does not support this. Could you clarify or > refer to prior maili

R/arrow update

2018-03-20 Thread Romain Francois
Hello, Today is Tuesday, so that's the day I work on porting arrow to R. This week, I've continued some of the work from last week, still following the steps of the python front end as documented here: https://arrow.apache.org/docs/python/data.html#type-metadata

[jira] [Created] (ARROW-2330) Optimize delta buffer creation with partially finishable array builders

2018-03-20 Thread Dimitri Vorona (JIRA)
Dimitri Vorona created ARROW-2330: - Summary: Optimize delta buffer creation with partially finishable array builders Key: ARROW-2330 URL: https://issues.apache.org/jira/browse/ARROW-2330 Project: Apac

Re: [DISCUSS] Arrow 1.0 Compatibility Issues: Union and Interval

2018-03-20 Thread Wes McKinney
hi Jacques, > - We have outstanding questions around union type. I think the main on is the > javascript type. Given the inability to support the desired behavior for > decimal type, I suggest we remove this capability before 1.0. I may have missed something, but I'm not remembering either the

Guidelines for use of Status and out parameters

2018-03-20 Thread Antoine Pitrou
Hello, I'm trying to understand when it is recommended to return a Status instance and use an out parameter for the result value, vs. when it is allowed to return the result value naturally. For instance we currently have the following methods on the Schema class: Status AddField(int i, const

[jira] [Created] (ARROW-2329) [Website]: 0.9.0 release update

2018-03-20 Thread Siddharth Teotia (JIRA)
Siddharth Teotia created ARROW-2329: --- Summary: [Website]: 0.9.0 release update Key: ARROW-2329 URL: https://issues.apache.org/jira/browse/ARROW-2329 Project: Apache Arrow Issue Type: Task