Re: C++ optimize stream output

2018-03-26 Thread Rares Vernica
Hi Wes, Thanks so much for the feedback. On Thu, Mar 15, 2018 at 5:38 PM, Wes McKinney wrote: > > Per ARROW-2189 -- do you get these problems if you build from source? > I'm trying to understand if this is a packaging issue or a code issue I plan to try building from source. I will update the i

[jira] [Created] (ARROW-2358) API for Writing to Multiple Feather Files

2018-03-26 Thread Dhruv Madeka (JIRA)
Dhruv Madeka created ARROW-2358: --- Summary: API for Writing to Multiple Feather Files Key: ARROW-2358 URL: https://issues.apache.org/jira/browse/ARROW-2358 Project: Apache Arrow Issue Type: New

[jira] [Created] (ARROW-2357) Benchmark PandasObjectIsNull

2018-03-26 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-2357: Summary: Benchmark PandasObjectIsNull Key: ARROW-2357 URL: https://issues.apache.org/jira/browse/ARROW-2357 Project: Apache Arrow Issue Type: Bug C

[jira] [Created] (ARROW-2356) [JS] JSON reader fails on FixedSizeBinary data buffer

2018-03-26 Thread Paul Taylor (JIRA)
Paul Taylor created ARROW-2356: -- Summary: [JS] JSON reader fails on FixedSizeBinary data buffer Key: ARROW-2356 URL: https://issues.apache.org/jira/browse/ARROW-2356 Project: Apache Arrow Issue

[jira] [Created] (ARROW-2355) [Python] Unable to import pyarrow [0.9.0]

2018-03-26 Thread Bradford W Littooy (JIRA)
Bradford W Littooy created ARROW-2355: - Summary: [Python] Unable to import pyarrow [0.9.0] Key: ARROW-2355 URL: https://issues.apache.org/jira/browse/ARROW-2355 Project: Apache Arrow Issu

Re: Confronting Arrow packaging problems

2018-03-26 Thread Phillip Cloud
On Mon, Mar 26, 2018 at 1:37 PM Wes McKinney wrote: > > Huge +1 on moving some of the packaging outside the scope of > responsibility of arrow dev, specifically I don't think we should be > responsible for anything except wheels and conda packages. > This is my ideal scenario, however unrealisti

Re: Confronting Arrow packaging problems

2018-03-26 Thread Wes McKinney
> Huge +1 on moving some of the packaging outside the scope of responsibility > of arrow dev, specifically I don't think we should be responsible for > anything except wheels and conda packages. In theory I agree, but until Apache Arrow grows popular enough and important enough for other communi

[jira] [Created] (ARROW-2354) [C++] PyDecimal_Check() is much too slow

2018-03-26 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-2354: - Summary: [C++] PyDecimal_Check() is much too slow Key: ARROW-2354 URL: https://issues.apache.org/jira/browse/ARROW-2354 Project: Apache Arrow Issue Type: B

[jira] [Created] (ARROW-2353) Test correctness of built wheel on AppVeyor

2018-03-26 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-2353: - Summary: Test correctness of built wheel on AppVeyor Key: ARROW-2353 URL: https://issues.apache.org/jira/browse/ARROW-2353 Project: Apache Arrow Issue Type

Re: Confronting Arrow packaging problems

2018-03-26 Thread Phillip Cloud
Responses inline. This kind of information is extremely helpful and informative. On Mon, Mar 26, 2018 at 11:26 AM Antoine Pitrou wrote: > > Hi, > > As someone who started contributing recently, I'd like to raise a few > points. I hope this post doesn't come accross as rambling or clueless, > ot

Re: Confronting Arrow packaging problems

2018-03-26 Thread Phillip Cloud
I've started a document on this issue here: https://docs.google.com/document/d/1IyhbQpiElxTsI8HbMZ-g9EGPOtcFdtMBzEyDJv48BKc/edit?usp=sharing On Sun, Mar 25, 2018 at 10:40 AM Wes McKinney wrote: > @Kou, automated commits / PRs to trigger Appveyor/Travis CI are most > likely part of the solution,

Re: Does Apache Arrow have the concept of broadcasting?

2018-03-26 Thread Andy Grove
Thanks. That makes sense. I have now refactored my code so that I have a compute layer above the arrow types and expressions. My expressions can now evaluate to arrays or scalars (which makes sense anyway if I want to compute array.len() and aggregate functions like min, max, which I haven't gotten

Re: Confronting Arrow packaging problems

2018-03-26 Thread Antoine Pitrou
Hi, As someone who started contributing recently, I'd like to raise a few points. I hope this post doesn't come accross as rambling or clueless, otherwise feel free to ignore / point it out :-) What does a release require? I didn't find any official documentation