Re: Does Apache Arrow have the concept of broadcasting?

2018-03-25 Thread Wes McKinney
Hi Andy, Broadcasting is really a computational concept rather than one related to memory representation / data structures -- we haven't developed significant computational libraries in Apache Arrow yet, but it is within scope for the project. In C++ I have anticipated adding an object model for

Does Apache Arrow have the concept of broadcasting?

2018-03-25 Thread Andy Grove
Numpy uses the concept of broadcasting to perform math operations on arrays of different sizes: https://docs.scipy.org/doc/numpy/user/basics.broadcasting.html A good example is multiplying an array by a single literal value or comparing an array to a single value. I'm in the process of converting

Re: Confronting Arrow packaging problems

2018-03-25 Thread Wes McKinney
@Kou, automated commits / PRs to trigger Appveyor/Travis CI are most likely part of the solution, but there are other issues. We should start a Google document or something to enumerate all the things we want to implement and identify the technical issues with each thing. For example, at present,

Re: Confronting Arrow packaging problems

2018-03-25 Thread Kouhei Sutou
Hi, How about creating a pull request to apache/arrow-dist with changes to use the latest apache/arrow? (A sample script exists at the end.) If the pull request is created, we can test packaging with the latest apache/arrow on Travis CI. If we add the following configuration to .travis.yml in apa

Re: Confronting Arrow packaging problems

2018-03-25 Thread Uwe L. Korn
Hello all, I strongly support Wes' points about having better automated feedback in our build chain is essential, independent from the tool we use to make the builds. As it sadly seems that our newly uploaded Arrow wheels for OSX are broken, I'm going to start there and add them to the build ma

[jira] [Created] (ARROW-2352) [C++/Python] Test OSX packaging in Travis matrix

2018-03-25 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-2352: -- Summary: [C++/Python] Test OSX packaging in Travis matrix Key: ARROW-2352 URL: https://issues.apache.org/jira/browse/ARROW-2352 Project: Apache Arrow Issue Type:

Re: Next Arrow sync call

2018-03-25 Thread Uwe L. Korn
Also works for me On Sat, Mar 24, 2018, at 1:34 AM, Bryan Cutler wrote: > Sounds good to me > > On Fri, Mar 23, 2018, 11:10 AM Li Jin wrote: > > > Works for me. Thanks! > > > > On Fri, Mar 23, 2018 at 2:03 PM, Wes McKinney wrote: > > > > > hi folks, > > > > > > With the USA DST transition, the