[jira] [Created] (ARROW-4155) [Rust] Implement array_ops::sum() for PrimitiveArray

2019-01-03 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4155: - Summary: [Rust] Implement array_ops::sum() for PrimitiveArray Key: ARROW-4155 URL: https://issues.apache.org/jira/browse/ARROW-4155 Project: Apache Arrow Issue Typ

Format specification document?

2019-01-03 Thread Kohei KaiGai
Hello, I'm now trying to understand the Apache Arrow format for my application. Is there a format specification document including meta-data layout? I checked out the description at: https://github.com/apache/arrow/tree/master/docs/source/format https://github.com/apache/arrow/tree/master/format

[jira] [Created] (ARROW-4154) [GLib] Add GArrowDecimal128DataType

2019-01-03 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-4154: --- Summary: [GLib] Add GArrowDecimal128DataType Key: ARROW-4154 URL: https://issues.apache.org/jira/browse/ARROW-4154 Project: Apache Arrow Issue Type: New Featur

Re: [Rust] crate versions and release process

2019-01-03 Thread Andy Grove
+1 from me. Keeping the code in a single repo makes sense but no need to artificially keep versions numbers consistent between the sub-crates. Andy. On Wed, Jan 2, 2019 at 10:28 PM Chao Sun wrote: > Hi, > > This is related to an earlier email I sent regarding separating the Rust > implementatio

[jira] [Created] (ARROW-4153) [GLib] Add builder_append_value() for consistency

2019-01-03 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-4153: --- Summary: [GLib] Add builder_append_value() for consistency Key: ARROW-4153 URL: https://issues.apache.org/jira/browse/ARROW-4153 Project: Apache Arrow Issue Ty

[jira] [Created] (ARROW-4152) [GLib] Remove an example to show Torch integration

2019-01-03 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-4152: --- Summary: [GLib] Remove an example to show Torch integration Key: ARROW-4152 URL: https://issues.apache.org/jira/browse/ARROW-4152 Project: Apache Arrow Issue T

Re: Move arrow-site.git to gitbox

2019-01-03 Thread Krisztián Szűcs
+1 On Thu, Jan 3, 2019 at 4:34 PM Wes McKinney wrote: > +1 > > On Thu, Jan 3, 2019, 9:22 AM Uwe L. Korn > > Hello, > > > > as requested per the mail from ASF infra, I would like to move the > > arrow-site git repo to gitbox. This is the repo used for the distribution > > of the rendered version

[jira] [Created] (ARROW-4151) [Rust] Restructure project directories

2019-01-03 Thread Chao Sun (JIRA)
Chao Sun created ARROW-4151: --- Summary: [Rust] Restructure project directories Key: ARROW-4151 URL: https://issues.apache.org/jira/browse/ARROW-4151 Project: Apache Arrow Issue Type: Task

Re: Enabling an installation path for Arrow R users

2019-01-03 Thread Wes McKinney
To have non-trivial R use, we have to get install.package working, which I think means integration with CRAN. There are a lot of logistical issues around build and packaging on each platform. It would be great to have a written summary of the best practices for each platform for getting bindings pl

Re: Please Remove me From List

2019-01-03 Thread Wes McKinney
You have to email dev-unsubscr...@arrow.apache.org to unsubscribe On Thu, Jan 3, 2019, 10:23 AM Moshik Hershcovitch Please remove me also > Moshik Hershcovitch > >

Re: Please Remove me From List

2019-01-03 Thread Moshik Hershcovitch
Please remove me also Moshik Hershcovitch

Please Remove me From List

2019-01-03 Thread Zack Reder
Thanks!

Re: Enabling an installation path for Arrow R users

2019-01-03 Thread Uwe L. Korn
We probably need to support both, conda-forge and CRAN. As a first shot, conda-forge will be much easier to setup as we should have a better build toolchain available there and this could also then be used in the multilanguage scenario demos really well. From my experience, the usage of conda in

[jira] [Created] (ARROW-4150) [C++] Buffer data should never be null

2019-01-03 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-4150: - Summary: [C++] Buffer data should never be null Key: ARROW-4150 URL: https://issues.apache.org/jira/browse/ARROW-4150 Project: Apache Arrow Issue Type: Wis

Re: Move arrow-site.git to gitbox

2019-01-03 Thread Wes McKinney
+1 On Thu, Jan 3, 2019, 9:22 AM Uwe L. Korn Hello, > > as requested per the mail from ASF infra, I would like to move the > arrow-site git repo to gitbox. This is the repo used for the distribution > of the rendered version of the website. Some +1s or a point why we should > consider alternatives

Move arrow-site.git to gitbox

2019-01-03 Thread Uwe L. Korn
Hello, as requested per the mail from ASF infra, I would like to move the arrow-site git repo to gitbox. This is the repo used for the distribution of the rendered version of the website. Some +1s or a point why we should consider alternatives would help to bring this forward. If there is conse

Re: Parallel processing

2019-01-03 Thread Antoine Pitrou
Hi Romain, No, it's better if you use the CPU thread pool directly (or through TaskGroup, if that suits your execution model better). Regards Antoine. Le 03/01/2019 à 14:29, Romain Francois a écrit : > Hello, > > Are the functions in parallel.h the de facto model for parallelisation in >

Re: Bison error when making thrift on macOS

2019-01-03 Thread Romain Francois
Thanks. I'll give that a go if/when I need to build thrift. Romain > Le 2 janv. 2019 à 17:07, Wes McKinney a écrit : > > You stumbled on https://issues.apache.org/jira/browse/PARQUET-1319. > See > https://github.com/apache/parquet-cpp/commit/d15d2687e9f154e69e956e2a56c8d1fd6c3b7ac8 > (which is

Parallel processing

2019-01-03 Thread Romain Francois
Hello, Are the functions in parallel.h the de facto model for parallelisation in arrow ? https://github.com/apache/arrow/blob/42cf69abfc1368c9884f4581811e2e7900c98fcd/cpp/src/arrow/util/parallel.h

[NOTICE] Mandatory migration of git repositories to gitbox.apache.org

2019-01-03 Thread Apache Infrastructure Team
Hello, arrow folks. As stated earlier in 2018, all git repositories must be migrated from the git-wip-us.apache.org URL to gitbox.apache.org, as the old service is being decommissioned. Your project is receiving this email because you still have repositories on git-wip-us that needs to be migrated.

Re: Enabling an installation path for Arrow R users

2019-01-03 Thread Jonathan Chiang
Hi, Long term, I believe getting an arrow package onto cran would be most useful for R users. Building arrow in R on Mac was easier than Linux for me. I was still having trouble installing after spending a couple hours or so. Typically if you can install.package from cran is most convenient

[jira] [Created] (ARROW-4149) [CI/C++] Parquet test misses ZSTD compression codec in CMake 3.2 nightly builds

2019-01-03 Thread Krisztian Szucs (JIRA)
Krisztian Szucs created ARROW-4149: -- Summary: [CI/C++] Parquet test misses ZSTD compression codec in CMake 3.2 nightly builds Key: ARROW-4149 URL: https://issues.apache.org/jira/browse/ARROW-4149 Pro

[jira] [Created] (ARROW-4148) [CI/Python] Disable ORC on nightly Alpine builds

2019-01-03 Thread Krisztian Szucs (JIRA)
Krisztian Szucs created ARROW-4148: -- Summary: [CI/Python] Disable ORC on nightly Alpine builds Key: ARROW-4148 URL: https://issues.apache.org/jira/browse/ARROW-4148 Project: Apache Arrow Iss

Re: Enabling an installation path for Arrow R users

2019-01-03 Thread Krisztián Szűcs
Perhaps an R conda-forge feedstock? I'm not sure how widely conda-forge is used in the R commmunity, but it already hosts around a thousand packages[1]. [1] https://github.com/conda-forge?&q=r- On Wed, Jan 2, 2019 at 6:09 PM Wes McKinney wrote: > hi folks, > > With 0.12 around the corner and si