Re: Distributing Arrow in Debian and Fedora

2019-02-09 Thread Wes McKinney
Note that there are already JIRA issues about introducing a dynamic linking option in several dependencies * Thrift https://issues.apache.org/jira/browse/ARROW-4447 * re2 https://issues.apache.org/jira/browse/ARROW-3435 * Compression libs (zstd, snappy, bz2, brotli, lz4) https://issues.apache.org/

Re: Distributing Arrow in Debian and Fedora

2019-02-08 Thread Uwe L. Korn
On Fri, Feb 8, 2019, at 10:49 PM, Todd Rme wrote: > On Fri, Feb 8, 2019 at 2:20 PM Uwe L. Korn wrote: > > > > Hello all, > > > > On Fri, Feb 8, 2019, at 8:02 PM, Suvayu Ali wrote: > > > Hello Todd, > > > > > > On Fri, Feb 08, 2019 at 11:41:05AM -0500, Todd Rme wrote: > > > > On 2019/02/02 10:00

Re: Distributing Arrow in Debian and Fedora

2019-02-08 Thread Todd Rme
On Fri, Feb 8, 2019 at 2:20 PM Uwe L. Korn wrote: > > Hello all, > > On Fri, Feb 8, 2019, at 8:02 PM, Suvayu Ali wrote: > > Hello Todd, > > > > On Fri, Feb 08, 2019 at 11:41:05AM -0500, Todd Rme wrote: > > > On 2019/02/02 10:00:37, Suvayu Ali wrote: > > > > > > > 1. Fedora doesn't allow including

Re: Distributing Arrow in Debian and Fedora

2019-02-08 Thread Todd Rme
On Fri, Feb 8, 2019 at 2:08 PM Suvayu Ali wrote: > > Hello Todd, > > On Fri, Feb 08, 2019 at 11:41:05AM -0500, Todd Rme wrote: > > On 2019/02/02 10:00:37, Suvayu Ali wrote: > > > > > 1. Fedora doesn't allow including external dependencies. In my > > > experience> > > >building arrow on Fedo

Re: Distributing Arrow in Debian and Fedora

2019-02-08 Thread Antoine Pitrou
Le 08/02/2019 à 20:20, Uwe L. Korn a écrit : > > We should be able to link all libraries dynamically. At the moment there may > be some that can only be linked statically in our build but that should not > be hard to change. I think plasma_store_server links statically with libplasma and liba

Re: Distributing Arrow in Debian and Fedora

2019-02-08 Thread Uwe L. Korn
Hello all, On Fri, Feb 8, 2019, at 8:02 PM, Suvayu Ali wrote: > Hello Todd, > > On Fri, Feb 08, 2019 at 11:41:05AM -0500, Todd Rme wrote: > > On 2019/02/02 10:00:37, Suvayu Ali wrote: > > > > > 1. Fedora doesn't allow including external dependencies. In my > > > experience> > > >building

Re: Distributing Arrow in Debian and Fedora

2019-02-08 Thread Suvayu Ali
Hello Todd, On Fri, Feb 08, 2019 at 11:41:05AM -0500, Todd Rme wrote: > On 2019/02/02 10:00:37, Suvayu Ali wrote: > > > 1. Fedora doesn't allow including external dependencies. In my experience> > >building arrow on Fedora, the way external deps like Protobuf, Thrift, > > RE2,> > >etc

Re: Distributing Arrow in Debian and Fedora

2019-02-08 Thread Todd Rme
On 2019/02/02 10:00:37, Suvayu Ali wrote: > Hello Javier,> > > On Fri, Feb 01, 2019 at 06:51:34PM -0800, Javier Luraschi wrote:> > > Hi, in order to make Arrow available to the R community through CRAN (R's> > > package archive), we need to get the Arrow binaries submitted to the Debian> > >

Re: Distributing Arrow in Debian and Fedora

2019-02-06 Thread Kouhei Sutou
k as much as possible. (I'm busy until the end of April for work and RubyKaigi 2019.) > Is there anything we can do to help? I listed items what we need to work. Thanks, -- kou In "Re: Distributing Arrow in Debian and Fedora" on Wed, 6 Feb 2019 12:50:24 -0800, Javie

Re: Distributing Arrow in Debian and Fedora

2019-02-06 Thread Javier Luraschi
Kou, would you be interested in taking the task of submitting to Debian and Fedora the arrow library? It would be ideal since it seems like you have a clear understanding of what needs to be done. Is there a timeline you would want to follow? Is there anything we can do to help? On Wed, Feb 6, 201

Re: Distributing Arrow in Debian and Fedora

2019-02-06 Thread Jeroen Ooms
On Sat, Feb 2, 2019 at 10:29 PM Kouhei Sutou wrote: > We need to consider how to update package versions. > We'll release Apache Arrow more frequency than Debian and > Fedora. If we don't update packages on Debian and Fedora, > they will ship old Apache Arrow. I think it's initially fine to uploa

Re: Distributing Arrow in Debian and Fedora

2019-02-05 Thread Wes McKinney
I commented on ARROW-4383. I think it would be ideal to use the installed .cmake files if they exist, but since some packages have non-CMake build systems we can't always assume that they'll be there. We need to support the ones that do, though On Sun, Feb 3, 2019 at 12:27 AM Suvayu Ali wrote: >

Re: Distributing Arrow in Debian and Fedora

2019-02-02 Thread Suvayu Ali
Hi Javier, On Sat, Feb 02, 2019 at 11:52:10AM -0800, Javier Luraschi wrote: > Thanks for the additional info, it's really helpful to hear your thoughts > and potential > issues we might need to resolve. > > The R package is planning to support feature flags, so a start, I'm hoping > we can > supp

Re: Distributing Arrow in Debian and Fedora

2019-02-02 Thread Kouhei Sutou
need to run rpmlint and resolve warnings and errors from it. Thanks, -- kou In "Distributing Arrow in Debian and Fedora" on Fri, 1 Feb 2019 18:51:34 -0800, Javier Luraschi wrote: > Hi, in order to make Arrow available to the R community through CRAN (R's > package

Re: Distributing Arrow in Debian and Fedora

2019-02-02 Thread Javier Luraschi
Thanks for the additional info, it's really helpful to hear your thoughts and potential issues we might need to resolve. The R package is planning to support feature flags, so a start, I'm hoping we can support a minimal version of Arrow with the minimum set of dependencies. It seems to be the cas

Re: Distributing Arrow in Debian and Fedora

2019-02-02 Thread Suvayu Ali
Hello Javier, On Fri, Feb 01, 2019 at 06:51:34PM -0800, Javier Luraschi wrote: > Hi, in order to make Arrow available to the R community through CRAN (R's > package archive), we need to get the Arrow binaries submitted to the Debian >

Distributing Arrow in Debian and Fedora

2019-02-01 Thread Javier Luraschi
Hi, in order to make Arrow available to the R community through CRAN (R's package archive), we need to get the Arrow binaries submitted to the Debian and the Fedora