[NIGHTLY] Arrow Build Report for Job nightly-2021-03-31-0

2021-03-31 Thread Crossbow
Arrow Build Report for Job nightly-2021-03-31-0 All tasks: https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-03-31-0 Failed Tasks: - conda-linux-gcc-py38-aarch64: URL: https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-03-31-0-drone-conda-linux

Re: Re: [Format][RFC] Introduce COMPLEX type for IntervalUnit

2021-03-31 Thread Andrew Lamb
I agree with you that having fixed precision (e.g. postgres / zetasql) is reasonable. Variable precision fields (ala SQL Server/Oracle) seem less valuable to me. I think support for nanosecond precision for intervals is important as there are nanosecond precision timestamps I don't think the post

Re: [Format][RFC] Introduce COMPLEX type for IntervalUnit

2021-03-31 Thread Antoine Pitrou
I would favour the following characteristics : - support for nanoseconds (especially as other Arrow temporal types support it) - easy to handle (which excludes the ZetaSQL representtaion IMHO) OTOH I don't really understand the point of supporting "the most reasonable ranges for Year, Month

Re: Call for Presentations for ApacheCon 2021 now open

2021-03-31 Thread Zoran Regvart
Hi all, just dripping in with a gentle reminder of the CFP and notifying you that this year's ApacheCon Asia also features the Integration track, so you might want to consider submitting your presentation there as well. I hope that we can have more software integration projects at ASF presented/pr

Re: [RESULT] [VOTE] Accept donation of Rust Ballista project

2021-03-31 Thread Andy Grove
CLAs have been submitted or are already on file for just over half the contributors at this point (some are still waiting for confirmation from secretary@) and based on feedback from the incubator folks, it looks like we can move ahead with a vote since the project has been Apache-licensed since it

Re: [RESULT] [VOTE] Accept donation of Rust Ballista project

2021-03-31 Thread Wes McKinney
hi Andy — before you start an IP clearance vote, you need to add an entry on https://incubator.apache.org/ip-clearance/ and run through the clearance checklist, let me know if you have trouble and I can help you. Thanks On Wed, Mar 31, 2021 at 8:47 AM Andy Grove wrote: > > CLAs have been submitt

Re: [Format][RFC] Introduce COMPLEX type for IntervalUnit

2021-03-31 Thread Micah Kornfield
Thanks for the feedback. A couple of points here and some responses below. * One other question is whether the Nanoseconds should actually be configurable (i.e. use milliseconds or microseconds). I would lean towards no. * I'm also still not 100% convinced we need this as a first class type in

Re: [Format][RFC] Introduce COMPLEX type for IntervalUnit

2021-03-31 Thread Antoine Pitrou
Le 31/03/2021 à 17:55, Micah Kornfield a écrit : Thanks for the feedback. A couple of points here and some responses below. * One other question is whether the Nanoseconds should actually be configurable (i.e. use milliseconds or microseconds). I would lean towards no. Same for me. * I'm

Re: Arrow sync call March 31 at 12:00 US/Eastern, 16:00 UTC

2021-03-31 Thread Kirill Lykov
Hi, I don't know about the others but I cannot join because someone needs to let me in. Might be it the problem also for other people? On Tue, Mar 30, 2021 at 5:53 PM Neal Richardson wrote: > Hi all, > Our biweekly call is coming up tomorrow at > https://meet.google.com/vtm-teks-phx. All are we

Re: Arrow sync call March 31 at 12:00 US/Eastern, 16:00 UTC

2021-03-31 Thread Jonathan Keane
I'm experiencing the same here. On Wed, Mar 31, 2021 at 11:06 AM Kirill Lykov wrote: > Hi, > > I don't know about the others but I cannot join because someone needs to > let me in. > Might be it the problem also for other people? > > On Tue, Mar 30, 2021 at 5:53 PM Neal Richardson < > neal.p.ric

Re: Arrow sync call March 31 at 12:00 US/Eastern, 16:00 UTC

2021-03-31 Thread Wes McKinney
The Google Meet link is on dremio.com, so there must not be someone from the org to let people in. What do folks think about moving to Zoom for future meetings (which shouldn't have this problem)? On Wed, Mar 31, 2021 at 11:07 AM Jonathan Keane wrote: > > I'm experiencing the same here. > > On We

Re: Arrow sync call March 31 at 12:00 US/Eastern, 16:00 UTC

2021-03-31 Thread Antoine Pitrou
I'm fine with Zoom. But doesn't need it a host as well? Le 31/03/2021 à 18:09, Wes McKinney a écrit : The Google Meet link is on dremio.com, so there must not be someone from the org to let people in. What do folks think about moving to Zoom for future meetings (which shouldn't have this pro

Re: Arrow sync call March 31 at 12:00 US/Eastern, 16:00 UTC

2021-03-31 Thread Wes McKinney
It does, but I would suggest that someone volunteer to host the call each week and send out a Zoom link for that week's call On Wed, Mar 31, 2021 at 11:11 AM Antoine Pitrou wrote: > > > I'm fine with Zoom. But doesn't need it a host as well? > > > Le 31/03/2021 à 18:09, Wes McKinney a écrit : >

Re: Arrow sync call March 31 at 12:00 US/Eastern, 16:00 UTC

2021-03-31 Thread Jonathan Keane
Thank you everyone who attended, here are the notes. Attendees: Jonathan Keane Colin Alworth David Sanders Micah Kornfield Rok Mihevc Projjal Chanda Eduardo Ponce Krill Lykov Discussion: - 4.0 release - zstd compression for the java library (has PR that is approved but ne

Re: sparse data array

2021-03-31 Thread bobtins
I appreciate the feedback. I realize it's a tricky nut to crack; there's always going to be a desire to use compression to improve scaling, and I was trying to identify a connecting thread between various requests for compression enhancements on this list and my own experience. I'll look at the

Debian dependencies on pyarrow for a C++ and Python package

2021-03-31 Thread Arthur Peters
I am working on packaging a system that uses Arrow from both C++ and Python. I have working Conda packages without much trouble. However, Ubuntu/APT packages are turning out to be a problem. The deb packages (at https://apache.bintray.com/arrow/ubuntu/pool/focal/main/a/apache-arrow/ for instan

Re: Debian dependencies on pyarrow for a C++ and Python package

2021-03-31 Thread Sutou Kouhei
Hi, We need to build python3-pyarrow package for it. We can use Pybuild for it: https://wiki.debian.org/Python/Pybuild Our debian/: https://github.com/apache/arrow/tree/master/dev/tasks/linux-packages/apache-arrow/debian BTW, we can use pip with our deb package: apt install -y libarrow-pyth