Re: [RESULT][VOTE] Release Apache Arrow 8.0.0 - RC3

2022-05-28 Thread Ian Cook
> 16. [todo:ianmcook] update vcpkg port Done On Sat, May 7, 2022 at 07:20 Krisztián Szűcs wrote: > Updated status of post-release tasks: > > 1. [done] make the released version as "RELEASED" on JIRA > 2. [done] start the new version on JIRA > 3. [done] merge changes on release branch to mainten

Re: June 23 virtual conference to highlight work in the Arrow ecosystem

2022-06-07 Thread Ian Cook
The deadline for applying to speak at the June 23 event has passed. We plan to do more events like this in the future so I expect there will be more opportunities to speak. Ian On Mon, Jun 6, 2022 at 10:28 PM Niranda Perera wrote: > > Hi, > > Is the event still open for submitting talks? If so,

Arrow sync call June 8 at 12:00 US/Eastern, 16:00 UTC

2022-06-08 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Re: Arrow sync call June 8 at 12:00 US/Eastern, 16:00 UTC

2022-06-08 Thread Ian Cook
Attendees: Ian Cook Raúl Cumplido Alenka Frim Ian Joiner Will Jones Jorge Leitão David Li Rok Mihevc Ashish Paliwal Matthew Topol Jacob Wujciak Discussion: Recent changes to the merge script for apache/arrow PRs - Now uses a personal access token (PAT) to authenticate to the ASF Jira - Now

Re: Arrow sync call June 8 at 12:00 US/Eastern, 16:00 UTC

2022-06-08 Thread Ian Cook
r there was any discussion of note that > happened around Arrow + Substrait stuff? > > > On Wed, Jun 8, 2022 at 5:31 PM Ian Cook wrote: > > > Attendees: > > > > Ian Cook > > Raúl Cumplido > > Alenka Frim > > Ian Joiner > > Will Jones >

Arrow sync call June 22 at 12:00 US/Eastern, 16:00 UTC

2022-06-22 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Re: [ANNOUNCE] New Arrow committers: Dewey Dunnington, Alenka Frim, and Rok Mihevc

2022-06-22 Thread Ian Cook
Congratulations Dewey, Alenka, and Rok!!! On Wed, Jun 22, 2022 at 1:13 PM Neal Richardson wrote: > > On behalf of the Arrow PMC, I'm happy to announce that > > Dewey Dunnington > Alenka Frim > Rok Mihevc > > have all accepted invitations to become committers on Apache Arrow! > Welcome, thank you

Re: Arrow sync call June 22 at 12:00 US/Eastern, 16:00 UTC

2022-06-22 Thread Ian Cook
Attendees: - Ian Cook - Will Jones - David Li - Rok Mihevc - Dragoș Moldovan-Grünfeld - Aldrin Montana - Matthew Topol - Jacob Wujciak Discussion: Book about Apache Arrow released this week - Matt Topol's book "In-Memory Analytics with Apache Arrow" goes on sale this Fr

Arrow sync call July 6 at 12:00 US/Eastern, 16:00 UTC

2022-07-05 Thread Ian Cook
Hi all, Our biweekly sync call is tomorrow at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Mee

Re: Arrow sync call July 6 at 12:00 US/Eastern, 16:00 UTC

2022-07-06 Thread Ian Cook
Attendees: - Ian Cook - Raul Cumplido - James Duong - Will Jones - David Li - Ashish Paliwal - Matt Topol - Jacob Wujciak Discussion: Donation of Flight SQL drivers to Arrow project - The vote to accept the donation of the Flight SQL JDBC driver has passed [1]. We are awaiting some

Arrow sync call July 20 at 12:00 US/Eastern, 16:00 UTC

2022-07-19 Thread Ian Cook
Hi all, Our biweekly sync call is tomorrow at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Mee

Arrow sync call August 3 at 12:00 US/Eastern, 16:00 UTC

2022-08-02 Thread Ian Cook
Hi all, Our biweekly sync call is tomorrow at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Mee

Re: Arrow sync call August 3 at 12:00 US/Eastern, 16:00 UTC

2022-08-06 Thread Ian Cook
With apologies for the delay. Attendees: Ian Cook Raúl Cumplido Dewey Dunnington James Duong Todd Farmer Will Jones David Li Rok Mihevc Ivan Ogasawara Ashish Paliwal Niranda Perera Antoine Pitrou Matt Topol Jacob Wujciak Discussion: 9.0.0 release - Vote on RC2 has passed - Post-release tasks

Arrow sync call August 17 at 12:00 US/Eastern, 16:00 UTC

2022-08-17 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Re: Usage of the name Feather?

2022-08-29 Thread Ian Cook
+1 We should explicitly discourage further use of “Feather” to refer to Arrow IPC files. In this spirit of simplifying terminology: Does the “IPC” in the term “Arrow IPC files” serve a truly necessary purpose? Is there another type of “Arrow file” that the “IPC” serves to disambiguate? If not, can

Arrow sync call August 31 at 12:00 US/Eastern, 16:00 UTC

2022-08-30 Thread Ian Cook
Hi all, Our biweekly sync call is tomorrow at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Mee

Re: Arrow sync call August 31 at 12:00 US/Eastern, 16:00 UTC

2022-08-31 Thread Ian Cook
Attendees: - Ian Cook - Raúl Cumplido - Dewey Dunnington - James Duong - Ian Joiner - Will Jones - Jonathan Keane - David Li - Rok Mihevc - Niranda Perera - Antoine Pitrou - Gavin Ray - Kae Suarez - Matt Topol - Brent Gardner - Dalton Modlin Discussion: Proposal to switch to C++ 17 as the

Re: [ANNOUNCE] New Arrow PMC member: Weston Pace

2022-09-05 Thread Ian Cook
Congratulations Weston! On Mon, Sep 5, 2022 at 01:56 Sutou Kouhei wrote: > The Project Management Committee (PMC) for Apache Arrow has invited > Weston Pace to become a PMC member and we are pleased to announce > that Weston Pace has accepted. > > Congratulations and welcome! >

Arrow sync call September 14 at 12:00 US/Eastern, 16:00 UTC

2022-09-13 Thread Ian Cook
Hi all, Our biweekly sync call is tomorrow at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Mee

Arrow sync call September 28 at 12:00 US/Eastern, 16:00 UTC

2022-09-28 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Arrow sync call October 12 at 12:00 US/Eastern, 16:00 UTC

2022-10-11 Thread Ian Cook
Hi all, Our biweekly sync call is tomorrow at 12:00 noon Eastern time. I expect this meeting might run shorter than usual because the attendees from Voltron Data will need to leave to join another call at 12:30 pm Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is

Re: Arrow sync call October 12 at 12:00 US/Eastern, 16:00 UTC

2022-10-13 Thread Ian Cook
Attendees: - Vibhatha Abeykoon - Anja Boskovic - Ian Cook - Will Jones - David Li - Rok Mihevc - Percy Triveño Aucahuasi - Joris Van den Bossche - Jacob Wujciak Discussion: DELTA_BINARY_PACKED encoder for Parquet - Rok looking for help debugging the PR [1] - Tests are failing on some

Re: [ANNOUNCE] New Arrow PMC member: Nicola Crane

2022-10-25 Thread Ian Cook
Congratulations Nic!!! On Tue, Oct 25, 2022 at 17:06 Sutou Kouhei wrote: > The Project Management Committee (PMC) for Apache Arrow has invited > Nicola Crane to become a PMC member and we are pleased to announce > that Nicola Crane has accepted. > > Congratulations and welcome! >

Arrow sync call October 26 at 12:00 US/Eastern, 16:00 UTC

2022-10-26 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Re: [DISCUSS] Move issue tracking to

2022-10-26 Thread Ian Cook
Todd said: >User identifiers differ between systems... To help with this, I created a couple of small scripts [1] that extract details from resolved Arrow Jira issues and the associated merged GitHub PRs, then perform some cleaning, to generate a list [2] of matching Jira user identifiers and GitH

Re: [DISCUSS] Move issue tracking to

2022-10-26 Thread Ian Cook
ttps://github.com/apache/arrow/issues/14510 Ian On Wed, Oct 26, 2022 at 1:30 PM Ian Cook wrote: > > Todd said: > >User identifiers differ between systems... > > To help with this, I created a couple of small scripts [1] that > extract details from resolved Arrow Jira issues a

Re: [ANNOUNCE] New Arrow committer: Will Jones

2022-10-27 Thread Ian Cook
Congratulations Will! On Thu, Oct 27, 2022 at 19:56 Sutou Kouhei wrote: > On behalf of the Arrow PMC, I'm happy to announce that Will Jones > has accepted an invitation to become a committer on Apache > Arrow. Welcome, and thank you for your contributions! > > kou >

Arrow sync call November 9 at 12:00 US/Eastern, 17:00 UTC

2022-11-09 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Re: Arrow sync call November 9 at 12:00 US/Eastern, 17:00 UTC

2022-11-09 Thread Ian Cook
Attendees: - Ian Cook - Raúl Cumplido - Bin Deng - Sean Gallagher - Will Jones - David Li - Ashish Paliwal - Niranda Perera - Matthew Topol Discussion: 10.0.1 release - Primary reason for this patch release is that we do not have PyArrow 10.0.0 wheels for Python 3.11, because the Arrow 10.0.0

Arrow sync call November 23 at 12:00 US/Eastern, 17:00 UTC

2022-11-22 Thread Ian Cook
Hi all, Our biweekly sync call is tomorrow at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Mee

Re: Arrow sync call November 23 at 12:00 US/Eastern, 17:00 UTC

2022-11-24 Thread Ian Cook
Attendees: - Percy T. Aucahuasi - Ian Cook - Raúl Cumplido - James Duong - Todd Farmer - Alenka Frim - Stephanie Hazlitt - Ian Joiner - David Li - Rok Mihevc - Matthew Topol - Joris Van den Bossche - Jacob Wujciak Discussion: Migration from Jira to GitHub issues - ASF Infra has disabled

Re: [ANNOUNCE] New Arrow committer: Raúl Cumplido

2022-12-06 Thread Ian Cook
Congratulations Raúl! On Tue, Dec 6, 2022 at 10:43 AM Matt Topol wrote: > > Congrats Raúl!! > > On Tue, Dec 6, 2022 at 9:53 AM Dewey Dunnington > wrote: > > > Congrats! Welcome! > > > > On Tue, Dec 6, 2022 at 10:35 AM Larry White wrote: > > > > > Congrats, Raúl! > > > > > > On Tue, Dec 6, 2022

Arrow sync call December 7 at 12:00 US/Eastern, 17:00 UTC

2022-12-06 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Re: Arrow sync call December 7 at 12:00 US/Eastern, 17:00 UTC

2022-12-08 Thread Ian Cook
Attendees - Ian Cook - Raúl Cumplido - Dewey Dunnington - Ian Joiner - Will Jones - David Li - Rok Mihevc - Antoine Pitrou - Matt Topol - Joris Van den Bossche Discussion Maintenance policy There is a discussion [1] on the mailing list about whether we should define a maintenance policy

Re: [DISCUSS] Maintenance policy

2022-12-08 Thread Ian Cook
This topic was discussed in the Arrow sync call this week. See the notes from that call here: https://lists.apache.org/thread/gbywpzbvpfydq24m1c0w6jgybnsrf9xm Ian On Wed, Nov 23, 2022 at 7:36 AM Benson Muite wrote: > > On 10/19/22 20:47, Will Jones wrote: > > One particular type of defect we mig

Re: [VOTE] Add RLE Arrays to Arrow Format

2022-12-14 Thread Ian Cook
Thank you Matt, Tobias, and others for the great work on this. I am -0.5 on this proposal in its current form because (pardon the pedantry) what we have implemented here is not run-length encoding; it is run-end encoding. Based on community input, the choice was made to store run ends instead of r

Re: [ANNOUNCE] New Arrow committer: Jacob Wujciak

2022-12-15 Thread Ian Cook
Herzlichen Glückwunsch, Jacob! On Thu, Dec 15, 2022 at 6:56 PM Rok Mihevc wrote: > > Congrats Jacob!! > > Rok > > On Fri, Dec 16, 2022 at 12:52 AM Vibhatha Abeykoon > wrote: > > > Congratulations Jacob!!! > > > > On Fri, Dec 16, 2022 at 5:09 AM Raúl Cumplido > > wrote: > > > > > Congratulations

Re: [VOTE] Add RLE Arrays to Arrow Format

2022-12-19 Thread Ian Cook
un-End-Encoding (which would also > > follow > > > > the naming of the internal fields) but I don't view that as a deal > > > blocker. > > > > > > > > Thank you for all your work in this matter, > > > > Andrew > > >

Arrow sync call December 21 at 12:00 US/Eastern, 17:00 UTC

2022-12-20 Thread Ian Cook
Hi all, Our biweekly sync call is tomorrow at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Mee

Arrow sync call January 4 at 12:00 US/Eastern, 17:00 UTC

2023-01-03 Thread Ian Cook
Hi all, Our biweekly sync call is tomorrow at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Mee

Re: Arrow sync call January 4 at 12:00 US/Eastern, 17:00 UTC

2023-01-05 Thread Ian Cook
Attendees: Ian Cook Dewey Dunnington Ian Joiner Will Jones David Li Bryce Mecum Rok Mihevc Eduardo Ponce Matthew Topol Jacob Wujciak Discussion: ADBC 0.1.0 release vote - The vote is open [1] - David is looking for more review and votes from PMC members and others Jira to GitHub migration

Re: Arrow sync call January 4 at 12:00 US/Eastern, 17:00 UTC

2023-01-06 Thread Ian Cook
> If a Google Doc is used, can it be configured to send out notifications of the summary to the list? Not as far as I know, but I think we can continue to send a copy of the notes to the mailing list after each biweekly meeting, copied and pasted from the Google Doc. On Fri, Jan 6, 2023 at 21:40

Arrow sync call January 18 at 17:00 UTC

2023-01-17 Thread Ian Cook
Hi all, Our biweekly Arrow sync call is tomorrow at 17:00 UTC / 12:00 EST. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 Thanks, Ian

Re: Arrow sync call January 18 at 17:00 UTC

2023-01-20 Thread Ian Cook
oskovic - Rusty Conover - Ian Cook - Raúl Cumplido - Ian Joiner - Will Jones - Sean Kelly - David Li - Bryce Mecum - Rok Mihevc - Matthew Topol - Jacob Wujciak Discussion: 11.0.0 release - Code freeze was on Monday - Release candidate was created today - Packaging and validation is underway - We en

Re: [Discuss] C++ query builder/execution API

2023-01-27 Thread Ian Cook
Hi Shoumyo, This is exciting—thank you for the thoughtfulness you have put into this proposal. This topic of a C++ dataframe API for Arrow-native engine(s) has come up in the past [3], but the bulk of the previous discussion about this predated Substrait. With the Substrait project now quickly ga

Arrow community meeting February 1 at 17:00 UTC

2023-01-31 Thread Ian Cook
Hi all, Our biweekly Arrow community meeting is tomorrow at 17:00 UTC / 12:00 EST. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 Thanks, Ian

Re: Arrow community meeting February 1 at 17:00 UTC

2023-02-01 Thread Ian Cook
The notes for this and future instances of this meeting will be captured in this Google Doc: https://docs.google.com/document/d/1xrji8fc6_24TVmKiHJB4ECX1Zy2sy2eRbBjpVJMnPmk/ A copy of the notes from this week's meeting are also included below: 2023-02-01 Attendees: - Ian Cook - Nic Crane -

Arrow community meeting February 15 at 17:00 UTC

2023-02-15 Thread Ian Cook
Hi all, Our biweekly Arrow community meeting is today at 17:00 UTC / 12:00 EST. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 The notes for this and future instances of this meeting will be captured in this Google

Re: Arrow community meeting February 15 at 17:00 UTC

2023-02-20 Thread Ian Cook
Below is a summary of the notes from last week's meeting: Attendees: - Anja Boskovic - Ian Cook - Dewey Dunnington - Ian Joiner - Will Jones - David Li - Bryce Mecum - Rok Mihevc - Sri Nadukudy - Dane Pitkin - Matthew Topol - Jacob Wujciak Discussion: Fixed-shape tensor cano

Arrow community meeting March 1 at 17:00 UTC

2023-02-28 Thread Ian Cook
Hi all, Our biweekly Arrow community meeting is tomorrow at 17:00 UTC / 12:00 EST. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 The notes for this and future instances of this meeting will be captured in this Goog

Re: Arrow community meeting March 1 at 17:00 UTC

2023-03-01 Thread Ian Cook
Below is a summary of the notes from this week's meeting Attendees: - Ian Cook - Raúl Cumplido - Dewey Dunnington - Ian Joiner - Will Jones - David Li - Bryce Mecum - Rok Mihevc - Sri Nadukudy - Weston Pace - Dane Pitkin Discussion: Fixed Shape Tensor canonical Extensio

Re: [ANNOUNCE] New Arrow PMC member: Will Jones

2023-03-13 Thread Ian Cook
Congratulations Will! On Mon, Mar 13, 2023 at 1:58 PM Andrew Lamb wrote: > > The Project Management Committee (PMC) for Apache Arrow has invited > Will Jones to become a PMC member and we are pleased to announce > that Will Jones has accepted. > > Congratulations and welcome!

Arrow community meeting March 15 at 16:00 UTC

2023-03-15 Thread Ian Cook
Hi all, Our biweekly Arrow community meeting is today at 16:00 UTC / 12:00 EST. For attendees in countries that have not yet switched to Daylight Saving Time, please note that the time is one hour earlier than usual in your local time zone. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=Sits

Re: Arrow community meeting March 15 at 16:00 UTC

2023-03-15 Thread Ian Cook
Below is a summary of the notes from this week's meeting Attendees: - Ian Cook - Raúl Cumplido - Alenka Frim - Will Jones - David Li - Bryce Mecum - Rok Mihevc - Sri Nadukudy - Weston Pace - Dane Pitkin - Matthew Topol - Joris Van den Bossche Discussion: Arrow 12.0.0 Release - Planned

Arrow community meeting March 29 at 16:00 UTC

2023-03-28 Thread Ian Cook
Hi all, Our biweekly Arrow community meeting is tomorrow at 16:00 UTC / 12:00 EDT. I expect that this meeting might run shorter than usual because all the attendees from Voltron Data will need to leave to join another meeting at 12:30 EDT. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=Sits

Re: Arrow community meeting March 29 at 16:00 UTC

2023-04-01 Thread Ian Cook
Below is a summary of the notes from this week's meeting: Attendees: - Ian Cook - Will Jones - David Li - Rok Mihevc - Sri Nadukudy - Dane Pitkin Discussion: Questions about versioning, packaging, releasing the Rust ADBC API [1] - ADBC drivers are packaged in native language, an

Arrow community meeting April 12 at 16:00 UTC

2023-04-11 Thread Ian Cook
Hi all, Our biweekly Arrow community meeting is tomorrow at 16:00 UTC / 12:00 EDT. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 The notes for this and future instances of this meeting will be captured in this Goog

Re: Arrow community meeting April 12 at 16:00 UTC

2023-04-12 Thread Ian Cook
Below is a summary of the notes from today's meeting: Attendees: - Ian Cook - Raúl Cumplido - Xuwei Fu - Will Jones - Bryce Mecum - Rok Mihevc - Sri Nadukudy - Ashish Paliwal - Dane Pitkin - David Dali Susanibar Arce - Matthew Topol - Joris Van den Bossche - Jacob Wujciak Discussion: 1

Arrow community meeting April 26 at 16:00 UTC

2023-04-25 Thread Ian Cook
Hi all, Our biweekly Arrow community meeting is tomorrow at 16:00 UTC / 12:00 EDT. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 The notes for this and future instances of this meeting will be captured in this Goog

Re: [DISCUSS][Format] Starting the draft implementation of the ArrayView array format

2023-04-26 Thread Ian Cook
+1 to what Weston and Joris suggested regarding the name. "ListView" seems like the best name to use for this layout in Arrow. My understanding is that the primary benefit of this ListView layout over Arrow's existing List layouts [1] is that ListView allows for buffer alignment [2] without paddin

Re: Arrow community meeting April 26 at 16:00 UTC

2023-04-27 Thread Ian Cook
Below is a summary of the notes from yesterday's meeting: Attendees: - Ian Cook - Raúl Cumplido - Xuwei Fu - Will Jones - Bryce Mecum - Rok Mihevc - Sri Nadukudy - Matthew Topol Discussion: Arrow 12.0.0 release - RC0 has been proposed [1] - There were a lot of CI failures at the time o

Re: [WEBSITE] [DISCUSS] Arrow-Site blog post

2023-04-28 Thread Ian Cook
Hi Matt, I reviewed it and left a few very minor comments. Looks great to me. Do any PMC members wish to chime in? If not, it seems OK to give it 72 hours from the time of your email here and then merge it. Thanks, Ian On Fri, Apr 28, 2023 at 11:41 AM Matt Topol wrote: > > Hey All, > > Yevgen

Re: [DISCUSS][Gandiva] changes in bundled double-conversion

2023-05-01 Thread Ian Cook
Looking at PR #9816 which is the PR that introduced downstream changes to our vendored copy of double-conversion, it appears that the changes were quite small: two files modified, fewer than 10 lines of added code, plus some comments [1]. If this is correct, then I think the easiest path forward fo

Re: [DISCUSS][Gandiva] changes in bundled double-conversion

2023-05-01 Thread Ian Cook
; discussing our changes with upstream. > > Does anyone want to upstream our changes? It seems that our > changes break a compatibility. So I think that we need to > explain our use-case to upstream. > > > Thanks, > -- > kou > > In > "Re: [DISCUSS][Gandiva]

Re: [ANNOUNCE] New Arrow PMC member: Matt Topol

2023-05-03 Thread Ian Cook
Congratulations Matt!!! On Wed, May 3, 2023 at 9:55 PM Yibo Cai wrote: > > Congrats Matt! > > On 5/4/23 07:07, Krisztián Szűcs wrote: > > Congrats Matt! > > > > On Wed, May 3, 2023 at 11:44 PM Rok Mihevc wrote: > >> > >> Congrats Matt. Well deserved! > >> > >> Rok > >> > >> On Wed, May 3, 2023 a

Arrow community meeting May 10 at 16:00 UTC

2023-05-09 Thread Ian Cook
Hi all, Our biweekly Arrow community meeting is tomorrow at 16:00 UTC / 12:00 EDT. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 The notes for this and future instances of this meeting will be captured in this Goog

Re: Arrow community meeting May 10 at 16:00 UTC

2023-05-10 Thread Ian Cook
Below is a summary of the notes from today's meeting. Attendees: - Ian Cook - Raúl Cumplido - Dewey Dunnington - Xuwei Fu - Will Jones - David Li - Ashish Paliwal - Dane Pitkin - Matthew Topol - Joris Van den Bossche Discussion: Arrow 12.0.0 release - Release is complete - Most post-re

Re: [DISCUSS][Format] Starting the draft implementation of the ArrayView array format

2023-05-15 Thread Ian Cook
I think it would be easier for us all to weigh the costs and benefits of adding this proposed ListView layout to the Arrow specification and implementing it in the various Arrow libraries if we could all see some benchmarks demonstrating the performance/efficiency benefits compared to Arrow’s exist

Re: [ANNOUNCE] New Arrow committer: Gang Wu

2023-05-15 Thread Ian Cook
Congratulations Gang! On Mon, May 15, 2023 at 9:47 AM vin jake wrote: > > Congrats Gang! > > On Mon, May 15, 2023 at 9:33 PM Sutou Kouhei wrote: > > > On behalf of the Arrow PMC, I'm happy to announce that Gang > > Wu has accepted an invitation to become a committer on > > Apache Arrow. Welcome,

Re: [DISCUSS][Gandiva] changes in bundled double-conversion

2023-05-18 Thread Ian Cook
ot; on Mon, 1 May > 2023 19:01:31 -0400, > Ian Cook wrote: > > > Hi Kou, > > > > Thank you. I think this is a reasonable approach. > > > > I added a comment asking if the PR author can please update the PR by > > porting the changes from PR #9816.

Re: [DISCUSS] Interest in a 12.0.1 patch?

2023-05-18 Thread Ian Cook
There is also a major issue with the 12.0.0 R package that has now been fixed in the repo [2] and needs to be resubmitted to CRAN soon. The R package developers are supportive of a 12.0.1 patch release happening soon so that the resubmission of the R package to CRAN can also include the fix for the

Re: [DISCUSS][Format] Starting the draft implementation of the ArrayView array format

2023-05-19 Thread Ian Cook
se > it would allow us to bitmask out mvcc rows that have been deleted / have > not yet been committed / have been rolled back, etc. > > - Brent > > On Mon, May 15, 2023, 06:55 Ian Cook wrote: > > > I think it would be easier for us all to weigh the costs and benefits >

Arrow community meeting May 24 at 16:00 UTC

2023-05-23 Thread Ian Cook
Hi all, Our biweekly Arrow community meeting is tomorrow at 16:00 UTC / 12:00 EDT. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 The notes for this and future instances of this meeting will be captured in this Goog

Re: [VOTE][Format] Add experimental ArrowDeviceArray to C-Data API

2023-05-31 Thread Ian Cook
+1 (non-binding). Thanks very much Matt for all the work you did here to solicit input from other stakeholder communities. On Mon, May 22, 2023 at 12:02 PM Matt Topol wrote: > Hello, > > Now that there's a rough consensus and a toy example POC[1], I would like > to propose an official enhanceme

Re: [DISCUSS][Format] Starting the draft implementation of the ArrayView array format

2023-06-06 Thread Ian Cook
To clarify why we cannot simply propose adding ListView as a new “canonical extension type”: The extension type mechanism in Arrow depends on the underlying data being organized in an existing Arrow layout—that way an implementation that does not support the extension type can still handle the unde

Re: [DISCUSS][Format] Starting the draft implementation of the ArrayView array format

2023-06-06 Thread Ian Cook
s and emits primary layouts - arrow compatible > * Receives and emits both primary and alternative layouts - arrow > compatible† > > † - with the caveat that the primary layout must be emitted if the user > does not > specifically request the alternative layout. > > [1] > http

Arrow community meeting June 7 at 16:00 UTC

2023-06-07 Thread Ian Cook
Our next biweekly Arrow community meeting is today at 16:00 UTC / 12:00 EDT. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 Meeting notes will be captured in this Google Doc: https://docs.google.com/document/d/1xrji8

Re: [Parquet C++] Plan to bump default write version from 2.4 -> 2.6 (include nanoseconds LogicalType)

2023-06-15 Thread Ian Cook
It will still be possible to write files using Parquet 2.4 by explicitly specifying the 2.4 version to the Parquet writer, correct? If yes, that provides a simple workaround for users who encounter compatibility issues. However we should take care to document this as a potentially breaking change,

Arrow community meeting June 21 at 16:00 UTC

2023-06-21 Thread Ian Cook
Our next biweekly Arrow community meeting is today at 16:00 UTC / 12:00 EDT. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 Meeting notes will be captured in this Google Doc: https://docs.google.com/document/d/1xrji8

Re: [ANNOUNCE] New Arrow PMC member: Dewey Dunnington

2023-06-23 Thread Ian Cook
Congratulations Dewey! On Fri, Jun 23, 2023 at 10:03 AM Matt Topol wrote: > > Congrats Dewey!! > > On Fri, Jun 23, 2023, 9:35 AM Dane Pitkin > wrote: > > > Congrats Dewey! > > > > On Fri, Jun 23, 2023 at 9:15 AM Nic Crane wrote: > > > > > Well-deserved Dewey, congratulations! > > > > > > On Fri

Re: [Python][Discuss] PyArrow Dataset as a Python protocol

2023-06-23 Thread Ian Cook
Thanks Will for this proposal! For anyone familiar with PyArrow, this idea has a clear intuitive logic to it. It provides an expedient solution to the current lack of a practical means for interchanging "unmaterialized dataframes" between different Python libraries. To elaborate on that: If you l

Re: [Python][Discuss] PyArrow Dataset as a Python protocol

2023-06-27 Thread Ian Cook
ible way to represent "unmaterialized dataframes" and there are > > > some parallels between RecordBatch/RecordBatchReader and > > > Fragment/Dataset. > > > > > > > This is a good point. I can add a section describing the differences. The > > main

Arrow community meeting July 5 at 16:00 UTC

2023-07-04 Thread Ian Cook
Our next biweekly Arrow community meeting is tomorrow at 16:00 UTC / 12:00 EDT. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 Meeting notes will be captured in this Google Doc: https://docs.google.com/document/d/1xr

Re: [DISCUSS] Canonical alternative layout proposal

2023-07-13 Thread Ian Cook
Thank you Weston for proposing this solution and Neal for describing its context and implications. I agree with the other replies here—this seems like an elegant solution to a growing need that could, if left unaddressed, increase the fragmentation of the ecosystem and reduce the centrality of the

Arrow community meeting July 19 at 16:00 UTC

2023-07-19 Thread Ian Cook
Our next biweekly Arrow community meeting is today at 16:00 UTC / 12:00 EDT. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 Meeting notes will be captured in this Google Doc: https://docs.google.com/document/d/1xrji8

Re: [QUESTION] Syndication site(s) for Apache Arrow related content?

2023-07-21 Thread Ian Cook
+1. Something like this would be quite valuable, especially if it highlighted successful real-world applications of Arrow and helped to disseminate to a broader audience the news of Arrow's increasing adoption as a standard. We should name it "This IntervalUnit in Arrow" On Fri, Jul 21, 2023 at

Arrow community meeting August 2 at 16:00 UTC

2023-08-02 Thread Ian Cook
Our next biweekly Arrow community meeting is today at 16:00 UTC / 12:00 EDT. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 Meeting notes will be captured in this Google Doc: https://docs.google.com/document/d/1xrji8

Arrow community meeting August 16 at 16:00 UTC

2023-08-16 Thread Ian Cook
Our next biweekly Arrow community meeting is today at 16:00 UTC / 12:00 EDT. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 Meeting notes will be captured in this Google Doc: https://docs.google.com/document/d/1xrji8

Re: [Vote][Format] C Data Interface Format string for REE

2023-08-16 Thread Ian Cook
+1 (non-binding) On Wed, Aug 16, 2023 at 10:16 AM Matt Topol wrote: > > Hey All, > > As proposed by Felipe [1] I'm starting a vote on the proposed update to the > Format Spec of adding "+r" as the format string for passing Run-End Encoded > arrays through the Arrow C Data Interface. > > A PR cont

Re: Sort a Table In C++?

2023-08-17 Thread Ian Cook
Li, Here's a standalone C++ example that constructs a Table and executes an Acero ExecPlan to sort it: https://gist.github.com/ianmcook/2aa9aa82e61c3ea4405450b93cf80fbc Ian On Thu, Aug 17, 2023 at 4:50 PM Li Jin wrote: > > Hi, > > I am writing some C++ test and found myself in need for an c++ f

Re: [Python][Discuss] PyArrow Dataset as a Python protocol

2023-08-29 Thread Ian Cook
t; > > > > > > On Wed, Jun 28, 2023 at 1:17 PM David Li wrote: > > > > > > > > > That wouldn't remove the feature from DuckDB, would it? It would just > > > > mean > > > > > that we recognize that PyArrow expressions don&

Arrow community meeting August 30 at 16:00 UTC

2023-08-30 Thread Ian Cook
Our next biweekly Arrow community meeting is today at 16:00 UTC / 12:00 EDT. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 Meeting notes will be captured in this Google Doc: https://docs.google.com/document/d/1xrji8

Arrow community meeting September 13 at 16:00 UTC

2023-09-12 Thread Ian Cook
Our next biweekly Arrow community meeting is tomorrow at 16:00 UTC / 12:00 EDT. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 Meeting notes will be captured in this Google Doc: https://docs.google.com/document/d/1xr

Arrow community meeting September 27 at 16:00 UTC

2023-09-27 Thread Ian Cook
Our next biweekly Arrow community meeting is today at 16:00 UTC / 12:00 EDT. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 Meeting notes will be captured in this Google Doc: https://docs.google.com/document/d/1xrji8

Re: [VOTE][Format] Add ListView and LargeListView Arrays to Arrow Format

2023-09-29 Thread Ian Cook
+1 (non-binding) Thanks very much Felipe for your persistence and your commitment to addressing the numerous questions and comments that have been raised since the beginning of the discussion on this in April. On Fri, Sep 29, 2023 at 12:34 PM Benjamin Kietzman wrote: > > +1 > > On Fri, Sep 29, 2

Re: [DISCUSS][C++] Raw pointer string views

2023-09-29 Thread Ian Cook
I strongly agree with Ben's assertion that "the risk of a parallel ecosystem… is more likely to be provoked by excluding a user's vital use case [than by implementing support for an unofficial layout variant]" in the C++ library. But there seems to be a consensus here that there is a real risk of s

Arrow community meeting October 11 at 16:00 UTC

2023-10-11 Thread Ian Cook
Our next biweekly Arrow community meeting is today at 16:00 UTC / 12:00 EDT. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 Meeting notes will be captured in this Google Doc: https://docs.google.com/document/d/1xrji8

Re: [ANNOUNCE] New Arrow PMC member: Jonathan Keane

2023-10-14 Thread Ian Cook
Congratulations Jonathan! On Sat, Oct 14, 2023 at 13:24 Andrew Lamb wrote: > The Project Management Committee (PMC) for Apache Arrow has invited > Jonathan Keane to become a PMC member and we are pleased to announce > that Jonathan Keane has accepted. > > Congratulations and welcome! > > Andrew

Re: [ANNOUNCE] New Arrow committer: Curt Hagenlocher

2023-10-15 Thread Ian Cook
Congratulations Curt! On Sun, Oct 15, 2023 at 05:32 Andrew Lamb wrote: > On behalf of the Arrow PMC, I'm happy to announce that Curt Hagenlocher > has accepted an invitation to become a committer on Apache > Arrow. Welcome, and thank you for your contributions! > > Andrew >

Re: [ANNOUNCE] New Arrow committer: Xuwei Fu

2023-10-23 Thread Ian Cook
Congratulations Xuwei! On Mon, Oct 23, 2023 at 12:46 AM Sutou Kouhei wrote: > > On behalf of the Arrow PMC, I'm happy to announce that Xuwei Fu > has accepted an invitation to become a committer on Apache > Arrow. Welcome, and thank you for your contributions! > > -- > kou

  1   2   3   >