Re: Arrow sync call January 18 at 17:00 UTC

2023-01-20 Thread Ian Cook
Beginning this week, we are using Google Docs to capture the notes from the biweekly Arrow sync call. The notes for this and future instances of this call will be captured in this Google Doc: https://docs.google.com/document/d/1xrji8fc6_24TVmKiHJB4ECX1Zy2sy2eRbBjpVJMnPmk/ Going forward, I intend

Arrow sync call January 18 at 17:00 UTC

2023-01-17 Thread Ian Cook
Hi all, Our biweekly Arrow sync call is tomorrow at 17:00 UTC / 12:00 EST. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 Thanks, Ian

Re: Arrow sync call January 4 at 12:00 US/Eastern, 17:00 UTC

2023-01-06 Thread Benson Muite
On 1/7/23 05:54, Ian Cook wrote: >> If a Google Doc is used, can it be configured to send out notifications of > the summary to the list? > > Not as far as I know, but I think we can continue to send a copy of the > notes to the mailing list after each biweekly meeting, copied and pasted > from th

Re: Arrow sync call January 4 at 12:00 US/Eastern, 17:00 UTC

2023-01-06 Thread Ian Cook
> If a Google Doc is used, can it be configured to send out notifications of the summary to the list? Not as far as I know, but I think we can continue to send a copy of the notes to the mailing list after each biweekly meeting, copied and pasted from the Google Doc. On Fri, Jan 6, 2023 at 21:40

Re: Arrow sync call January 4 at 12:00 US/Eastern, 17:00 UTC

2023-01-06 Thread Benson Muite
> Proposal to move sync call meeting notes into a Google Doc > > - Will proposed that we share notes from sync calls in a publicly > viewable Google Doc instead of in emails to the mailing list [2] > - There was a discussion about whether managing edit access to this > Google Doc would be diffic

Re: Arrow sync call January 4 at 12:00 US/Eastern, 17:00 UTC

2023-01-05 Thread Ian Cook
Attendees: Ian Cook Dewey Dunnington Ian Joiner Will Jones David Li Bryce Mecum Rok Mihevc Eduardo Ponce Matthew Topol Jacob Wujciak Discussion: ADBC 0.1.0 release vote - The vote is open [1] - David is looking for more review and votes from PMC members and others Jira to GitHub migration -

Arrow sync call January 4 at 12:00 US/Eastern, 17:00 UTC

2023-01-03 Thread Ian Cook
Hi all, Our biweekly sync call is tomorrow at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Mee

Re: Arrow sync call December 21 at 12:00 US/Eastern, 17:00 UTC

2022-12-22 Thread Raúl Cumplido
Hi, Here are the notes from the Arrow sync call from yesterday 21st December: Attendees: - Raúl Cumplido - Bryce Mecum - Rok Mihevc - Matthew Topol - Joris Van den Bossche - Jacob Wujciak Discussion: Migration from Jira to GitHub issues: - Adding new issues on JIRA is closed. Creation of new

Arrow sync call December 21 at 12:00 US/Eastern, 17:00 UTC

2022-12-20 Thread Ian Cook
Hi all, Our biweekly sync call is tomorrow at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Mee

Re: Arrow sync call December 7 at 12:00 US/Eastern, 17:00 UTC

2022-12-08 Thread Ian Cook
Attendees - Ian Cook - Raúl Cumplido - Dewey Dunnington - Ian Joiner - Will Jones - David Li - Rok Mihevc - Antoine Pitrou - Matt Topol - Joris Van den Bossche Discussion Maintenance policy There is a discussion [1] on the mailing list about whether we should define a maintenance policy. - The

Arrow sync call December 7 at 12:00 US/Eastern, 17:00 UTC

2022-12-06 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Re: Arrow sync call November 23 at 12:00 US/Eastern, 17:00 UTC

2022-11-28 Thread Jacob Wujciak
:40 PM Antoine Pitrou wrote: > > Also a note that discussing this in a thread entitled "Arrow sync call > November 23" might not raise the attention of all interested parties :-) > > > Le 28/11/2022 à 14:38, Antoine Pitrou a écrit : > > > > The merge scrip

Re: Arrow sync call November 23 at 12:00 US/Eastern, 17:00 UTC

2022-11-28 Thread Antoine Pitrou
Also a note that discussing this in a thread entitled "Arrow sync call November 23" might not raise the attention of all interested parties :-) Le 28/11/2022 à 14:38, Antoine Pitrou a écrit : The merge script would still be useful to flag issues such as a missing component la

Re: Arrow sync call November 23 at 12:00 US/Eastern, 17:00 UTC

2022-11-28 Thread Antoine Pitrou
The merge script would still be useful to flag issues such as a missing component label, or to ensure the fix version (milestone) is set. Le 28/11/2022 à 12:09, Joris Van den Bossche a écrit : FYI: Raúl also already opened a PR to update the merge script to work with github issues: https://

Re: Arrow sync call November 23 at 12:00 US/Eastern, 17:00 UTC

2022-11-28 Thread Weston Pace
One thing to note is that you need to have something like "closes #123" in the PR description or a comment in order for GitHub to close the relevant issue when the PR is merged. This isn't too much of a burden to check I think but took a bit of getting used to for me in Substrait where we use the

Re: Arrow sync call November 23 at 12:00 US/Eastern, 17:00 UTC

2022-11-28 Thread Joris Van den Bossche
On Mon, 28 Nov 2022 at 12:09, Joris Van den Bossche wrote: > > FYI: Raúl also already opened a PR to update the merge script to work > with github issues: https://github.com/apache/arrow/pull/14731 (sorry, that PR is to update the github actions workflow (the bot that comments on PRs), not the me

Re: Arrow sync call November 23 at 12:00 US/Eastern, 17:00 UTC

2022-11-28 Thread Joris Van den Bossche
FYI: Raúl also already opened a PR to update the merge script to work with github issues: https://github.com/apache/arrow/pull/14731 Personally I also think that we should consider using the merge button instead of our script (or at least re-evaluate what the script still does better, or might now

Re: Arrow sync call November 23 at 12:00 US/Eastern, 17:00 UTC

2022-11-28 Thread Andrew Lamb
> How do apache/arrow-rs, arrow-datafusion, arrow-julia, et al. handle this? arrow-rs and arrow-datafusion use the squash-and-merge button in the github UI. In general we don't have the same level of curation in commit titles as the main arrow repo. However, I have not heard anyone ask for better

Re: Arrow sync call November 23 at 12:00 US/Eastern, 17:00 UTC

2022-11-25 Thread David Li
This is now configurable, but you have to ask Infra to do it. (You can have GitHub always use the PR title + description.) See https://docs.github.com/en/repositories/configuring-branches-and-merges-in-your-repository/configuring-pull-request-merges/configuring-commit-squashing-for-pull-requests

Re: Arrow sync call November 23 at 12:00 US/Eastern, 17:00 UTC

2022-11-25 Thread Neal Richardson
> - This creates an immediate need to modify the PR merge script; Raúl > opened an issue for this after the call [6]; this also raises the > question of whether we still need the PR merge script or whether > committers can use the "Squash and merge" button in the GitHub web UI > instead > I think

Re: Arrow sync call November 23 at 12:00 US/Eastern, 17:00 UTC

2022-11-24 Thread Ian Cook
Attendees: - Percy T. Aucahuasi - Ian Cook - Raúl Cumplido - James Duong - Todd Farmer - Alenka Frim - Stephanie Hazlitt - Ian Joiner - David Li - Rok Mihevc - Matthew Topol - Joris Van den Bossche - Jacob Wujciak Discussion: Migration from Jira to GitHub issues - ASF Infra has disabled creatio

Arrow sync call November 23 at 12:00 US/Eastern, 17:00 UTC

2022-11-22 Thread Ian Cook
Hi all, Our biweekly sync call is tomorrow at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Mee

Re: Arrow sync call November 9 at 12:00 US/Eastern, 17:00 UTC

2022-11-10 Thread Todd Farmer
Hello, As a quick update on the issue tracking migration: - Basic extract from Jira and conversion/import to GitHub issues works well. Some tweaking is needed around content. - Updating source Jira issues now works [1] - The biggest outstanding issue is how to represent related issues [2] - Issue

Re: Arrow sync call November 9 at 12:00 US/Eastern, 17:00 UTC

2022-11-09 Thread Ian Cook
Attendees: - Ian Cook - Raúl Cumplido - Bin Deng - Sean Gallagher - Will Jones - David Li - Ashish Paliwal - Niranda Perera - Matthew Topol Discussion: 10.0.1 release - Primary reason for this patch release is that we do not have PyArrow 10.0.0 wheels for Python 3.11, because the Arrow 10.0.0

Arrow sync call November 9 at 12:00 US/Eastern, 17:00 UTC

2022-11-09 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Re: Arrow sync call October 26 at 12:00 US/Eastern, 16:00 UTC

2022-10-26 Thread Neal Richardson
Attendees: Vibhatha Abeykoon Raúl Cumplido James Duong Sean Gallagher Ian Joiner Will Jones David Li Antoine Pitrou Neal Richardson Matt Topol Jacob Wujciak Discussion: Release 10.0.0: it's done, and it seemed to go smoothly. Kudos to all who have been working to make releases easier! * But sin

Arrow sync call October 26 at 12:00 US/Eastern, 16:00 UTC

2022-10-26 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Re: Arrow sync call October 12 at 12:00 US/Eastern, 16:00 UTC

2022-10-13 Thread Ian Cook
Attendees: - Vibhatha Abeykoon - Anja Boskovic - Ian Cook - Will Jones - David Li - Rok Mihevc - Percy Triveño Aucahuasi - Joris Van den Bossche - Jacob Wujciak Discussion: DELTA_BINARY_PACKED encoder for Parquet - Rok looking for help debugging the PR [1] - Tests are failing on some architectu

Arrow sync call October 12 at 12:00 US/Eastern, 16:00 UTC

2022-10-11 Thread Ian Cook
Hi all, Our biweekly sync call is tomorrow at 12:00 noon Eastern time. I expect this meeting might run shorter than usual because the attendees from Voltron Data will need to leave to join another call at 12:30 pm Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is

Re: Arrow sync call September 28 at 12:00 US/Eastern, 16:00 UTC

2022-09-29 Thread Jacob Wujciak
Attendees: - Anja Boskovic - Ashish Paliwal - Bryce Mecum - David Li - Ian Joiner - Jacob Wujciak - Matt Topol - Percy Camilo Triveño Aucahuasi - Raúl Cumplido - Rok Mihevc - Vibhatha Abeykoon - Will Jones Condition of nightly builds - Raúl would like to remind everyone that the great conditions o

Arrow sync call September 28 at 12:00 US/Eastern, 16:00 UTC

2022-09-28 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Re: Arrow sync call September 14 at 12:00 US/Eastern, 16:00 UTC

2022-09-14 Thread Will Jones
Attendees: - Will Jones - Ian Joiner - Jacob Wujciak - Dhamo - Dewey Dunnington - Sean Gallagher - Ashish Paliwal - Rok Mihevc - James Duong - Bryce Mecum - Anja Boskovic - Matt Topol - David Li Discussion: RLE Progress - Dewey considering implementing

Arrow sync call September 14 at 12:00 US/Eastern, 16:00 UTC

2022-09-13 Thread Ian Cook
Hi all, Our biweekly sync call is tomorrow at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Mee

Re: Arrow sync call August 31 at 12:00 US/Eastern, 16:00 UTC

2022-08-31 Thread Ian Cook
Attendees: - Ian Cook - Raúl Cumplido - Dewey Dunnington - James Duong - Ian Joiner - Will Jones - Jonathan Keane - David Li - Rok Mihevc - Niranda Perera - Antoine Pitrou - Gavin Ray - Kae Suarez - Matt Topol - Brent Gardner - Dalton Modlin Discussion: Proposal to switch to C++ 17 as the basel

Arrow sync call August 31 at 12:00 US/Eastern, 16:00 UTC

2022-08-30 Thread Ian Cook
Hi all, Our biweekly sync call is tomorrow at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Mee

Re: Arrow sync call August 17 at 12:00 US/Eastern, 16:00 UTC

2022-08-17 Thread Rok Mihevc
Attendees: Matt Topol Will Jones David Li Joris Van den Bosche Eduardo Ponce Atoine Pitrou Jacob Wujciak Ivan Ogasawara Ashish Paliwal Niranda Perera Discussion: - FlightSQL PR reviews David Li is inviting reviewers to two FlightSQL PRs. [1] "ARROW-7744: [Java][FlightRPC] JDBC Driver for Arrow F

Arrow sync call August 17 at 12:00 US/Eastern, 16:00 UTC

2022-08-17 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Re: Arrow sync call August 3 at 12:00 US/Eastern, 16:00 UTC

2022-08-06 Thread Ian Cook
With apologies for the delay. Attendees: Ian Cook Raúl Cumplido Dewey Dunnington James Duong Todd Farmer Will Jones David Li Rok Mihevc Ivan Ogasawara Ashish Paliwal Niranda Perera Antoine Pitrou Matt Topol Jacob Wujciak Discussion: 9.0.0 release - Vote on RC2 has passed - Post-release tasks a

Arrow sync call August 3 at 12:00 US/Eastern, 16:00 UTC

2022-08-02 Thread Ian Cook
Hi all, Our biweekly sync call is tomorrow at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Mee

Re: Arrow sync call July 20 at 12:00 US/Eastern, 16:00 UTC

2022-07-21 Thread Rok Mihevc
> One failing test is the R ubuntu test. Rok noted it is likely unrelated as he is seeing elsewhere [7]. > [7] https://github.com/apache/arrow/runs/7424773120?check_suite_focus=true Dragos is looking into this. It does seem to be an R timezone issue [1]. [1] https://github.com/apache/arrow/comp

Re: Arrow sync call July 20 at 12:00 US/Eastern, 16:00 UTC

2022-07-20 Thread Gavin Ray
Awesome, thanks for the clarification David! On Wed, Jul 20, 2022 at 2:40 PM David Li wrote: > It was pulled out of the ADBC project so you can see an example at [1] > (API changed slightly when ported though). > > Yes, it'll bind one row of values at a time, and your description is > correct. >

Re: Arrow sync call July 20 at 12:00 US/Eastern, 16:00 UTC

2022-07-20 Thread David Li
It was pulled out of the ADBC project so you can see an example at [1] (API changed slightly when ported though). Yes, it'll bind one row of values at a time, and your description is correct. [1]: https://github.com/apache/arrow-adbc/blob/cf43e0cc2ae15ad0ce669b531d475ee218698100/java/driver/jdb

Re: Arrow sync call July 20 at 12:00 US/Eastern, 16:00 UTC

2022-07-20 Thread Gavin Ray
That JDBC PreparedStatement binding utility looks super useful! I had one question about the behavior of it, if that's alright: The doc says: "Each call to next() will bind parameters > from the next row of data, and then the application can execute the > statement, call addBatch(), etc. as desir

Re: Arrow sync call July 20 at 12:00 US/Eastern, 16:00 UTC

2022-07-20 Thread Will Jones
Attendees: - Jacob Wujciak-Jens - James Duong - Rok Mihevc - Raul Cumplido - Eduardo Ponce - Jeremy Parr-Pearson - Will Jones - Joris Van den Bossche Discussion Arrow 9.0.0 Release Increased capacity for crossbow, like 3x, including Macs. Devs are encouraged to use more

Arrow sync call July 20 at 12:00 US/Eastern, 16:00 UTC

2022-07-19 Thread Ian Cook
Hi all, Our biweekly sync call is tomorrow at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Mee

Re: Arrow sync call July 6 at 12:00 US/Eastern, 16:00 UTC

2022-07-06 Thread Ian Cook
Attendees: - Ian Cook - Raul Cumplido - James Duong - Will Jones - David Li - Ashish Paliwal - Matt Topol - Jacob Wujciak Discussion: Donation of Flight SQL drivers to Arrow project - The vote to accept the donation of the Flight SQL JDBC driver has passed [1]. We are awaiting some administrati

Arrow sync call July 6 at 12:00 US/Eastern, 16:00 UTC

2022-07-05 Thread Ian Cook
Hi all, Our biweekly sync call is tomorrow at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Mee

Re: Rust / Arrow sync Call - June 23 2022

2022-06-23 Thread Andy Grove
Thanks for sending out the reminder Andrew. I will try and remember to do that for the upcoming calls. I updated the agenda document with notes on topics discussed. Andy. On Wed, Jun 22, 2022 at 11:12 AM Andrew Lamb wrote: > Andy Grove is hosting the next Rust / Arrow sync call tomorrow. M

Re: Arrow sync call June 22 at 12:00 US/Eastern, 16:00 UTC

2022-06-22 Thread Ian Cook
Attendees: - Ian Cook - Will Jones - David Li - Rok Mihevc - Dragoș Moldovan-Grünfeld - Aldrin Montana - Matthew Topol - Jacob Wujciak Discussion: Book about Apache Arrow released this week - Matt Topol's book "In-Memory Analytics with Apache Arrow" goes on sale this Friday June 24 [1] Confere

Rust / Arrow sync Call - June 23 2022

2022-06-22 Thread Andrew Lamb
Andy Grove is hosting the next Rust / Arrow sync call tomorrow. More details such the meeting link can be found on the agenda document [1]. As always, all are invited and we'll send a summary of the meeting afterwards Thank you, Andrew [1] https://docs.google.com/docum

Arrow sync call June 22 at 12:00 US/Eastern, 16:00 UTC

2022-06-22 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Re: Arrow sync call June 8 at 12:00 US/Eastern, 16:00 UTC

2022-06-09 Thread Gavin Ray
This is awesome, thanks so much for the comprehensive reply RE: point #9, also holding my breath for data update operations (INSERT/UPDATE/DELETE) to be added to Substrait Have an open issue about it, it needs design work (which I don't think I'm qualified to do) Add Insert/Update/Delete basic fu

Re: Arrow sync call June 8 at 12:00 US/Eastern, 16:00 UTC

2022-06-08 Thread Ian Cook
Hi Gavin, There was no detailed discussion in the meeting about this, just some general comments, but I'll share a few areas of collaboration that I'm aware of: - There is work ongoing to enable the Arrow C++ compute engine (aka "Acero") to consume Substrait plans, change them into ExecPlans, and

Re: Arrow sync call June 8 at 12:00 US/Eastern, 16:00 UTC

2022-06-08 Thread Gavin Ray
Thanks Ian -- can I ask whether there was any discussion of note that happened around Arrow + Substrait stuff? On Wed, Jun 8, 2022 at 5:31 PM Ian Cook wrote: > Attendees: > > Ian Cook > Raúl Cumplido > Alenka Frim > Ian Joiner > Will Jones > Jorge Leitão > David Li > Rok Mihevc > Ashish Paliwal

Re: Arrow sync call June 8 at 12:00 US/Eastern, 16:00 UTC

2022-06-08 Thread Ian Cook
Attendees: Ian Cook Raúl Cumplido Alenka Frim Ian Joiner Will Jones Jorge Leitão David Li Rok Mihevc Ashish Paliwal Matthew Topol Jacob Wujciak Discussion: Recent changes to the merge script for apache/arrow PRs - Now uses a personal access token (PAT) to authenticate to the ASF Jira - Now requ

Arrow sync call June 8 at 12:00 US/Eastern, 16:00 UTC

2022-06-08 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Re: Arrow sync call May 25 at 12:00 US/Eastern, 16:00 UTC

2022-05-25 Thread Rok Mihevc
Below are the minutes of the call. Best, Rok Present: Dewey Dunnington, Raul Cumplido, Will Jones, Jonathan Keane, Matt Topol, Rok Mihevc, Ian Joiner Agenda: 1. Minimal C++/C interface 2. Naming the C++ Compute Engine 3. Change to bucket creation behaviour in S3FileSystem Notes: 1. Dewey is ask

Arrow sync call May 25 at 12:00 US/Eastern, 16:00 UTC

2022-05-25 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Re: Arrow sync call May 11 at 12:00 US/Eastern, 16:00 UTC

2022-05-13 Thread Antoine Pitrou
Le 13/05/2022 à 16:30, Alessandro Molina a écrit : I think Arrow should definitely consider adding a DataFrame-like API. There are multiple reasons why exposing Arrow to end users instead of restricting it to developers of framework would be beneficial for the Arrow project itself. A rough ap

Re: Arrow sync call May 11 at 12:00 US/Eastern, 16:00 UTC

2022-05-13 Thread Gavin Ray
I agree with this as well, and I it's also along the lines of what I was trying to propose here: "[RFC] [Java] Higher-level "DataFrame"-like API. Lower barrier to entry, increase adoption/audience and productivity." https://github.com/apache/arrow/issues/12618 It would be really nice if there was

Re: Arrow sync call May 11 at 12:00 US/Eastern, 16:00 UTC

2022-05-13 Thread Alessandro Molina
I think Arrow should definitely consider adding a DataFrame-like API. There are multiple reasons why exposing Arrow to end users instead of restricting it to developers of framework would be beneficial for the Arrow project itself. A rough approximation of DataFrame like API has been growing duri

Re: Arrow sync call May 11 at 12:00 US/Eastern, 16:00 UTC

2022-05-12 Thread Andrew Lamb
Also, it seems as if duckdb[1] is heading in the same direction of adding a dataframe API to their database engine [1] https://github.com/duckdb/duckdb/issues/2000 On Thu, May 12, 2022 at 3:36 PM Andrew Lamb wrote: > For what it is worth, DataFusion has a DataFrame interface[1], that uses > the

Re: Arrow sync call May 11 at 12:00 US/Eastern, 16:00 UTC

2022-05-12 Thread Andrew Lamb
For what it is worth, DataFusion has a DataFrame interface[1], that uses the same underlying `LogicalPlan` structures as the SQL interface. Unsurprisingly it is heavily inspired by pandas. I believe that this interface seems more familiar and popular for DataFusion users who programmatically build

Re: Arrow sync call May 11 at 12:00 US/Eastern, 16:00 UTC

2022-05-12 Thread Wes McKinney
> Discussion about whether the community around Arrow would like to have > DataFrame-like APIs for Arrow in more languages, for example C++ We've discussed this a bit on the mailing list in the past, see https://docs.google.com/document/d/1XHe_j87n2VHGzEbnLe786GHbbcbrzbjgG8D0IXWAeHg/edit#heading

Re: Arrow sync call May 11 at 12:00 US/Eastern, 16:00 UTC

2022-05-11 Thread Ian Cook
Attendees: Joris Van den Bossche Ian Cook Nic Crane Raul Cumplido Ian Joiner David Li Rok Mihevc Dragoș Moldovan-Grünfeld Aldrin Montana Weston Pace Eduardo Ponce Matthew Topol Jacob Wujciak Discussion: Eduardo: Draft PR with a guide showing how to create a new Arrow C++ compute kernel [1] - R

Arrow sync call May 11 at 12:00 US/Eastern, 16:00 UTC

2022-05-11 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Re: Arrow sync call April 27 at 12:00 US/Eastern, 16:00 UTC

2022-04-27 Thread Benson Muite
Attendees: Ian Joiner Matthew Topol Benson Muite Discussion points: 1) New book on Arrow - covers C++, Python and Go, out in June 2) Building ORC bindings in R would be useful, extensions to parallel R? 3) Comparing ORC and Parquet for IO 4) IO optimization vs SIMD optimization - Parquet seems we

Re: Arrow sync call April 27 at 12:00 US/Eastern, 16:00 UTC

2022-04-27 Thread Ian Cook
Thanks Benson! The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meeting ID: 876 4903 3008 Passcode: 958092 The Zoom meeting

Re: Arrow sync call April 27 at 12:00 US/Eastern, 16:00 UTC

2022-04-27 Thread David Li
Thanks Benson. If you are able to take notes this week that would be much appreciated. And thanks Joris for the clarification. On Wed, Apr 27, 2022, at 09:34, Joris Van den Bossche wrote: > As a small clarification: the zoom meeting link itself should still work > for anyone to join, it's only t

Re: Arrow sync call April 27 at 12:00 US/Eastern, 16:00 UTC

2022-04-27 Thread Joris Van den Bossche
As a small clarification: the zoom meeting link itself should still work for anyone to join, it's only there is no one from Voltron Data to lead the meeting / take notes (so I also won't be present today). Joris On Wed, 27 Apr 2022 at 13:05, Benson Muite wrote: > Hi, > > Can host if required, t

Re: Arrow sync call April 13 at 12:00 US/Eastern, 16:00 UTC

2022-04-27 Thread Benson Muite
On 4/25/22 2:49 PM, David Li wrote: Following up here: N.B. The Voltron Data folks have a scheduling conflict on 4/27 and will not be able to host the fortnightly sync call. Is anyone available to run the meeting that day? Is anyone available to run the sync call this Wednesday? On Wed, Ap

Re: Arrow sync call April 27 at 12:00 US/Eastern, 16:00 UTC

2022-04-27 Thread Benson Muite
Hi, Can host if required, though the timing is not ideal for me. It may be helpful to vary the timing in future. Benson On 4/25/22 2:49 PM, David Li wrote: Following up here: N.B. The Voltron Data folks have a scheduling conflict on 4/27 and will not be able to host the fortnightly sync c

Re: Arrow sync call April 13 at 12:00 US/Eastern, 16:00 UTC

2022-04-25 Thread David Li
Following up here: > N.B. The Voltron Data folks have a scheduling conflict on 4/27 and will not > be able to host the fortnightly sync call. Is anyone available to run the > meeting that day? Is anyone available to run the sync call this Wednesday? On Wed, Apr 13, 2022, at 12:59, David Li wro

Re: Arrow sync call April 13 at 12:00 US/Eastern, 16:00 UTC

2022-04-18 Thread Will Jones
That sounds great, Weston! Agreed that syncing up with releases seems like a good idea. On Mon, Apr 18, 2022 at 11:51 AM Weston Pace wrote: > I'm happy to provide a quarterly update on C++ engine work but in the > future I'll draft it in PR form so others have a chance to pitch in. > I was inspi

Re: Arrow sync call April 13 at 12:00 US/Eastern, 16:00 UTC

2022-04-18 Thread Weston Pace
I'm happy to provide a quarterly update on C++ engine work but in the future I'll draft it in PR form so others have a chance to pitch in. I was inspired by, and hope to mimic, the Rust community's very cool quarterly roadmap [1][2] as a place to have higher level discussions on what people are hop

Re: Arrow sync call April 13 at 12:00 US/Eastern, 16:00 UTC

2022-04-18 Thread Will Jones
Thanks Weston for providing the update on the C++ compute engine. IMO, it would be very welcome to have that update be a quarterly email to the dev mailing list, and may provide an opportunity to highlight issues in Jira that are good first issues or neglected but important. On Wed, Apr 13, 2022 a

Re: Arrow sync call April 13 at 12:00 US/Eastern, 16:00 UTC

2022-04-13 Thread David Li
Attendees: - David Li - Eduardo Ponce - Gavin Ray - Ian Cook - James Duong - Matthew Topol - Nic - Niranda - Raul Cumplido - Rok - Weston Pace - Will Jones N.B. The Voltron Data folks have a scheduling conflict on 4/27 and will not be able to host the fortnightly sync call. Is anyone available t

Arrow sync call April 13 at 12:00 US/Eastern, 16:00 UTC

2022-04-12 Thread Ian Cook
Hi all, Our biweekly sync call is tomorrow at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Mee

Re: Arrow sync call March 30 at 12:00 US/Eastern, 16:00 UTC

2022-03-30 Thread Ian Cook
Attendees: Ian Cook James Duong Ian Joiner Micah Kornfield David Li Rok Mihevc Matt Topol Discussion: C++ helpers for conversion between Arrow columnar formats and row-oriented formats - Discussion at [1]; comments requested - Could this be pursued by factoring out existing code from the CSV

Arrow sync call March 30 at 12:00 US/Eastern, 16:00 UTC

2022-03-30 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Re: Arrow sync call March 16 at 12:00 US/Eastern, 16:00 UTC

2022-03-16 Thread Rok Mihevc
Sorry to all who will have missed the call because of the Daylight Saving Time change. Here are the notes: Attendees: James Duong, Micah Kornfield, Eduardo Ponce, Will Jones, Rok Mihevc, David Li, Niranda Perera, Alenka Frim, Ian Joiner Discussion: * James Duong - Out of curiosity - does Arrow ha

Arrow sync call March 16 at 12:00 US/Eastern, 16:00 UTC

2022-03-16 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. For attendees in locations where Daylight Saving Time is observed but has not yet begun, please note that this is one hour earlier than the usual time in your local time zone. The Zoom meeting URL for this and other biweekly Arro

Re: Arrow sync call March 2 at 12:00 US/Eastern, 17:00 UTC

2022-03-02 Thread David Li
Yeah, things like that would help I believe, to help make it easier to adopt and make sure knowledge of the details is readily available around the community. I have been meaning to tackle ARROW-14698 but haven't gotten to it yet. I think it would also help to have more reviewers, so maybe one

Re: Arrow sync call March 2 at 12:00 US/Eastern, 17:00 UTC

2022-03-02 Thread James Duong
I missed this call (incidentally to present Flight SQL at Subsurface). I'd be interested in helping to champion Flight SQL. What would this entail? Working on extending the documentation, providing example code and cookbook entries? On Wed, Mar 2, 2022 at 10:59 AM Gavin Ray wrote: > Ah got it, t

Re: Arrow sync call March 2 at 12:00 US/Eastern, 17:00 UTC

2022-03-02 Thread Gavin Ray
Ah got it, thank you! =) On Wed, Mar 2, 2022 at 10:33 AM Micah Kornfield wrote: > Hi Gavin, > This was mostly discussing the current discussion on the e-mail thread > titled "Flight/FlightSQL Optimization for Small Results?". The main thing > discussed was whether we think adding the complexity

Re: Arrow sync call March 2 at 12:00 US/Eastern, 17:00 UTC

2022-03-02 Thread Micah Kornfield
Hi Gavin, This was mostly discussing the current discussion on the e-mail thread titled "Flight/FlightSQL Optimization for Small Results?". The main thing discussed was whether we think adding the complexity around negotiation is necessary. The consensus was it probably depends on how big the res

Re: Arrow sync call March 2 at 12:00 US/Eastern, 17:00 UTC

2022-03-02 Thread Gavin Ray
Particularly curious about the small-results FlightSQL optimizations and general FlightSQL developments, if there was anything anyone felt was worth noting outside of the general outline. Thank you =) On Wed, Mar 2, 2022 at 10:12 AM Micah Kornfield wrote: > It was not. Is there anything you wo

Re: Arrow sync call March 2 at 12:00 US/Eastern, 17:00 UTC

2022-03-02 Thread Micah Kornfield
It was not. Is there anything you would like more context on? On Wed, Mar 2, 2022 at 10:10 AM Gavin Ray wrote: > Was this recorded by any chance? No worries if not. > > On Wed, Mar 2, 2022 at 9:58 AM Alessandro Molina < > alessan...@ursacomputing.com> wrote: > > > Attendees: > > > > > > Alessan

Re: Arrow sync call March 2 at 12:00 US/Eastern, 17:00 UTC

2022-03-02 Thread Gavin Ray
Was this recorded by any chance? No worries if not. On Wed, Mar 2, 2022 at 9:58 AM Alessandro Molina < alessan...@ursacomputing.com> wrote: > Attendees: > > > Alessandro Molina > > Micah Kornfield > > David Li > > Joris Van Den Bossche > > > > Discussion: > > > Flight SQL Optimization for Small R

Re: Arrow sync call March 2 at 12:00 US/Eastern, 17:00 UTC

2022-03-02 Thread Alessandro Molina
Attendees: Alessandro Molina Micah Kornfield David Li Joris Van Den Bossche Discussion: Flight SQL Optimization for Small Results - Reference to https://databricks.com/blog/2021/08/11/how-we-achieved-high-bandwidth-connectivity-with-bi-tools.html - Building directly in Flight as flig

Arrow sync call March 2 at 12:00 US/Eastern, 17:00 UTC

2022-03-02 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Re: Arrow sync call February 16 at 12:00 US/Eastern, 17:00 UTC

2022-02-16 Thread Ian Cook
Attendees: Ian Cook Nic Crane James Duong Alenka Frim Ian Joiner Will Jones Jonathan Keane Rok Mihevc Discussion: Arrow visual identity proposal - If interested, please review the PR [1] arrow vcpkg port 7.0.0 update PR [2] - To maintain ORC functionality, the orc vcpkg port must be updated [3

Arrow sync call February 16 at 12:00 US/Eastern, 17:00 UTC

2022-02-15 Thread Ian Cook
Hi all, Our biweekly sync call is tomorrow at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Mee

Re: Arrow sync call February 2 at 12:00 US/Eastern, 17:00 UTC

2022-02-02 Thread Ian Cook
Attendees: Ian Cook Ian Joiner Will Jones Jon Keane Micah Kornfield Rok Mihevc Alessandro Molina Antoine Pitrou Jacob Quinn Krisztián Szűcs Matt Topol Joris Van den Bossche Discussion: Recent ORC writer work - Ian Joiner is working on several follow-up issues [1] 7.0.0 release current state - K

Arrow sync call February 2 at 12:00 US/Eastern, 17:00 UTC

2022-02-02 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Re: Arrow sync call January 19 at 12:00 US/Eastern, 17:00 UT

2022-01-19 Thread Ian Cook
Attendees: Colin Alworth Ian Cook Nic Crane Alenka Frim Will Jones David Li Rok Mihevc Dragoș Moldovan-Grünfeld Niranda Perera Antoine Pitrou Matt Topol Joris Van den Bossche Discussion: 7.0.0 release - Krisztián has a PR open for RC0 [1] - Joris has identified a regression [2] so there will li

Arrow sync call January 19 at 12:00 US/Eastern, 17:00 UT

2022-01-19 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Re: Arrow sync call January 5 at 12:00 US/Eastern, 17:00 UTC

2022-01-05 Thread Eduardo Ponce
Hi all, With respect to what examples/information may be relevant to add/improve in documentation, I find that browsing GitHub issues [1] is a good place to identify some cases on how users are using Arrow. Moreover, many of the GH issues related to code examples, contain snippets of code in the r

Re: Arrow sync call January 5 at 12:00 US/Eastern, 17:00 UTC

2022-01-05 Thread Rok Mihevc
Attendees Nic Crane, Micah Kornfeld, Eduardo Ponce, Will Jones, Rok Mihevc, David Li, Niranda Perera, Benson Muite Agenda - Discussion about the new columnar memory layout - Preparing for 7.0.0 release - 2nd or 3rd week of January - Documentation improvement - Support for table like structures

Arrow sync call January 5 at 12:00 US/Eastern, 17:00 UTC

2022-01-05 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

  1   2   3   4   >