Re: [C++] Adding Run-Length Encoding to Arrow

Would it make sense to make a draft PR with your branch so that folks can comment on specific parts of it? Neal On Wed, Jun 1, 2022 at 10:20 AM Tobias Zagorni wrote: > Am Dienstag, dem 31.05.2022 um 12:41 -0700 schrieb Micah Kornfield: > > > > - Should we allow multiple runs of the same value f

Re: [C++] Can we remove cpp/src/arrow/dbi/hiveserver2?

If you have fixes already for building it, perhaps merge those and then remove it? That way, if we decided that we wanted to restore it (not that I expect we would), we would be reverting to something that at least built successfully. Neal On Mon, Jun 6, 2022 at 1:04 PM Micah Kornfield wrote:

Re: [VOTE] Mark C Stream Interface as Stable

+1 On Wed, Jun 8, 2022 at 7:44 PM Sutou Kouhei wrote: > +1 > > In > "[VOTE] Mark C Stream Interface as Stable" on Wed, 8 Jun 2022 11:15:29 > -0700, > Will Jones wrote: > > > Hi, > > > > Given all feedback to discussion [1] has been positive, I would like to > > propose marking the C Stream

Re: [Go][Release][Discussion] Patch release for Go libraries to address CVE-2022-28948

Personally, I don't have a problem with doing `git tag` just for Go. I don't think this needs a full patch release process since we aren't producing new artifacts that need signing, we're only adding a tag that points to a SHA in git. But I am not an expert in this area of policy and will defer to

[ANNOUNCE] New Arrow committers: Dewey Dunnington, Alenka Frim, and Rok Mihevc

On behalf of the Arrow PMC, I'm happy to announce that Dewey Dunnington Alenka Frim Rok Mihevc have all accepted invitations to become committers on Apache Arrow! Welcome, thank you for all your contributions so far, and we look forward to continuing to drive Apache Arrow forward to an even bette

Re: [Nightly builds] Crossbow nightly report page announcement + next steps

One challenge with automatically creating issues is that sometimes a single cause will make many builds fail (think python wheels or conda packages, across versions and platforms). So it may end up creating a lot of issues we have to close as duplicate (and have to track that so we don't re-create

Re: [Nightly builds] Crossbow nightly report page announcement + next steps

I've enabled the web-public option on https://ursalabs.zulipchat.com/ turned it on for the main discussion streams. Anyone can go to that URL and not only view discussions in those streams but also sign themselves up to be able to participate in discussions there. Neal On Wed, Jun 29, 2022 at 5:0

Re: Proposal: Unassign idle issues

Sounds like a good idea to me, thanks for taking the initiative on this. To Benson's idea about varying the timeout based on priority, IMO we could just start with the simple approach and see how that goes. Maybe that would be helpful but maybe it's not necessary. If you're truly watching an issue

Re: [VOTE] Release Apache Arrow 6.0.2 - RC0

+1. Thank you for doing this, Kou. Neal On Thu, Jul 14, 2022 at 5:15 PM Sutou Kouhei wrote: > +1 > > I ran the followings on Debian GNU/Linux sid: > > * TEST_DEFAULT=0 \ > TEST_GO=1 \ > dev/release/verify-release-candidate.sh 6.0.2 0 > > with: > > * go version go1.18.3 linux/amd

Re: [VOTE] Release Apache Arrow 7.0.1 - RC0

+1 Neal On Thu, Jul 14, 2022 at 5:16 PM Sutou Kouhei wrote: > +1 > > I ran the followings on Debian GNU/Linux sid: > > * TEST_DEFAULT=0 \ > TEST_GO=1 \ > dev/release/verify-release-candidate.sh 7.0.1 0 > > with: > > * go version go1.17.11 linux/amd64 > > > Thanks, > -- > kou > >

Re: [VOTE] Release Apache Arrow 8.0.1 - RC0

+1 Neal On Thu, Jul 14, 2022 at 5:17 PM Sutou Kouhei wrote: > +1 > > I ran the followings on Debian GNU/Linux sid: > > * TEST_DEFAULT=0 \ > TEST_GO=1 \ > dev/release/verify-release-candidate.sh 8.0.1 0 > > with: > > * go version go1.18.3 linux/amd64 > > > Thanks, > -- > kou > >

Re: Proposal: renaming the 'master' branch to 'main'

ng the link to > >> the previous discussion and creating the umbrella issue/breaking > >> down the tasks in Jira. > >> > >> I am happy to work on these subtasks to move the effort forward; > >> I’ll start with this subtask [1]. > >> > >>

Re: [ARROW-17255] Logical JSON type in Arrow

Sounds good to me too. +1 on the canonical extension type option; maybe it should end up as a first-class type, but I'd like to see us try it without first and see what that tells us about the path for having an extension type get promoted to being a first-class type. This is something that has bee

Re: [RESULT][VOTE] Release Apache Arrow 9.0.0 - RC2

CRAN is closed for new submissions until August 5, so I'll submit the R package next week. On Wed, Aug 3, 2022 at 7:19 AM Krisztián Szűcs wrote: > Below is the current status of the post release tasks, I > "soft-assigned" a couple of them to the relevant maintainers, could > you please help with

Re: Proposal: Allow any ASF Jira user to assign ARROW issues

+1, SGTM Neal On Wed, Aug 10, 2022 at 6:17 PM Rok Mihevc wrote: > It would be great if this friction point is removed. +1 > > Rok > > On Wed, Aug 10, 2022 at 11:36 PM Sutou Kouhei wrote: > > > +1 > > > > In > > "Proposal: Allow any ASF Jira user to assign ARROW issues" on Wed, 10 > > Aug 20

Re: DISCUSS: [C++] Switch to C++17

I have no opinion about the benefits of upgrading to C++17. From the R perspective, there are a handful of packages on CRAN that require C++14 or C++17. Last year, when I asked other R package maintainers why they hadn't upgraded to newer C++ standards, the reasoning was that because many packages

Re: R package: Why using cpp11 instead of Rcpp?

https://cpp11.r-lib.org/articles/motivations.html is a good summary of why we use cpp11. Neal On Fri, Aug 19, 2022 at 1:23 PM Mauricio Vargas Sepúlveda wrote: > Hi! > > Which was the practical reason to use cpp11 for the R package? > > I ask because now I'm in the process of creating a fork of

Re: [VOTE] Format: Rules and procedures for Canonical extension types

I agree with Micah. Moreover, adding "org.apache" does not disambiguate anything; "arrow" should be the reserved namespace for canonical (extension) types. Neal On Wed, Aug 24, 2022 at 12:31 PM Micah Kornfield wrote: > Sorry for beling late. I'm -0.5 on "org.apache.arrow." given people > previ

Re: [VOTE] Substrait for Flight SQL

+1 Neal On Thu, Sep 8, 2022 at 2:15 PM Ashish wrote: > +1 (non-binding) > > On Thu, Sep 8, 2022 at 9:41 AM Gavin Ray wrote: > > > Oh, so that's what "non-binding" means in vote threads > > Those threads make a lot more sense now, thanks for the heads-up =) > > > > On Thu, Sep 8, 2022 at 12:31

Re: [DISC] Improving Arrow's database support

On Mon, Sep 12, 2022 at 12:44 PM David Li wrote: > I like this idea. I would also like to set up some sort of automated ABI > checker as well (the options I found were GPL/LGPL so I need to figure out > how to proceed). > You should be able to use GPL software in CI, that's no problem. You can e

Re: [VOTE] Adopt ADBC database client connectivity specification

+1 (I think this makes 4 binding +1s, if I count correctly) On Wed, Oct 5, 2022 at 11:30 AM Antoine Pitrou wrote: > > +1 (binding), with the caveat that I looked mostly at the C API. > > Regards > > Antoine. > > > Le 21/09/2022 à 17:40, David Li a écrit : > > Hello, > > > > We have been discuss

Re: [DISCUSS] Maintenance policy

On Thu, Oct 20, 2022 at 11:31 AM Jacob Wujciak wrote: > This is definitively an important topic that should be discussed. I just > want to point out that there is no difference between a major, minor or > patch release with regards to the ASF process. Any official release needs a > vote and a PMC

[DISCUSS] Move issue tracking to GitHub Issues

Hi all, ASF Infra has announced [1] that, due to spam account creation, it will no longer be possible for people to sign themselves up for a Jira account to report issues as of November 6. Instead, the PMC will have to request the creation of Jira accounts. Their email says: > Infra knows this pr

Re: [DISCUSS] Move issue tracking to

t; > Hi Neal, > > Le 22/10/2022 à 15:35, Neal Richardson a écrit : > > > > Their email says: > > > >> Infra knows this process change places an increasing burden on PMC > members > >> for managing contributors, and makes it harder for people to con

Re: [DISCUSS] Move issue tracking to

I'll start a vote on this in the next day or so since it seems like we have consensus on the main issue (moving from Jira to GitHub Issues) and are working out the finer points on how we'll migrate and how we'll map Jira concepts to Issues. Speaking of the migration: now would be an *excellent* ti

Re: [VOTE] Release Apache Arrow 10.0.0 - RC0

+1 On macOS 12.6 (arm64), Python 3.9.12, I ran: TEST_DEFAULT=0 TEST_WHEELS=1 dev/release/verify-release-candidate.sh 10.0.0 and it succeeded, but some Python subprocess or something crashed in the test suite--I think it was around test_pandas or test_plasma but I wasn't paying close attentio

Re: [RESULT][VOTE] Release Apache Arrow 10.0.0 - RC0

I will submit the R package to CRAN. Neal On Wed, Oct 26, 2022 at 4:40 AM Sutou Kouhei wrote: > Thanks!!! > > Current status: > > - [Done] Make the released version as “RELEASED” on JIRA > - [Done] Make the CPP PARQUET related version as “RELEASED” on JIRA > - [Done] Start the new version on JI

Re: [DISCUSS] Move issue tracking to

to create an issue to track a decision/concern > that's not already defined. > > On Tue, Oct 25, 2022 at 6:37 AM Neal Richardson < > neal.p.richard...@gmail.com> > wrote: > > > I'll start a vote on this in the next day or so since it seems like we > have &

Re: Arrow sync call October 26 at 12:00 US/Eastern, 16:00 UTC

Attendees: Vibhatha Abeykoon Raúl Cumplido James Duong Sean Gallagher Ian Joiner Will Jones David Li Antoine Pitrou Neal Richardson Matt Topol Jacob Wujciak Discussion: Release 10.0.0: it's done, and it seemed to go smoothly. Kudos to all who have been working to make releases easier!

[VOTE] Move issue tracking to GitHub Issues

I propose that we move issue tracking from the ASF's Jira to GitHub Issues. This has been discussed on [1] and [2] and there seems to be consensus. A number of Arrow subprojects already use GitHub Issues; this moves the issue tracking for `apache/arrow` into GitHub along with the source code. The

Re: [DISCUSS] Move issue tracking to

t; Arrow Jira issues but never created an Arrow PR that was merged. > > > > Please do some sanity-checking on this list before using it. > > > > [1] https://gist.github.com/ianmcook/0f1538ebc8268a88cd4e0a0a61445287 > > [2] > https://docs.google.com/spreadsheets/d/1C8Px

Re: [VOTE] Move issue tracking to GitHub Issues

n Thu, Oct 27, 2022 at 4:25 PM Matt Topol wrote: > +1 (Non-binding) > > On Thu, Oct 27, 2022, 4:19 PM Joris Van den Bossche < > jorisvandenboss...@gmail.com> wrote: > > > +1 > > > > On Thu, 27 Oct 2022 at 07:27, Jacob Quinn > wrote: > > > &

Re: [DISCUSS] Pyarrow wheels for Python 3.11

Two unrelated thoughts: 1. Since it sounds like we need to do a patch release for the wheels, should we include any other critical bugfixes that have been reported affecting 10.0.0? Do we have a 10.0.1 Fix Version in Jira already, and/or any known issues we would want to include? 2. Since I said "

Re: [DISCUSS] Docs site for ADBC

Would it be feasible to make it arrow.apache.org/docs/adbc, and nightly under arrow.apache.org/docs/dev/adbc, for consistency with the rest of the docs? Neal On Tue, Nov 8, 2022 at 8:27 AM David Li wrote: > Thanks! Yes, I was looking at how the Cookbook works and plan to use the > same setup. I

Re: [VOTE][Julia] Release Apache Arrow Julia 2.4.1 RC0

+1 Verified on Intel macOS 13 Neal On Thu, Nov 17, 2022 at 9:00 AM Raúl Cumplido wrote: > +1 > > Tested on Ubuntu 22.04.1 LTS > > El jue, 17 nov 2022 a las 14:42, David Li () > escribió: > > > +1 (binding) > > > > Tested on AMD64/Linux (Ubuntu 18.04) > > > > On Thu, Nov 17, 2022, at 07:18, Eri

Re: Arrow sync call November 23 at 12:00 US/Eastern, 17:00 UTC

> - This creates an immediate need to modify the PR merge script; Raúl > opened an issue for this after the call [6]; this also raises the > question of whether we still need the PR merge script or whether > committers can use the "Squash and merge" button in the GitHub web UI > instead > I think

ASF Infra Survey

ASF Infra is running a survey and would like feedback from any committer. Cross-posting here in case folks aren't on the infra mailing list. If you have opinions you would like to share, please see the link below. Neal -- Forwarded message - From: Chris Thistlethwaite Date: Thu,

Re: [ANNOUNCE] New Arrow committer: Raúl Cumplido

Congratulations! > On Dec 6, 2022, at 6:11 AM, vin jake wrote: > > Congratulations Raúl !! > >> On Tue, Dec 6, 2022 at 7:11 PM Rok Mihevc wrote: >> >> Congrats Raul!! >> >>> On Tue, Dec 6, 2022 at 12:04 PM Andrew Lamb wrote: >>> >>> Congratulations Raúl >>> >>> On Tue, Dec 6, 2022 at 2

Re: Request for Patch release of 10.0.2

I don't see a problem cherry-picking commits to the maintenance branch--seems like that's what it should be for, right? Neal On Thu, Dec 15, 2022 at 11:17 AM Matt Topol wrote: > @Kou It looks like we're going to just have a branch as an un-official > patched version that can solve Laurent's iss

Re: [ANNOUNCE] New Arrow committer: Jacob Wujciak

Congrats! On Thu, Dec 15, 2022 at 7:00 PM Ian Cook wrote: > Herzlichen Glückwunsch, Jacob! > > On Thu, Dec 15, 2022 at 6:56 PM Rok Mihevc wrote: > > > > Congrats Jacob!! > > > > Rok > > > > On Fri, Dec 16, 2022 at 12:52 AM Vibhatha Abeykoon > > wrote: > > > > > Congratulations Jacob!!! > > > >

Re: [ANNOUNCE] New Arrow PMC chair: Andrew Lamb

Congratulations! On Mon, Dec 26, 2022 at 4:38 PM Matt Topol wrote: > Congrats!!! > > On Mon, Dec 26, 2022, 12:47 PM Jacob Wujciak > > wrote: > > > Congratulations Andrew! > > > > Matthew Turner schrieb am Mo., 26. Dez. > > 2022, 16:44: > > > > > Congratulations, Andrew! > > > > > > From: Yijie

Re: [VOTE] Release Apache Arrow 11.0.0 - RC0

I received an email this morning from the CRAN maintainers about a C++ build failure on clang 16. Although clang 16 is not scheduled for release until March, CRAN wants to ensure that all packages build successfully on it when it becomes available, so they've given us an ultimatum to fix the issue

Re: Norms for adopting PRs

Correct, it does. So as long as you base your branch off of the original contributor's PR, or cherry-pick their commit(s) into yours, the attribution should show up. Neal On Wed, Jan 25, 2023 at 10:54 AM Antoine Pitrou wrote: > > Le 25/01/2023 à 16:47, Julian Hyde a écrit : > > A common practic

Re: [RESULT][VOTE] Release Apache Arrow 11.0.0 - RC0

> > * Proceed with RC0, fix for 12.0.0 (and 11.0.1, should it happen), > > and > > >> > > cherry-pick the fix into the bundle we upload to CRAN for 11.0.0. > > (This > > >> > is > > >> > > something we do regularly, not a cr

Re: [DISCUSS] The default commit message for merge button

+1, with or without description Neal On Tue, Jan 31, 2023 at 11:04 AM Weston Pace wrote: > +1 to both. This only applies to the merge button and, in that case, the > committer has a chance to review the message before merging. So if there > is garbage in the description hopefully they can cat

Re: [C++] Parquet and Arrow overlap

Would it make sense to transfer all governance of the parquet-cpp implementation to Apache Arrow? It seems like that's where we de facto are already, so that would resolve these ambiguities and put it in line with the Rust implementation. Would the Parquet PMC be opposed to formalizing this change

Re: [ANNOUNCE] New Arrow PMC member: Will Jones

Congrats, Will! On Mon, Mar 13, 2023 at 2:37 PM Anja wrote: > Congrats, Will!! =) > > On Mon, 13 Mar 2023 at 11:23, Weston Pace wrote: > > > Congratulations Will! > > > > On Mon, Mar 13, 2023, 11:22 AM Ian Cook wrote: > > > > > Congratulations Will! > > > > > > On Mon, Mar 13, 2023 at 1:58 PM

Re: updating arrow binaries for Linux on CRAN

Or, possibly you're on an older version of R, and CRAN no longer builds binary packages for your version. Regardless, CRAN doesn't host binary packages for Linux, and we have no control over what binaries/versions they do host, so unfortunately there's nothing the Arrow community can do about what

Re: [VOTE][Julia] Release Apache Arrow Julia 2.5.2 RC1

+1 (Intel Mac) Neal On Wed, Apr 19, 2023 at 1:20 PM Jacob Quinn wrote: > +1 (macOS M1) > > -Jacob > > On Tue, Apr 18, 2023 at 1:59 AM Sutou Kouhei wrote: > > > Hi, > > > > I would like to propose the following release candidate (RC1) of > > Apache Arrow Julia version 2.5.2. > > > > This releas

Re: [VOTE] Formalize how to change format

+1, thanks for taking the initiative on this! Neal On Mon, Apr 24, 2023 at 6:10 AM Andrew Lamb wrote: > +1 > > > On Mon, Apr 24, 2023 at 1:55 AM David Li wrote: > > > +1 > > > > Thanks Kou! > > > > On Mon, Apr 24, 2023, at 11:53, Sutou Kouhei wrote: > > > +1 > > > > > > In <20230424.103259.664

Re: [WEBSITE] [DISCUSS] Arrow-Site blog post

Thanks for following up on this. Just a point of order: I don't think PMC approval or voting is required to merge to arrow-site. Though I agree that it's always good to get more eyes on things we publish to the web. Neal On Fri, Apr 28, 2023 at 6:33 PM Will Jones wrote: > Thanks for highlightin

Re: [ANNOUNCE] New Arrow PMC member: Matt Topol

Congratulations! On Wed, May 3, 2023 at 1:58 PM Jacob Wujciak wrote: > Congratulations, well deserved! > > On Wed, May 3, 2023 at 7:48 PM Weston Pace wrote: > > > Congratulations! > > > > On Wed, May 3, 2023 at 10:47 AM Raúl Cumplido > > wrote: > > > > > Congratulations Matt! > > > > > > El mi

Re: [DISCUSS] Interest in a 12.0.1 patch?

Hi all, checking back in about the patch release. Do we have a timeline for when we plan to do it? Looks like Weston's PR is about ready to go, and I believe that was the last outstanding issue. Neal On Fri, May 19, 2023 at 5:30 AM Sutou Kouhei wrote: > Sure! > > In > "Re: [DISCUSS] Interest

Re: Webassembly?

Thanks, Joe. Looking forward to seeing this come together. Neal On Mon, Jul 3, 2023 at 11:29 AM Joe Marshall wrote: > Hi, > > I'm a pyodide developer amongst other things (webassembly cpython > intepreter) and I've got some PRs in progress on arrow relating to > webassembly support. I wondered

Re: [DISCUSS][Format] Draft implementation of string view array format

Since this is now the second time that the proposal of a new type has raised the "alternative layout" question, I'm going to start a new thread about that. Neal On Wed, Jul 12, 2023 at 11:37 AM Pedro Eugenio Rocha Pedreira wrote: > Hi all, this is Pedro from the Velox team at Meta. Chiming in h

[DISCUSS] Canonical alternative layout proposal

Hi all, As was previously raised in [1] and surfaced again in [2], there is a proposal for representing alternative layouts. The intent, as I understand it, is to be able to support memory layouts that some (but perhaps not all) applications of Arrow find valuable, so that these nearly Arrow system

Re: [VOTE][Format] Add Utf8View Arrays to Arrow Format

+1 Thanks all for the thoughtful discussions here. Neal On Fri, Aug 18, 2023 at 4:14 AM Raphael Taylor-Davies wrote: > +1 (binding) > > Despite my earlier misgivings, I think this will be a valuable addition > to the specification. > > To clarify I've interpreted this as a vote on both Utf8Vie

Re: [Discuss] Do we need a release verification script?

I would be curious how old that language is in the ASF policy. In the era of cloud infrastructure and public CI, "your own hardware" might mean something different than it once did. IMO, it is essential that we download and test the release artifacts in a separate context from where they are built

Re: [DISCUSS][C++] Raw pointer string views

Agreed, it's unfortunately not just a simple tradeoff. We have discussed this a bit in [1] and in several other threads around this topic. If we say that Arrow is about interchange and not execution, so we shouldn't adopt the pointer version that DuckDB uses, that means we're also making interchang

Re: [ANNOUNCE] New Arrow PMC member: Jonathan Keane

Congratulations! On Sun, Oct 15, 2023 at 1:35 PM Bryce Mecum wrote: > Congratulations, Jon! > > On Sat, Oct 14, 2023 at 9:24 AM Andrew Lamb wrote: > > > > The Project Management Committee (PMC) for Apache Arrow has invited > > Jonathan Keane to become a PMC member and we are pleased to announce

Re: [Format] C Data Interface integration testing

Nice work! Neal On Thu, Oct 19, 2023 at 4:01 PM Antoine Pitrou wrote: > > Hello again, > > Quick update: the C++, C#, Go and Java implementations now all > participate in C Data Interface integration testing. > > (this helped us fix a few interoperability bugs, and add deterministic > releasing

Re: [ANNOUNCE] New Arrow PMC member: Raúl Cumplido

Congratulations! On Mon, Nov 13, 2023 at 3:10 PM Matt Topol wrote: > Congratulations Raul!! > > On Mon, Nov 13, 2023, 3:09 PM Antoine Pitrou wrote: > > > > > Welcome Raul, we're glad to have you! > > > > Regards > > > > Antoine. > > > > > > Le 13/11/2023 à 20:27, Andrew Lamb a écrit : > > > The

Re: [ANNOUNCE] New Arrow committer: Bryce Mecum

Congratulations! On Mon, Mar 18, 2024 at 6:45 AM Rok Mihevc wrote: > Congrats and welcome Bryce! > > On Mon, Mar 18, 2024 at 11:07 AM Andrew Lamb wrote: > > > Congratulations Bryce! > > > > On Mon, Mar 18, 2024 at 3:35 AM Alenka Frim > .invalid> > > wrote: > > > > > Congratulations Bryce and t

Re: [VOTE] Release Apache Arrow 17.0.0 - RC2

Adam, Yes, I saw that when it was introduced here, on a PR I did: https://github.com/apache/arrow/runs/25894658283 It's on the smallest scale factor and on two of the queries ( https://github.com/voltrondata-labs/arrowbench/blob/main/R/tpch-queries.R#L510-L535 and https://github.com/voltrondata-la

Re: [JIRA] Request contributor role

Hi Bob, have you subscribed to the dev@arrow.apache.org mailing list? If you're having trouble sending messages to the list, that would definitely help. (I'm one of the moderators for the list, and I notice that many of your messages are requiring approval, which usually only happens when non-subsc

Re: [VOTE] Accept donation of Rust Ballista project

+1 (binding) Neal On Sun, Mar 21, 2021 at 10:38 AM Francis Du wrote: > I have been following Ballista for a long time. This is an exciting thing. > I am also very happy to contribute to this. > > So +1 > > Regards, > Fracnis > > On Sun, 21 Mar 2021 at 23:56, Andy Grove wrote: > > > Dear all, >

Re: [R][Rust][IPC] Attempting to pass RecordBatch from R to Rust via C ABI

I'd recommend looking at how we use the C data interface to pass data between Python and R. On the R side, see https://github.com/apache/arrow/blob/master/r/R/python.R and https://github.com/apache/arrow/blob/master/r/src/py-to-r.cpp. I believe the Rust library has support for the C data interface

Re: [R][Rust][IPC] Attempting to pass RecordBatch from R to Rust via C ABI

> > rb <- arrow::record_batch(mtcars) > > bytes <- arrow::write_to_raw(rb, "stream") > > > > > - > > > > The raw (byte) vector from that can be correctly interpreted by an > > arrow::ipc::reader::StreamReader in Rust.

Arrow sync call March 31 at 12:00 US/Eastern, 16:00 UTC

Hi all, Our biweekly call is coming up tomorrow at https://meet.google.com/vtm-teks-phx. All are welcome to join. I won't be able to attend this week, but hopefully someone else will share notes with the mailing list afterward. Neal

4.0 release preparation

Hi all, It's release time again. By our quarterly release pace, we are scheduled for an April 4.0.0 release. Given the time it takes to prepare and approve a release, I think we should aim to close out our release scope by the end of this week, beginning of next at latest, so that we can ensure a r

Re: [NIGHTLY] Arrow Build Report for Job nightly-2021-04-06-0

I just checked crossbow's logs and the jpype build has been failing since October 26 (i.e., we're coming up on 6 months of solid failure). I don't know the use case for why we have it, but if we are going to ignore a failing build for 6 months (seemingly without repercussion), we should probably de

Re: [C++] (Eventually) merging asynchronous datasets feature

Three thoughts: 1. Given that lots of prerequisite patches have already merged, and we've seen some instability as a result of those, I don't think it's obviously true that holding ARROW-7001 out of 4.0 is lower risk. It could be that the intermediate state we're in now is higher risk. What do you

Re: Standard/Reserved Metadata keys

Like Pandas, in the R package we store R-specific metadata in the schema; this lets us preserve all R class and other attributes when round-tripping data to Feather or Parquet. These are not stored in a way that is readable or useful to other implementations, partly by design. If there were type in

Re: 4.0 release preparation

a blocker. We'll not release > deb/rpm packages when we release 4.0. We can release > deb/rpm packages later. > > > Thanks, > -- > kou > > > In > "4.0 release preparation" on Mon, 5 Apr 2021 19:39:30 -0700, > Neal Richardson wrote: > &

Re: [DISCUSS] [Rust] Move Rust components to new repos and process

Thanks, Andy. Two areas of concern I think we should have some answer for before going forward with this (and I make no opinions as to what the "right" answers are, just raising them for discussion): 1. Integration testing: what is our workflow for ensuring that our implementations are integration

Re: 4.0 release preparation

ubuntu-18.04-docs: > > ARROW-11633 (This is the intermittent Java failure that has been > > popping up in CI. I did some investigation and there may be some > > options to reduce these failures which I've added to the JIRA) > > - test-ubuntu-20.04-cpp-thread-sanitizer:

Re: 4.0 release preparation

I think we're getting close to closing out 4.0. Let's give until the end of Wednesday to get any outstanding pull requests reviewed and merged, and Krisztián will plan to cut a release candidate on Thursday. If there are any objections, please speak up! Neal On Sun, Apr 11, 2021 at 9:15 AM Antoi

Re: [Github] @mentions in commits.

Thanks for staying on top of this, Diana! Neal On Tue, Apr 13, 2021 at 2:06 PM Diana Clarke wrote: > I've resolved the following ticket, as GitHub says the notification > bug has been fixed. > > [Developer] Remove @-mentions from commit messages in merge tool > https://issues.apache.org

Arrow sync call April 14 at 12:00 US/Eastern, 16:00 UTC

Hi all, Our biweekly call is coming up tomorrow at https://meet.google.com/vtm-teks-phx. All are welcome to join. Notes will be shared with the mailing list afterward. Neal

Re: [JIRA Permissions] Requesting change to "Contributor"

Done! Neal On Wed, Apr 14, 2021 at 9:36 AM Sarah Gilmore wrote: > Hi all, > > I just created a Jira issue > and I would like to be > added as a Jira contributor so that I can assign the issue to myself. My > Jira username is sgilmore. If this

Re: [VOTE] Release Apache Arrow 4.0.0 - RC3

+1 (binding) GitHub Actions verifications are green and R artifact builds are successful. Neal On Mon, Apr 26, 2021 at 6:02 AM Krisztián Szűcs wrote: > On Sun, Apr 25, 2021 at 10:59 PM Sutou Kouhei wrote: > > > > Here: https://github.com/apache/arrow/pull/10126 > I've incorporated the automat

Re: [VOTE] Release Apache Arrow 4.0.0 - RC3

Krisztián Szűcs wrote: > The VOTE carries with 4 binding +1 and 5 non-binding +1 votes. > > Thanks everyone! > > I'm starting the post release tasks and keep you posted about the > current status. > > On Mon, Apr 26, 2021 at 6:06 PM Neal Richardson > wro

Re: [VOTE] Release Apache Arrow 4.0.0 - RC3

s2 > > > >>>>>>> 15. [nealrichardson] update R packages > > > >>>>>>> 16. [ ] update docs > > > >>>>>>> > > > >>>>>>> The JS post release task is failing with: > > > >

Re: [VOTE] Release Apache Arrow 4.0.0 - RC3

37:04 -0500, > Paul Taylor wrote: > > > JS packages have been uploaded. > > > > Paul > > > > On 4/27/21 9:47 AM, Neal Richardson wrote: > >> R package has been accepted by CRAN. > >> > >> Neal > >> > >> On Tue, Apr

Arrow sync call April 28 at 12:00 US/Eastern, 16:00 UTC

Hi all, Our biweekly call is coming up tomorrow at https://meet.google.com/vtm-teks-phx. All are welcome to join. Notes will be shared with the mailing list afterward. Neal

[ANNOUNCE] New Arrow committer: Jonathan Keane

On behalf of the Arrow PMC, I'm happy to announce that Jonathan has accepted an invitation to become a committer on Apache Arrow. Welcome, and thank you for your contributions! Neal

[ANNOUNCE] New Arrow committer: Ian Cook

On behalf of the Arrow PMC, I'm happy to announce that Ian has accepted an invitation to become a committer on Apache Arrow. Welcome, and thank you for your contributions! Neal

Re: Arrow sync call April 28 at 12:00 US/Eastern, 16:00 UTC

Attendees: Nate Bauernfeind Ian Cook Nic Crane Jonathan Keane Micah Kornfield Andrew Lamb Rok Mihevc Ruan Pearce-Authers Prudhvi Porandla Neal Richardson Ying Zhou Discussion: * 4.0 release: done! Watch out for issues that might merit a patch release, raise on the mailing list. Note that Rust

Re: [RUST] Proposal for more frequent Rust Arrow release process

In case it's not clear where `comdev@` is (it wasn't at all to me), here's the thread Julian referenced: https://lists.apache.org/thread.html/rf12538ef0f60f7257e63391e5d4962a6156564020c99d3dfb193f4d7%40%3Cdev.community.apache.org%3E Neal On Mon, May 3, 2021 at 1:25 PM Julian Hyde wrote: > If yo

Re: [VOTE] Register media types (MIME types) for Apache Arrow formats to IANA

+1 Neal On Tue, May 4, 2021 at 9:56 AM Jorge Cardoso Leitão < jorgecarlei...@gmail.com> wrote: > +1 > > Also, great process, Weston. > > Best, > Jorge > > > > On Tue, May 4, 2021 at 6:48 PM Antoine Pitrou wrote: > > > > > +1 from me. Thank you for doing this! > > > > Regards > > > > Antoine. >

Re: [ANNOUNCE] New Arrow PMC member: Benjamin Kietzman

Congrats Ben! Neal On Wed, May 5, 2021 at 4:16 PM Eduardo Ponce wrote: > Great news! Congratulations Ben. > > ~Eduardo > > > From: Wes McKinney > Sent: Wednesday, May 5, 2021, 7:10 PM > To: dev > Subject: [ANNOUNCE] New Arrow PMC member: Benjamin Kietzman > > T

Arrow sync call May 12 at 12:00 US/Eastern, 16:00 UTC

Hi all, Our biweekly call is coming up at the top of the hour at https://meet.google.com/vtm-teks-phx. All are welcome to join. Notes will be shared with the mailing list afterward. Neal

Re: Arrow sync call May 12 at 12:00 US/Eastern, 16:00 UTC

Attendees: Jim Apple Ian Cook Nic Crane Prem Sagar Gali Jonathan Keane Micah Kornfield David Li Rok Mihevc Niranda Perera Eduardo Ponce Gyan Prakash Neal Richardson Aster Rosa Naman Udasi Discussion: * Interval type: Micah is working on implementations in C++ and Java. Note that Parquet uses

[DISCUSS] 4.0.1 patch release?

Hi, As discussed at the biweekly sync call, I wanted to gauge interest in doing a 4.0.1 patch release. There currently are 14 issues in JIRA tagged with 4.0.1 [1]. There are 3 segfaults, including one that a cuDF maintainer raised yesterday [2] in requesting a patch release. I don't want to bias

Re: [DISCUSS] 4.0.1 patch release?

ssues in a patch release sounds like a > good idea to me. > > On Wed, May 12, 2021 at 6:18 PM Jorge Cardoso Leitão > wrote: > > > > I agree. Segfaults are not nice. > > > > I can take it. I would possibly need some guidance. > > > > Best, > &g

Re: [DISCUSS] 4.0.1 patch release?

gt; > On the Rust side; we can either bump 4.1.0 or cherry-pick for a 4.0.1. I > suggest 4.0.1 to keep parity as we recently agreed, but let me know if > others disagree. > > [1] https://github.com/apache/arrow-rs/pull/289 > > > > On Thu, May 13, 2021 at 5:54 PM

Re: [DISCUSS] 4.0.1 patch release?

recreated the maintenance branch and resolved the conflicts. > > > > According to the release curation script [1], we have 4 issues > without > > > > available patches: > > > > - https://issues.apache.org/jira/browse/ARROW-12769 (Joris has just > > >

Re: Nightly Builds Repors 2021-05-17

Could even use GitHub Pages on top of that to render a static dashboard. On Tue, May 18, 2021 at 6:50 AM Jonathan Keane wrote: > Thanks for the comments + tickets Krisztián all of those sound like > good enhancements to this process. > > On the point of: > >> Error type: Internal > > I find it

Arrow sync call May 26 at 12:00 US/Eastern, 16:00 UTC

Hi all, Our biweekly call is tomorrow at https://meet.google.com/vtm-teks-phx. All are welcome to join. Notes will be shared with the mailing list afterward. Neal

Re: [ANNOUNCE] New Arrow committer: Dominik Moritz

Congratulations! Neal On Wed, Jun 2, 2021 at 3:23 PM Brian Hulette wrote: > Congratulations Dominik! Well deserved! > > Really excited to see some momentum in the JavaScript library > > On Wed, Jun 2, 2021 at 2:44 PM Dominik Moritz wrote: > > > Thank you for the warm welcome, Wes. > > > > I l

  1   2   3   4   5   6   7   8   9   >