Re: [RESULT][VOTE] Release Apache Arrow 10.0.0 - RC0

2022-10-26 Thread Antoine Pitrou
Le 26/10/2022 à 07:37, Sutou Kouhei a écrit : Two more: - Make the CPP PARQUET related version as "RELEASED" on JIRA - Start the new version on JIRA for the related CPP PARQUET version I don't have admin permission on PARQUET. Could someone who has admin permission on PARQUET do them? Ok, I

Re: [RESULT][VOTE] Release Apache Arrow 10.0.0 - RC0

2022-10-26 Thread Sutou Kouhei
Thanks!!! Current status: - [Done] Make the released version as “RELEASED” on JIRA - [Done] Make the CPP PARQUET related version as “RELEASED” on JIRA - [Done] Start the new version on JIRA on the ARROW project - [Done] Start the new version on JIRA for the related CPP PARQUET version - [Done] Me

Re: [VOTE][Julia] Release Apache Arrow Julia 2.4.0 RC1

2022-10-26 Thread Bogumił Kamiński
+1

Re: [RESULT][VOTE] Release Apache Arrow 10.0.0 - RC0

2022-10-26 Thread Neal Richardson
I will submit the R package to CRAN. Neal On Wed, Oct 26, 2022 at 4:40 AM Sutou Kouhei wrote: > Thanks!!! > > Current status: > > - [Done] Make the released version as “RELEASED” on JIRA > - [Done] Make the CPP PARQUET related version as “RELEASED” on JIRA > - [Done] Start the new version on JI

Re: [DISCUSS] Move issue tracking to

2022-10-26 Thread Neal Richardson
Thanks Todd! That's really helpful. Neal On Tue, Oct 25, 2022 at 7:47 PM Todd Farmer wrote: > I'm beginning to track decisions needing to be made and problems needing to > be solved in the Arrow project GitHub issues, prefixing all such issues > with "MIGRATION: ..". They can be found here: > >

Re: [ANNOUNCE] New Arrow PMC member: Nicola Crane

2022-10-26 Thread Larry White
Congratulations, Nic! On Wed, Oct 26, 2022 at 2:31 AM Alenka Frim wrote: > 🎉 Congratulations Nic! Well deserved!! > > On Wed, Oct 26, 2022 at 7:54 AM Daniël Heres > wrote: > > > Congratulations! > > > > On Wed, Oct 26, 2022, 07:50 Benson Muite > > wrote: > > > > > Congratulations Nic! > > > On

Re: [ANNOUNCE] New Arrow PMC member: Nicola Crane

2022-10-26 Thread Jacob Wujciak
Congratulations! 🎉 On Wed, Oct 26, 2022 at 3:04 PM Larry White wrote: > Congratulations, Nic! > > On Wed, Oct 26, 2022 at 2:31 AM Alenka Frim .invalid> > wrote: > > > 🎉 Congratulations Nic! Well deserved!! > > > > On Wed, Oct 26, 2022 at 7:54 AM Daniël Heres > > wrote: > > > > > Congratulation

Re: [ANNOUNCE] New Arrow PMC member: Jacob Quinn

2022-10-26 Thread Jacob Wujciak
Congrats! On Wed, Oct 26, 2022 at 8:31 AM Alenka Frim wrote: > Congratulations! > > On Wed, Oct 26, 2022 at 7:54 AM Daniël Heres > wrote: > > > Congratulations! > > > > On Wed, Oct 26, 2022, 07:50 Benson Muite > > wrote: > > > > > Congratulations Jacob! > > > On 10/26/22 04:12, Vibhatha Abeyko

Re: [ANNOUNCE] New Arrow committer: Bogumił Kamiński

2022-10-26 Thread Jacob Wujciak
Congrats! On Wed, Oct 26, 2022 at 8:31 AM Alenka Frim wrote: > Congratulations! > > On Wed, Oct 26, 2022 at 7:55 AM Daniël Heres > wrote: > > > Congratulations! > > > > On Wed, Oct 26, 2022, 07:50 Benson Muite > > wrote: > > > > > Congratulations Bogumił! > > > On 10/26/22 04:13, Vibhatha Abey

Arrow sync call October 26 at 12:00 US/Eastern, 16:00 UTC

2022-10-26 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. The Zoom meeting URL for this and other biweekly Arrow sync calls is: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Alternatively, enter this information into the Zoom website or app to join the call: Meetin

Re: [ANNOUNCE] New Arrow PMC member: Nicola Crane

2022-10-26 Thread Dewey Dunnington
Congrats, Nic! On Wed, Oct 26, 2022 at 10:10 AM Jacob Wujciak wrote: > Congratulations! 🎉 > > On Wed, Oct 26, 2022 at 3:04 PM Larry White wrote: > > > Congratulations, Nic! > > > > On Wed, Oct 26, 2022 at 2:31 AM Alenka Frim > .invalid> > > wrote: > > > > > 🎉 Congratulations Nic! Well deserved

Re: [ANNOUNCE] New Arrow PMC member: Nicola Crane

2022-10-26 Thread Antoine Pitrou
Welcome, Nic! Le 26/10/2022 à 16:37, Dewey Dunnington a écrit : Congrats, Nic! On Wed, Oct 26, 2022 at 10:10 AM Jacob Wujciak wrote: Congratulations! 🎉 On Wed, Oct 26, 2022 at 3:04 PM Larry White wrote: Congratulations, Nic! On Wed, Oct 26, 2022 at 2:31 AM Alenka Frim wrote: 🎉 Con

Re: [ANNOUNCE] New Arrow PMC member: Nicola Crane

2022-10-26 Thread Raúl Cumplido
Thanks Nic for your contributions! El mié, 26 oct 2022 a las 17:17, Antoine Pitrou () escribió: > > Welcome, Nic! > > > Le 26/10/2022 à 16:37, Dewey Dunnington a écrit : > > Congrats, Nic! > > > > On Wed, Oct 26, 2022 at 10:10 AM Jacob Wujciak > > wrote: > > > >> Congratulations! 🎉 > >> > >> On

Re: Arrow sync call October 26 at 12:00 US/Eastern, 16:00 UTC

2022-10-26 Thread Neal Richardson
Attendees: Vibhatha Abeykoon Raúl Cumplido James Duong Sean Gallagher Ian Joiner Will Jones David Li Antoine Pitrou Neal Richardson Matt Topol Jacob Wujciak Discussion: Release 10.0.0: it's done, and it seemed to go smoothly. Kudos to all who have been working to make releases easier! * But sin

Re: [VOTE][Julia] Release Apache Arrow Julia 2.4.0 RC1

2022-10-26 Thread Benson Muite
+1 non binding, Rocky linux 9 $ dev/release/verify_rc.sh 2.4.0 1 and also Cent OS 7 (Signature verification fails due to older libraries) $ VERIFY_SIGN=0 dev/release/verify_rc.sh 2.4.0 1

Re: [ANNOUNCE] New Arrow committer: Bogumił Kamiński

2022-10-26 Thread Weston Pace
Congratulations Bogumił. On Wed, Oct 26, 2022 at 6:10 AM Jacob Wujciak wrote: > > Congrats! > > On Wed, Oct 26, 2022 at 8:31 AM Alenka Frim > wrote: > > > Congratulations! > > > > On Wed, Oct 26, 2022 at 7:55 AM Daniël Heres > > wrote: > > > > > Congratulations! > > > > > > On Wed, Oct 26, 2022

Re: [ANNOUNCE] New Arrow PMC member: Jacob Quinn

2022-10-26 Thread Weston Pace
Congrats Jacob! On Wed, Oct 26, 2022 at 6:10 AM Jacob Wujciak wrote: > > Congrats! > > On Wed, Oct 26, 2022 at 8:31 AM Alenka Frim > wrote: > > > Congratulations! > > > > On Wed, Oct 26, 2022 at 7:54 AM Daniël Heres > > wrote: > > > > > Congratulations! > > > > > > On Wed, Oct 26, 2022, 07:50 B

Re: [ANNOUNCE] New Arrow PMC member: Nicola Crane

2022-10-26 Thread Weston Pace
Thanks Nic and congratulations! On Wed, Oct 26, 2022 at 8:28 AM Raúl Cumplido wrote: > > Thanks Nic for your contributions! > > El mié, 26 oct 2022 a las 17:17, Antoine Pitrou () > escribió: > > > > > Welcome, Nic! > > > > > > Le 26/10/2022 à 16:37, Dewey Dunnington a écrit : > > > Congrats, Nic!

Re: [DISCUSS] Move issue tracking to

2022-10-26 Thread Ian Cook
Todd said: >User identifiers differ between systems... To help with this, I created a couple of small scripts [1] that extract details from resolved Arrow Jira issues and the associated merged GitHub PRs, then perform some cleaning, to generate a list [2] of matching Jira user identifiers and GitH

Re: [ANNOUNCE] New Arrow PMC member: Nicola Crane

2022-10-26 Thread Joris Van den Bossche
Congratulations Nic! ;) On Wed, 26 Oct 2022 at 19:26, Weston Pace wrote: > > Thanks Nic and congratulations! > > On Wed, Oct 26, 2022 at 8:28 AM Raúl Cumplido wrote: > > > > Thanks Nic for your contributions! > > > > El mié, 26 oct 2022 a las 17:17, Antoine Pitrou () > > escribió: > > > > > > >

Re: [ANNOUNCE] New Arrow PMC member: Jacob Quinn

2022-10-26 Thread Joris Van den Bossche
Congratulations! On Wed, 26 Oct 2022 at 19:25, Weston Pace wrote: > > Congrats Jacob! > > On Wed, Oct 26, 2022 at 6:10 AM Jacob Wujciak > wrote: > > > > Congrats! > > > > On Wed, Oct 26, 2022 at 8:31 AM Alenka Frim > > wrote: > > > > > Congratulations! > > > > > > On Wed, Oct 26, 2022 at 7:54 A

RE: Apache Arrow filesystem question

2022-10-26 Thread Jerry Adair
Hi- I am curious about the Apache Arrow filesystem support. I noticed that there are classes for S3 and GCS. I am currently using those classes to read/write from/to those cloud storage options. However I noticed that there is no class for Azure (ADLS). And so I am curious why that is? Doe

RE: Apache Arrow filesystem question

2022-10-26 Thread Lee, David
There are fsspec implementations to support other filesystems. https://pypi.org/project/pyarrowfs-adlgen2/ -Original Message- From: Jerry Adair Sent: Wednesday, October 26, 2022 10:59 AM To: dev@arrow.apache.org Subject: RE: Apache Arrow filesystem question External Email: Use caution

Re: Apache Arrow filesystem question

2022-10-26 Thread Jacob Wujciak
The azure implementation is underway but did not make it into 10.0.0: https://issues.apache.org/jira/browse/ARROW-2034 On Wed, Oct 26, 2022 at 7:59 PM Jerry Adair wrote: > Hi- > > I am curious about the Apache Arrow filesystem support. I noticed that > there are classes for S3 and GCS. I am cu

RE: Apache Arrow filesystem question

2022-10-26 Thread Lee, David
Or this.. https://arrow.apache.org/docs/python/filesystems.html#using-fsspec-compatible-filesystems-with-arrow import adlfs # ... load your credentials and configure the filesystem fs = adlfs.AzureBlobFileSystem(account_name=account_name, account_key=account_key) -Original Message- Fr

Re: [DISCUSS] Move issue tracking to

2022-10-26 Thread Ian Cook
I updated this user mapping list to include both the "key" and "name" fields for each Jira account. These fields sometimes do not match, and the "key" field sometimes contains unfriendly values like JIRAUSER123456. To follow further discussion about this, please see https://github.com/apache/arrow/

pyarrow.parquet.write_to_dataset - Seeking an help in addressing some customer request

2022-10-26 Thread Mahesha Nayak
Hello Team, I'm glad that I would be connecting with people who are helping in 'pyarrow' usages. my question is below snippet creating datafiles in s3 with partition keys however partition columns are not part of datafiles hence is there any way we can add the partition column in the datafiles so t

[RESULT][VOTE][RUST][Ballista] Release Apache Arrow Ballista 0.9.0 RC2

2022-10-26 Thread Andy Grove
With four binding +1 votes, the vote passes. Thank you to everyone who contributed to this release and helped with the release verification process. I will release the artifacts this evening. Thanks, Andy. On Mon, Oct 24, 2022 at 7:49 PM L. C. Hsieh wrote: > +1 (binding) > > Thanks Andy! > >

[RESULT][VOTE][Julia] Release Apache Arrow Julia 2.4.0 RC1

2022-10-26 Thread Sutou Kouhei
Hi, The vote carries with 3 +1 binding votes and 2 +1 non-binding votes. I'll publish this release to https://dist.apache.org/repos/dist/release/arrow/ . Thanks, -- kou In <20221026.055226.202954124253405503@clear-code.com> "[VOTE][Julia] Release Apache Arrow Julia 2.4.0 RC1" on Wed, 26

RE: pyarrow.parquet.write_to_dataset - Seeking an help in addressing some customer request

2022-10-26 Thread Lee, David
I couldn't find anything in the docs, but you could just append a duplicate set of column values to the table before calling write_to_dataset(). >>> for column in partitionCols: ... table = table.append_column(column + '_new', table[column]) ... >>> table pyarrow.Table animals: string animal

[ANNOUNCE] New Arrow committer: Eric Patrick Hanson

2022-10-26 Thread Sutou Kouhei
On behalf of the Arrow PMC, I'm happy to announce that Eric Patrick Hanson has accepted an invitation to become a committer on Apache Arrow. Welcome, and thank you for your contributions! kou

[ANNOUNCE] New Arrow committer: Ben Baumgold

2022-10-26 Thread Sutou Kouhei
On behalf of the Arrow PMC, I'm happy to announce that Ben Baumgold has accepted an invitation to become a committer on Apache Arrow. Welcome, and thank you for your contributions! kou

Re: [ANNOUNCE] New Arrow committer: Bogumił Kamiński

2022-10-26 Thread Ian Joiner
Congrats Bogumił! Ian On Tuesday, October 25, 2022, Sutou Kouhei wrote: > Hi, > > On behalf of the Arrow PMC, I'm happy to announce that Bogumił Kamiński > has accepted an invitation to become a committer on Apache > Arrow. Welcome, and thank you for your contributions! > > Thanks, > -- > kou >

Re: [ANNOUNCE] New Arrow PMC member: Jacob Quinn

2022-10-26 Thread Ian Joiner
Congrats Jacob! Ian On Tuesday, October 25, 2022, Sutou Kouhei wrote: > The Project Management Committee (PMC) for Apache Arrow has invited > Jacob Quinn to become a PMC member and we are pleased to announce > that Jacob Quinn has accepted. > > Congratulations and welcome! >

Re: [ANNOUNCE] New Arrow PMC member: Nicola Crane

2022-10-26 Thread Ian Joiner
Congrats Nic! Ian On Tuesday, October 25, 2022, Sutou Kouhei wrote: > The Project Management Committee (PMC) for Apache Arrow has invited > Nicola Crane to become a PMC member and we are pleased to announce > that Nicola Crane has accepted. > > Congratulations and welcome! >

Re: [ANNOUNCE] New Arrow committer: Eric Patrick Hanson

2022-10-26 Thread Ian Joiner
Congrats Eric! Ian On Wednesday, October 26, 2022, Sutou Kouhei wrote: > On behalf of the Arrow PMC, I'm happy to announce that Eric Patrick Hanson > has accepted an invitation to become a committer on Apache > Arrow. Welcome, and thank you for your contributions! > > kou >

Re: [ANNOUNCE] New Arrow committer: Ben Baumgold

2022-10-26 Thread Ian Joiner
Congrats Ben! Ian On Wednesday, October 26, 2022, Sutou Kouhei wrote: > On behalf of the Arrow PMC, I'm happy to announce that Ben Baumgold > has accepted an invitation to become a committer on Apache > Arrow. Welcome, and thank you for your contributions! > > kou >

[VOTE] Move issue tracking to GitHub Issues

2022-10-26 Thread Neal Richardson
I propose that we move issue tracking from the ASF's Jira to GitHub Issues. This has been discussed on [1] and [2] and there seems to be consensus. A number of Arrow subprojects already use GitHub Issues; this moves the issue tracking for `apache/arrow` into GitHub along with the source code. The

Re: [VOTE] Move issue tracking to GitHub Issues

2022-10-26 Thread Raphael Taylor-Davies
+1 On 27/10/2022 12:02, Neal Richardson wrote: I propose that we move issue tracking from the ASF's Jira to GitHub Issues. This has been discussed on [1] and [2] and there seems to be consensus. A number of Arrow subprojects already use GitHub Issues; this moves the issue tracking for `apache/ar

Re: [VOTE] Move issue tracking to GitHub Issues

2022-10-26 Thread L. C. Hsieh
+1 On Wed, Oct 26, 2022 at 4:08 PM Raphael Taylor-Davies wrote: > > +1 > > On 27/10/2022 12:02, Neal Richardson wrote: > > I propose that we move issue tracking from the ASF's Jira to GitHub Issues. > > This has been discussed on [1] and [2] and there seems to be consensus. A > > number of Arro

Re: [VOTE] Move issue tracking to GitHub Issues

2022-10-26 Thread Andy Grove
+1 On Wed, Oct 26, 2022 at 5:50 PM L. C. Hsieh wrote: > +1 > > > > On Wed, Oct 26, 2022 at 4:08 PM Raphael Taylor-Davies > wrote: > > > > +1 > > > > On 27/10/2022 12:02, Neal Richardson wrote: > > > I propose that we move issue tracking from the ASF's Jira to GitHub > Issues. > > > This has bee

Re: [VOTE] Move issue tracking to GitHub Issues

2022-10-26 Thread David Li
+1 On Wed, Oct 26, 2022, at 20:01, Andy Grove wrote: > +1 > > On Wed, Oct 26, 2022 at 5:50 PM L. C. Hsieh wrote: > >> +1 >> >> >> >> On Wed, Oct 26, 2022 at 4:08 PM Raphael Taylor-Davies >> wrote: >> > >> > +1 >> > >> > On 27/10/2022 12:02, Neal Richardson wrote: >> > > I propose that we move is

Re: [ANNOUNCE] New Arrow committer: Ben Baumgold

2022-10-26 Thread David Li
Welcome Ben! On Wed, Oct 26, 2022, at 17:57, Ian Joiner wrote: > Congrats Ben! > > Ian > > On Wednesday, October 26, 2022, Sutou Kouhei wrote: > >> On behalf of the Arrow PMC, I'm happy to announce that Ben Baumgold >> has accepted an invitation to become a committer on Apache >> Arrow. Welcome,

Re: [ANNOUNCE] New Arrow committer: Eric Patrick Hanson

2022-10-26 Thread David Li
Welcome Eric! On Wed, Oct 26, 2022, at 17:57, Ian Joiner wrote: > Congrats Eric! > > Ian > > On Wednesday, October 26, 2022, Sutou Kouhei wrote: > >> On behalf of the Arrow PMC, I'm happy to announce that Eric Patrick Hanson >> has accepted an invitation to become a committer on Apache >> Arrow.

Re: [VOTE] Move issue tracking to GitHub Issues

2022-10-26 Thread Jonathan Keane
+1, I'm very glad to see what will hopefully be a _slightly smoother_ experience for new contributors + issue reporters -Jon On Wed, Oct 26, 2022 at 7:05 PM David Li wrote: > +1 > > On Wed, Oct 26, 2022, at 20:01, Andy Grove wrote: > > +1 > > > > On Wed, Oct 26, 2022 at 5:50 PM L. C. Hsieh wr

Re: [ANNOUNCE] New Arrow committer: Ben Baumgold

2022-10-26 Thread Weston Pace
Congratulations Ben! On Wed, Oct 26, 2022 at 2:05 PM David Li wrote: > > Welcome Ben! > > On Wed, Oct 26, 2022, at 17:57, Ian Joiner wrote: > > Congrats Ben! > > > > Ian > > > > On Wednesday, October 26, 2022, Sutou Kouhei wrote: > > > >> On behalf of the Arrow PMC, I'm happy to announce that Be

Re: [ANNOUNCE] New Arrow committer: Eric Patrick Hanson

2022-10-26 Thread Weston Pace
Congrats Eric! On Wed, Oct 26, 2022 at 2:05 PM David Li wrote: > > Welcome Eric! > > On Wed, Oct 26, 2022, at 17:57, Ian Joiner wrote: > > Congrats Eric! > > > > Ian > > > > On Wednesday, October 26, 2022, Sutou Kouhei wrote: > > > >> On behalf of the Arrow PMC, I'm happy to announce that Eric P

Re: [VOTE] Move issue tracking to GitHub Issues

2022-10-26 Thread Jacob Quinn
+1 On Wed, Oct 26, 2022 at 5:04 PM Neal Richardson wrote: > I propose that we move issue tracking from the ASF's Jira to GitHub Issues. > This has been discussed on [1] and [2] and there seems to be consensus. A > number of Arrow subprojects already use GitHub Issues; this moves the issue > trac