[VOTE] Release Apache Arrow 10.0.0 - RC0

2022-10-20 Thread Sutou Kouhei
Hi, I would like to propose the following release candidate (RC0) of Apache Arrow version 10.0.0. This is a release consisting of 470 resolved JIRA issues[1]. This release candidate is based on commit: 89f9a0948961f6e94f1ef5e4f310b707d22a3c11 [2] The source release rc0 is hosted at [3]. The bina

Re: [WEBSITE] Blog posts on representing Structured Data with Parquet and Arrow

2022-10-20 Thread Andrew Lamb
I have received the invite -- thank you On Thu, Oct 20, 2022 at 4:41 PM Sutou Kouhei wrote: > Hi Andrew, > > I've sent you ( https://twitter.com/andrewlamb ) an > invitation to join the @ApacheArrow 's team members. Could > you confirm the invitation? You can tweet as @ApacheArrow > from htt

Re: [WEBSITE] Blog posts on representing Structured Data with Parquet and Arrow

2022-10-20 Thread Sutou Kouhei
Hi Andrew, I've sent you ( https://twitter.com/andrewlamb ) an invitation to join the @ApacheArrow 's team members. Could you confirm the invitation? You can tweet as @ApacheArrow from https://tweetdeck.twitter.com/ after you accept the invitation. Thanks, -- kou In "Re: [WEBSITE] Blog p

Re: [DISCUSS] Maintenance policy

2022-10-20 Thread Neal Richardson
On Thu, Oct 20, 2022 at 11:31 AM Jacob Wujciak wrote: > This is definitively an important topic that should be discussed. I just > want to point out that there is no difference between a major, minor or > patch release with regards to the ASF process. Any official release needs a > vote and a PMC

C# and -1 null_count

2022-10-20 Thread John Muehlhausen
if (fieldNullCount < 0) { throw new InvalidDataException("Null count length must be >= 0"); // TODO:Localize exception message } Above from Ipc/ArrowReaderImplementation.cs. pyarrow is fine with -1, probably due to the following. It would be ni

Re: [DISCUSS] Maintenance policy

2022-10-20 Thread Jacob Wujciak
This is definitively an important topic that should be discussed. I just want to point out that there is no difference between a major, minor or patch release with regards to the ASF process. Any official release needs a vote and a PMC to act as a release manager to sign & upload the release (which

Re: Go: pqarrow (github.com/apache/arrow/go/v9/parquet/pqarrow) cannot handle arrow's DICTIONARY field

2022-10-20 Thread Matt Topol
Hey Zhonghao! I'm glad you're getting good use out of the Arrow and Parquet Go implementations! You're absolutely right, pqarrow does not currently support Dictionary Arrow arrays. Support for Dictionary Arrays in the Go Arrow implementation was developed *after* the pqarrow package was created, s

Go: pqarrow (github.com/apache/arrow/go/v9/parquet/pqarrow) cannot handle arrow's DICTIONARY field

2022-10-20 Thread Zhonghao (Kevin) Yang
Hey, Arrow Go Dev: I was trying to save some arrow tables out to parquet files, with the help of the "github.com/apache/arrow/go/v9/parquet/pqarrow" package. btw, it's generally a great design (of Arrow) and a great Go implementation. However, one issue sticks out: in my original arrow Table I ha

Re: [WEBSITE] Blog posts on representing Structured Data with Parquet and Arrow

2022-10-20 Thread Andrew Lamb
I think it is a great idea to tweet it out -- can someone help me do so? On Wed, Oct 19, 2022 at 8:26 PM David Li wrote: > Andrew, what do you think about tweeting this series out through > @ApacheArrow? > > -David > > On Mon, Oct 17, 2022, at 16:50, Andrew Lamb wrote: > > And the final installm

Re: [RESULT][VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 13.0.0 RC1

2022-10-20 Thread Sutou Kouhei
Thanks!!! In "Re: [RESULT][VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 13.0.0 RC1" on Wed, 19 Oct 2022 08:31:13 -0600, Andy Grove wrote: > I added the DataFusion 13.0.0 release and created PRs to update release > instructions for both repos: > > https://github.com/apache/arrow