Re: [VOTE][RUST] Release Apache Arrow Rust 15.0.0 RC1

+1 (non-binding) verified on Intel Mac. Thanks Andrew! On Fri, May 27, 2022 at 6:35 AM Andy Grove wrote: > > +1 (binding) > > Verified on Ubuntu 20.04.4 LTS > > Thanks, Andrew! > > On Fri, May 27, 2022 at 7:10 AM Remzi Yang <1371656737...@gmail.com> wrote: > > > +1 (non-binding) > > > > Verified

Re: [VOTE][RUST] Release Apache Arrow Rust 16.0.0 RC1

+1 (non-binding) verified on M1 Mac. Thanks Andrew, Chao On Fri, Jun 10, 2022 at 11:12 PM Remzi Yang <1371656737...@gmail.com> wrote: > > +1 (non-binding) > > Verified on Mac M1 > > Thanks, Andrew > > On Sat, 11 Jun 2022 at 04:40, L. C. Hsieh wrote: > > > +1 (non-binding) > > > > Verified on Int

Re: [VOTE][RUST] Release Apache Arrow Rust 17.0.0 RC1

+1 (non-binding). Verified on Intel Mac. Thanks Andrew. On Fri, Jun 24, 2022 at 5:17 PM L. C. Hsieh wrote: > > +1 (non-binding) > > Verified on Intel Mac. > > Thank you, Andrew. > > On Fri, Jun 24, 2022 at 5:00 PM Andy Grove wrote: > > > > +1 (binding) > > > > Verified on Ubuntu 20.04.4 LTS. >

Re: [VOTE][RUST] Release Apache Arrow Rust 18.0.0 RC1

+1 (non-binding) verified on Intel Mac. Thanks Andrew. Chao On Sat, Jul 9, 2022 at 10:36 AM L. C. Hsieh wrote: > > +1 (non-binding) > > Verified on Intel Mac. > > Thank you, Andrew! > > On Sat, Jul 9, 2022 at 9:36 AM Andy Grove wrote: > > > > +1 (binding) > > Verified on Ubuntu 20.04.4 LTS > >

Re: [VOTE][RUST] Release Apache Arrow Rust 19.0.0 RC1

+1 (non-binding). Verified on Intel Mac. Thanks, Andrew. Chao On Mon, Jul 25, 2022 at 12:52 AM Martin Grigorov wrote: > > +1 (non-binding) > > Tested on Ubuntu 20.04.4 x86_64 and openEuler 20.03 aarch64. > > Regards, > Martin > > On Fri, Jul 22, 2022 at 7:56 PM Andrew Lamb wrote: > > > Hi, > >

Re: [VOTE][RUST] Release Apache Arrow Rust 20.0.0 RC2

+1 (non-binding) verified on M1 Mac. Thanks Andrew! On Sat, Aug 6, 2022 at 7:45 PM QP Hou wrote: > > +1 (binding) > > On Sat, Aug 6, 2022 at 8:01 AM Andy Grove wrote: > > > +1 (binding). > > Verified on Ubuntu 20.04 LTS > > > > Thanks, Andrew! > > > > On Sat, Aug 6, 2022 at 8:00 AM Remzi Yang <1

Re: [VOTE][RUST] Release Apache Arrow Rust 22.0.0 RC1

+1 (non-binding). Verified on Intel Mac Thanks Andrew. Chao On Fri, Sep 2, 2022 at 6:23 PM Remzi Yang <1371656737...@gmail.com> wrote: > > +1 (non_binding) Verified on M1 Mac. > Thank you, Andrew. > > On Sat, 3 Sept 2022 at 08:10, Ashish wrote: > > > +1 (non-binding) > > > > Validated on M1 Mac

Re: [ANNOUNCE] New Arrow PMC member: L. C. Hsieh

Congrats LiangChi! Well deserved! Chao On Sun, Sep 4, 2022 at 8:07 AM Weston Pace wrote: > Congratulations! > > On Sun, Sep 4, 2022 at 5:04 AM Andy Grove wrote: > > > > Congratulations, L. C.! > > > > On Sun, Sep 4, 2022 at 8:09 AM Wang Xudong > wrote: > > > > > Congrats! > > > > > > David Li

Re: [ANNOUNCE] New Arrow PMC member: Raphael Taylor-Davies

Congratulations Raphael! On Tue, Sep 20, 2022 at 7:00 AM Kun Liu wrote: > > Congratulations!! > Raphael! > > David Li 于2022年9月20日周二 20:26写道： > > > Congrats, Raphael! > > > > On Tue, Sep 20, 2022, at 04:19, Tim Van Wassenhove wrote: > > > Wel deserved, congratulations! > > > > > > On Tue, Sep 20,

Re: [ANNOUNCE] New Arrow committer: Dan Harris

Congrats Dan! On Tue, Sep 20, 2022 at 10:17 AM Ian Joiner wrote: > > Congrats Dan! > > On Tue, Sep 20, 2022 at 9:10 AM Andrew Lamb wrote: > > > On behalf of the Arrow PMC, I'm happy to announce that Dan Harris > > has accepted an invitation to become a committer on Apache > > Arrow. Welcome, and

Re: [VOTE][RUST] Release Apache Arrow Rust 24.0.0 RC1

+1 (non-binding) Verified on Intel Mac. Thanks Andrew. On Sat, Oct 1, 2022 at 1:21 PM Willy Kuo wrote: > > +1 (non-binding) > Verified in my Intel MacBook > > Sent from my iPhone > > > On Oct 1, 2022, at 5:55 PM, Remzi Yang <1371656737...@gmail.com> wrote: > > > > +1 (non-binding) Verified on M

Re: [ANNOUNCE] New Arrow PMC chair: Andrew Lamb

Congrats Andrew! On Mon, Jan 2, 2023 at 11:22 PM Alenka Frim wrote: > > Congratulations! > Thank you Andrew and Kou for all your hard work! > > On Thu, Dec 29, 2022 at 6:21 AM Yang Jiang wrote: > > > > > > > On 2022/12/27 17:33:26 Micah Kornfield wrote: > > > Congrats! > > > > > > On Tue, Dec 27

Re: [ANNOUNCE] New Arrow committer: Gang Wu

Congrats Gang! On Mon, May 15, 2023 at 6:08 PM Jacob Wujciak wrote: > > Congrats! > > On Mon, May 15, 2023 at 6:53 PM Andrew Lamb wrote: > > > Congratulations! > > > > On Mon, May 15, 2023 at 10:00 AM Matthew Topol > > > > wrote: > > > > > Congrats Gang! > > > > > > On Mon, May 15, 2023, 9:57 A

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 29.0.0 RC1

+ non-binding, verified on Fedora 38 On Fri, Aug 11, 2023 at 3:16 PM Ian Joiner wrote: > +1 (non-binding) > > Verified on System 76 / Ubuntu 22.04 > > > On Fri, Aug 11, 2023 at 2:13 PM L. C. Hsieh wrote: > > > +1 (binding) > > > > Verified on M1 Mac. > > > > Thanks Andy. > > > > On Fri, Aug 11,

Re: [VOTE][Format] Add Utf8View Arrays to Arrow Format

+1 (non-binding)! On Fri, Aug 18, 2023 at 12:59 PM Felipe Oliveira Carvalho < felipe...@gmail.com> wrote: > +1 (non-binding) > > — > Felipe > > On Fri, 18 Aug 2023 at 18:48 Jacob Wujciak-Jens > wrote: > > > +1 (non-binding) > > > > On Fri, Aug 18, 2023 at 6:04 PM L. C. Hsieh wrote: > > > > > +1

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 31.0.0 RC1

+1 (non-binding). Thanks Andy! On Fri, Sep 8, 2023 at 12:18 PM Andrew Lamb wrote: > > +1 (binding) > > Thanks again Andy for keeping the release train moving forward > > Andrew > > On Fri, Sep 8, 2023 at 12:49 PM L. C. Hsieh wrote: > > > +1 (binding) > > > > Verified on M1 Mac. > > > > Thanks An

Re: [DISCUSS][Rust][DataFusion][HiveMetaStore] Possible Metastore integration with Data Fusion

I think for DataFusion to Hive metastore we just need to implement the HMS thrift API and create a client implementation. Agree this is best suited under datafusion-contrib. On Wed, Oct 4, 2023 at 4:06 AM Raphael Taylor-Davies wrote: > Hi, > > I think [1] might be a good place to start and handl

Re: [VOTE][RUST] Release Apache Arrow Rust 49.0.0 RC1

+1 (non-binding) Verified on M1 Mac. Thanks Raphael. On Thu, Nov 9, 2023 at 12:47 AM Wayne Xia wrote: > > +1 (non-binding) > > Verified on Intel Linux > > Thanks Raphael > > On Wed, Nov 8, 2023 at 6:12 AM L. C. Hsieh wrote: > > > +1 (binding) > > > > Verified on Intel Mac. > > > > Thanks Raphae

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 33.0.0 RC2

+1 (non-binding). Verified on M1 Mac. Thanks Andy. On Mon, Nov 13, 2023 at 11:16 PM Wayne Xia wrote: > > +1 (non-binding) > > Verified on amd64 linux > > Thanks Andy > > On Tue, Nov 14, 2023 at 2:25 PM vin jake wrote: > > > +1 (binding) > > > > Verified on M1 macbook > > > > Thanks Andy > > > >

Re: [ANNOUNCE] New Arrow PMC chair: Andy Grove

Congratulations Andy! And thanks Andrew for the awesome work in the past year! Chao On Mon, Nov 27, 2023 at 9:51 AM Jeremy Dyer wrote: > > Thanks for your leadership this past year Andrew and I know we are in good > hands with Andy going forward. Congrats Andy! > > - Jeremy Dyer > > Get Outlook

[DISCUSS] Donation of a Spark native engine based on DataFusion & Arrow

Hi all, We have been working on a native execution engine for Apache Spark that is heavily based on DataFusion and Arrow. Our goal is to accelerate Spark query execution via delegating Spark's physical plan execution to DataFusion's highly modular execution framework, while still maintaining the s

Re: [DISCUSS] Donation of a Spark native engine based on DataFusion & Arrow

t; 1. Would Spark itself not be a reasonable place for this work? > 2. Do you anticipate this would move with DataFusion to its own top-level > project [1] if that happens or stay within the Arrow project? > > Thanks, > Micah > > [1] https://lists.apache.org/thread/c150t1s1x0kcb3r03c

Re: [DISCUSS] Donation of a Spark native engine based on DataFusion & Arrow

> > channels will generally be more efficient than if this project is > > > separate. > > > > - Hopefully this leads to more upstream contributions to DataFusion, > > > > perhaps even allowing other projects such as Ballista to benefit from > > > > S

Re: [DISCUSS] Donation of a Spark native engine based on DataFusion & Arrow

t; > > Thanks, > > > > Andy. > > > > Andy. > > > > On Fri, Jan 12, 2024 at 3:45 PM Chao Sun wrote: > > > > > Thanks all for the positive support! > > > > > > Andy, we plan to name the project Comet (BTW if you have better

Re: [DISCUSS] Donation of a Spark native engine based on DataFusion & Arrow

ories, etc. to get something prepped for external > consumption. My experience is that spending a few days now to do this kind > of thing saves far more days in the future (and leads to higher quality). > > On Wed, Jan 17, 2024 at 9:18 AM Chao Sun wrote: > > > Hi Andy and Jacques,

Re: [DISCUSS] Donation of a Spark native engine based on DataFusion & Arrow

t to find every way > possible that we can do that. > > Looking forward to seeing the code. > > On Wed, Jan 17, 2024 at 10:13 AM Chao Sun wrote: > > > Hi Jacques, > > > > Do you mean instead of a single PR, we modify (e.g., git commit amend) > > all the commi

Re: [RESULT][VOTE] Accept donation of Comet Spark native engine

This is great. Thanks all for the support! especially Andy for helping to drive this. Best, Chao On Tue, Jan 30, 2024 at 11:53 AM Andy Grove wrote: > > On Tue, Jan 30, 2024 at 12:52 PM Andy Grove wrote: > > > The vote passes with 17 votes (11 binding). > > > > Thank you to everyone who took the

Re: [DISCUSS] Donation of a Spark native engine based on DataFusion & Arrow

1 > > > 62 > > > Bourne Again Shell1 12 16 > > > 56 > > > YAML 2 5 38 > > > 34 > > > Properties2 8 42 > > > 26 > > > SQL

Re: [VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

hairs, guiding the community, and releasing software > versions. > > >> > >> > With this existing governance experience and structure, the > new top > > >> > >> > level project will be able to function well immediately and > > >> >

Re: [ANNOUNCE] New Arrow PMC member: Neville Dipale

Congrats Neville! On Fri, Jul 30, 2021 at 5:23 AM Krisztián Szűcs wrote: > Congrats Neville! > > On 2021. Jul 30., Fri at 13:14, Rok Mihevc wrote: > > > Congrats Neville! > > > > On Fri, Jul 30, 2021 at 12:52 PM Neville Dipale > > wrote: > > > > > > Thank you everyone :) > > > > > > On Fri, 30

Re: [VOTE] Release Apache Arrow 6.0.1 - RC1

Sutou, I'm trying to evaluate the RC via building a downstream Java project by changing its dependency to 6.0.1, however it seems the staging jars are not available. Could you "close" the release candidate in Apache Nexus server? Thanks, Chao On Mon, Nov 15, 2021 at 12:25 PM Neal Richardson < nea

Re: [VOTE] Release Apache Arrow 7.0.0 - RC10

Hi Krisztián, Just curious what's the progress of publishing Maven artifacts. Thanks! Best, Chao On Thu, Feb 3, 2022 at 2:32 PM Krisztián Szűcs wrote: > I managed to upload the wheels to pypi. Here is the current status > with the updated assignments: > > 1. [done] make the released version as

Re: [VOTE] Release Apache Arrow 7.0.0 - RC10

button. > > Chao, could you verify the staged artifacts? Or is it OK to > publish the staged artifacts now? > > > Thanks, > -- > kou > > In > "Re: [VOTE] Release Apache Arrow 7.0.0 - RC10" on Tue, 8 Feb 2022 > 11:12:29 -0800, > Chao Sun wrote:

Re: [VOTE] Release Apache Arrow 7.0.0 - RC10

hed, they are immutable. Chao On Tue, Feb 8, 2022 at 1:17 PM Krisztián Szűcs wrote: > On Tue, Feb 8, 2022 at 10:01 PM Chao Sun wrote: > > > > Thanks, let me verify the artifacts and come back to this thread. > That would be great, thanks Chao! > > > > On Tue,

Re: [VOTE] Release Apache Arrow 7.0.0 - RC10

The Java Maven artifacts look good to me. I was able to upgrade Apache Spark to use the staging artifacts and all the tests successfully passed. It's also great to see the `arrow-c-data` module finally get published in this release! Chao On Tue, Feb 8, 2022 at 5:51 PM Ian Joiner wrote: > The UR

Re: [VOTE][RUST] Release Apache Arrow Rust 9.0.3 RC3

Hmm I'm running dev/release/verify-release-candidate.sh but is seeing a lot of errors like the following: thread 'arrow::arrow_writer::tests::date32_single_column' panicked at 'called `Result::unwrap()` on an `Err` value: Os { code: 24, kind: Uncategorized, message: "Too many open files" }', parqu

Re: [VOTE][RUST] Release Apache Arrow Rust 9.0.3 RC3

Thanks, yea `ulimit -n` helped to fix it. Looks good. +1 (non-binding). On Fri, Feb 11, 2022 at 9:52 AM Andrew Lamb wrote: > I have not seen this before -- perhaps `ulimit -n` needs to be raised. > > On Fri, Feb 11, 2022 at 12:34 PM Chao Sun wrote: > > > Hmm I'm run

Re: [VOTE][RUST] Release Apache Arrow Rust 9.1.0 RC1

+1 (non-binding) Verified on macos with `dev/release/verify-release-candidate.sh` and it looks good. On Sun, Feb 20, 2022 at 1:06 PM Sutou Kouhei wrote: > Hi, > > Great! > Could you also add your PGP key to > https://dist.apache.org/repos/dist/release/arrow/KEYS > ? > > The release/arrow/KEYS c

Re: [VOTE][RUST] Release Apache Arrow Rust 10.0.0 RC1

+1 (non-binding) verified on Mac. Thanks Andrew! On Mon, Mar 7, 2022 at 7:47 AM Matthew Turner wrote: > > +1 (non-binding) after running release verification script on M1 Mac. > > Thanks, Andrew. > > From: Andy Grove > Date: Monday, March 7, 2022 at 10:00 AM > To: dev > Subject: Re: [VOTE][RUST

Re: [ANNOUNCE] New Arrow committers: Raphael Taylor-Davies, Wang Xudong, Yijie Shen, and Kun Liu

Congrats all! On Wed, Mar 9, 2022 at 9:16 AM Micah Kornfield wrote: > > Congrats! > > On Wed, Mar 9, 2022 at 8:36 AM Weston Pace wrote: > > > Congratulations to all of you! > > > > On Wed, Mar 9, 2022, 4:52 AM Matthew Turner > > wrote: > > > > > Congrats all and thank you for your contributions

Re: [VOTE][RUST] Release Apache Arrow Rust 11.1.0 RC1

+1 (non-binding) thanks Andrew! On Sat, Apr 2, 2022 at 11:16 AM QP Hou wrote: > +1 (binding), thanks Andrew! > > On Fri, Apr 1, 2022 at 8:26 AM Andrew Lamb wrote: > > > > Hi, > > > > I would like to propose a release of Apache Arrow Rust Implementation, > > version 11.1.0. > > > > This release

Re: [VOTE][RUST] Release Apache Arrow Rust 12.0.0 RC1

+1 (non-binding). Tested on Mac (AMD). Thanks Andrew! On Fri, Apr 15, 2022 at 5:48 PM Andy Grove wrote: > > I ran into a problem running the release verification script. I will try > and debug tomorrow .. perhaps it is a local environmental issue or maybe I > just need to upgrade the version of

Re: [Discuss][Format] Add 32-bit and 64-bit Decimals

Any update on this proposal? I think this will be a useful addition too. I can potentially help on the Rust side implementation. Chao On Tue, Mar 8, 2022 at 1:00 PM Jorge Cardoso Leitão wrote: > > Agreed. > > Also, I would like to revise my previous comment about the small risk. > While prototyp

Re: [ANNOUNCE] New Arrow committer: Liang-Chi Hsieh

Congrats Liang-Chi! well deserved! On Wed, Apr 27, 2022 at 12:49 PM L. C. Hsieh wrote: > > Thank you, Andrew and Bryan, > I'm pleased to become an Arrow committer. Looking forward to > contributing more on Apache Arrow! > > On Wed, Apr 27, 2022 at 12:34 PM Bryan Cutler wrote: > > > > Congratulat

Re: [VOTE][RUST] Release Apache Arrow Rust 13.0.0 RC1

+1 (non-binding), verified on Intel Mac. Thanks Andrew! Chao On Fri, Apr 29, 2022 at 5:20 PM L. C. Hsieh wrote: > > +1 (non-binding), verified on Intel Mac. > > Thanks Andrew! > > > Liang-Chi > > On Fri, Apr 29, 2022 at 3:42 PM Yang hao <1371656737...@gmail.com> wrote: > > > > +1 (non-binding) >

Re: [VOTE][RUST] Release Apache Arrow Rust 14.0.0 RC1

+1 (non-binding) Verified on M1 Mac, thanks Andrew! On Sat, May 14, 2022 at 9:09 PM QP Hou wrote: > > +1 (binding) > > On Fri, May 13, 2022 at 11:12 AM Andrew Lamb wrote: > > > > Hi, > > > > I would like to propose a release of Apache Arrow Rust Implementation, > > version 14.0.0. > > > > This

Re: [Rust] Comparison when one array is sliced seems flawed.

(Changed thread title to indicate it's Rust specific) Thanks for reporting the issue Ritchie. I believe this is a bug in Rust compute kernels for comparison and posted some comments on the JIRA. Let's continue discussing there. Thanks, Chao On Thu, Jul 16, 2020 at 12:21 AM Ritchie Vink wrote:

Re: [DISCUSS][Rust] Supporting stable Rust

Thanks Andy for starting the thread. Agree that supporting stable Rust should be one of the top priorities. Instead of creating a new crate, I'd prefer to make the switch in-place in the current crate if possible. A major part of the current code base, such as compute kernels, ipc, etc., is built

Re: [DISCUSS][Rust] Supporting stable Rust

an swap notes. > > > > On Tue, Jul 28, 2020 at 11:37 AM Chao Sun wrote: > > > Thanks Andy for starting the thread. Agree that supporting stable Rust > > should be one of the top priorities. > > > > Instead of creating a new crate, I'd prefer to make the sw

Re: [ANNOUNCE] New Arrow committer: Jorge Leitão

Congrats Jorge! On Wed, Sep 30, 2020 at 9:50 AM Jorge Cardoso Leitão < jorgecarlei...@gmail.com> wrote: > I just wanna say that it is being an awesome experience working with you > folks: IMO a great balance between pragmatism and design choices, together > with a very friendly atmosphere and imp

Re: [ANNOUNCE] New Arrow committer: Andrew Lamb

Congrats Andrew! On Tue, Nov 10, 2020 at 9:21 AM Micah Kornfield wrote: > Congrats! > > On Tue, Nov 10, 2020 at 8:51 AM Ying Zhou wrote: > > > Congratulations Andrew! > > > > > On Nov 10, 2020, at 10:42 AM, Andy Grove > wrote: > > > > > > On behalf of the Arrow PMC, I'm happy to announce that

Re: [Rust] Announcement: Rust is now part of the Arrow Flight Integration Test

Congrats! this is awesome work! On Sat, Jan 9, 2021 at 4:28 AM paddy horan wrote: > This was a long time coming. Congrats and thank you to all involved! > > > > From: Andrew Lamb > Sent: Saturday, January 9, 2021 6:08:47 AM > To: dev@arrow.apache.org ; > carol.

Re: Parquet to Arrow in Java

Bumping this. We may have an upcoming use case for this as well. Want to know if anyone is actively working on this? I also heard that Dremio has internally implemented a performant Parquet to Arrow reader. Is there any plan to open source it? that could save us a lot of work. Thanks, Chao On Fr

Re: Parquet to Arrow in Java

ught I'd > share this. > > Cheers > Uwe > > On Wed, Sep 4, 2019, at 7:24 PM, Chao Sun wrote: > > Bumping this. > > > > We may have an upcoming use case for this as well. Want to know if anyone > > is actively working on this? I also heard that

Re: Rust IPC and Integration Testing

I think I suggested this. The idea is to isolate the auto-generated code from the other source files, and also to isolate future changes due to updates on either format or flatbuffers versions. IMO this makes the repo cleaner and more organized. Of course, ideally we should auto-generate these file

Re: [DISCUSS] Rust add adapter for parquet

8 at 11:03 AM Renjie Liu > wrote: > > > > > Yes, it's a mistake, sorry for that > > > > > > > > > On Mon, Aug 20, 2018 at 10:57 AM Chao Sun wrote: > > > > > >> (s/flink/arrow - it is a mistake?) > > >> > >

Re: Rust IPC and Integration Testing

rates later if that's desired. > > On Tue, Nov 20, 2018 at 6:39 PM Chao Sun wrote: > > > I think I suggested this. The idea is to isolate the auto-generated code > > from the other source files, and also to isolate future changes due to > > updates on either format or flat

Re: [DISCUSS] Rust add adapter for parquet

olve. > >> > >> On Wed, Nov 21, 2018 at 4:49 AM Andy Grove > wrote: > >> > >> > This sounds like a great idea. > >> > > >> > With support for both CSV and Parquet in the Arrow crate, it would be > nice > >> > to desi

Re: [DISCUSS] Rust add adapter for parquet

windows? I would be willing to help get windows support > working after the fact, although I know very little about parquet right now. > > > > Are there other strategies for dealing with this? > > > > Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> f

Re: [DISCUSS] Rust add adapter for parquet

n particular, would be really useful within the existing > code base. > > > > Paddy > > > > Get Outlook for iOS > > > > From: Chao Sun > > Sent: Wednesday, November 21, 2018 2:42 PM > > To: dev@arrow.apache.org > > Cc: W

Re: Rust nightly + formatting changes

One question is whether we should only restrict this on rustfmt but still use nightly for testing. Also, how often should we update the nightly version? does it require a JIRA every time? Another option is to run stable rustfmt but use nightly for CI. Since we're already running CI with stable, th

Re: Reviewing PRs (was: Re: Arrow sync call)

+1 on adding labels for languages, review states, components, etc. This makes it much easier to filter PRs. Chao On Wed, Dec 12, 2018 at 11:54 AM Krisztián Szűcs wrote: > Create a new one and set arrow-xxx as parent: > [image: image.png] > > On Wed, Dec 12, 2018 at 7:46 PM Antoine Pitrou wrote

[Rust] move parquet into a separate sub-crate

Hi, It just occurs to me that it may be a better idea to move the parquet module into a separate sub-crate by using cargo workspaces . The advantage is that we can make the project more modular (in future, we may want to add more sub-cr

Re: [Rust] move parquet into a separate sub-crate

mail.com> > Sent: Thursday, December 27, 2018 10:09 PM > To: dev@arrow.apache.org<mailto:dev@arrow.apache.org> > Subject: Re: [Rust] move parquet into a separate sub-crate > > Cool. It may also be worthy to put adapters into a separate crate. > > On Fri, Dec 28, 2018 at 4

Re: [Rust] move parquet into a separate sub-crate

> I support the idea[1]! > > Cheers, Krisztian > > [1] https://github.com/apache/arrow/pull/3050#discussion_r237412529 > > On Thu, Dec 27, 2018 at 9:10 PM Chao Sun wrote: > > > Hi, > > > > It just occurs to me that it may be a better idea to move the p

[Rust] crate versions and release process

Hi, This is related to an earlier email I sent regarding separating the Rust implementation into sub crates. See some early discussions in this PR [1]. As we could have multiple crates for the project in future (e.g., arrow, parquet, orc, gandiva), I'm wondering whether we can keep different vers

Re: [Rust] crate versions and release process

Is it a matter of > > Rust developers rather than release managers? > > > > I just want to know whether release managers need to care > > version of sub-crates or not. > > > > > > Thanks, > > -- > > kou > > > > In > > "[Rus

Re: [Rust] crate versions and release process

defer to more > > >experienced people. It might be confusing to have Apache Arrow X.Y.Z > > >and artifacts deriving from that release with different version > > >numbers. I don't see the upside to having different version numbers > > >unless you intend to releas

Re: [Rust] crate versions and release process

OK, I don't want to add much extra work to the release process. Let's use the single version for now then and perhaps revisit this in future. On Sun, Jan 6, 2019 at 10:41 AM Wes McKinney wrote: > On Sun, Jan 6, 2019 at 12:18 PM Chao Sun wrote: > > > > I think ve

Re: [VOTE] Accept donation of Rust DataFusion library for Apache Arrow

+1 (non-binding) Glad to see this coming and I think it is a great complement to existing modules, e.g., Arrow and Parquet. It also aligns with the overall direction that the project is going. Chao On Wed, Jan 23, 2019 at 9:30 AM Andy Grove wrote: > As far as I know, the majority of the PMC ar

[Rust] code style: restrict line width to 90 characters?

Hi Rust developers, Just want to know if anyone like the idea to restrict the line width to 90 characters for Rust, similar to the C++ coding style. Personally I found it helpful when you need to keep multiple windows in a monitor. This can easily be enforced via rustfmt. If there's no objection,

Re: [Rust] code style: restrict line width to 90 characters?

t ran rustfmt, and seems like it's not > reformatting at 100 characters. I support changing whatever the current > width is to 90 characters. > > Regards > Neville > > On Fri, 25 Jan 2019 at 19:49, Chao Sun wrote: > > > Hi Rust developers, > > > > Just

Re: [Rust] code style: restrict line width to 90 characters?

le: restrict line width to 90 characters? > > +1 for this suggestio. > > Chao Sun 于 2019年1月26日周六 上午2:39写道： > > > Hi Neville, there's no limit today: you'll need to add > > > > max_width = 90 > > comment_width = 90 > > > > to rustfmt.toml

Re: [ANNOUNCE] New Arrow PMC member: Andy Grove

Congratulations Andy! On Mon, Feb 4, 2019 at 10:40 AM Micah Kornfield wrote: > Congratulations. > > On Mon, Feb 4, 2019 at 10:13 AM Antoine Pitrou wrote: > > > > > Welcome on board Andy! Hopefully this will fuel Rust contributions in > > the future. > > > > Regards > > > > Antoine. > > > > > >

Re: [Rust] Rust 0.13.0 release

I’m also interested in the Parquet/Arrow integration and may help there. This is however a relative large feature and I’m not sure if it can be done in 0.13. Another area I’d like to work in is high level Parquet writer support. This issue has been discussed several times in the past. People shoul

Re: [ANNOUNCE] New Arrow committer: Paddy Horan

Congratulations Paddy! On Thu, Feb 28, 2019 at 5:52 PM paddy horan wrote: > Thanks All, > > I honored to be a part of such a great, talented community. > > P > > > From: Renjie Liu > Sent: Thursday, February 28, 2019 7:24 PM > To: dev@arrow.apache.org; emkornfi.

Re: [ANNOUNCE] New Arrow committer: Chao Sun

> > > > > wrote: > > > > > > > > > > > > Congrats Chao! > > > > > > > > > > > > Get Outlook for iOS<https://aka.ms/o0ukef> > > > > > > > > > > >

Re: Timeline for 0.13 Arrow release

Neville, I think we should be able to fix the two bugs you mentioned within this week. I'll take a look. It would be great if you can provide more details in the JIRAs (e.g., test case to reproduce). Array currently doesn't expose a bitmask API, and I don't think we need specialized implementations

Re: [ANNOUNCE] New Arrow committer: Neville Dipale

Congrats Neville! On Sat, May 11, 2019 at 9:36 AM Micah Kornfield wrote: > Congrats!! > > On Saturday, May 11, 2019, paddy horan wrote: > > > Congrats Neville! Thank you for your contributions! > > > > Get Outlook for iOS > > > > From: An

Re: [DISCUSS] Parquet C++/Rust: Rename Parquet::LogicalType to Parquet::ConvertedType

I'm +1 on the change for the Rust side as well. It probably won't be as disruptive as the C++ side. On Wed, May 29, 2019 at 7:09 AM Wes McKinney wrote: > I'm in favor of making the change -- it's slightly disruptive for > library-users, but the fix is no more complicated than a > search-and-repl

Re: [ANNOUNCE] New Arrow committer: Francois Saint-Jacques

Congrats Francois! On Wed, Jun 12, 2019 at 9:01 AM Micah Kornfield wrote: > Congrats Francois, well deserved! > > On Wed, Jun 12, 2019 at 8:46 AM Wes McKinney wrote: > > > On behalf of the Arrow PMC I'm happy to announce that Francois has > > accepted an invitation to become an Arrow committer!

Re: [ANNOUNCE] New Arrow committer: Praveen Kumar

Congratulations Praveen! On Thu, Jun 27, 2019 at 1:35 PM Micah Kornfield wrote: > Congrats Praveen! > > On Thursday, June 27, 2019, Wes McKinney wrote: > > > On behalf of the Arrow PMC I'm happy to announce that Praveen has > > accepted an invitation to become an Arrow committer! > > > > Welcom

Re: [VOTE] Release Apache Arrow 0.14.0 - RC0

On MacOS Mojave. Verified Rust and Go with verify-release-candidate.sh and they look good. I got the following error when verifying C++ though: [ 18%] Built target grpc_dependencies CMake Error at /var/folders/z3/ptkgr4kn4pv9v8g7s1fnr5mmgn/T/arrow-0.14.0.X.yYmSAqR5/apache-arrow-0.14.0/cpp/

Re: [VOTE] Release Apache Arrow 0.14.0 - RC0

s. Could you show your system Protocol Buffers > version? > > https://github.com/apache/arrow/pull/4785 will resolve this > case. It prevents using old system Protocol Buffers. > > In > "Re: [VOTE] Release Apache Arrow 0.14.0 - RC0" on Wed, 3 Jul 2019 > 00:15:54 -07

Re: [RESULT][VOTE] Release Apache Arrow 0.14.0 - RC0

Hi Sutou, Do you know whether we saw this error before? seems it has nothing to do with the patch you put. I think in the meanwhile we can just remove the lines with "[[bench]]" as they are not needed for "cargo publish". We can file a JIRA to investigate this latter. Chao On Thu, Jul 4, 2019 at

Re: Cross-implementation metadata specification, IPC details

Hi, Sorry if this is a n00b question. For the example that Jacques used in the previous thread, how does it work if the struct is nullable - shouldn't there be a is_null array between 1 and 2? For instance, with the example: list elem #0: { , null, } list elem #1: { } list elem #2: null list e

Re: Cross-implementation metadata specification, IPC details

it's there (this is similar to the Hive HS2 V6 protocol). > > One alternative to this is that rather than omitting the bitmap, its > data header metadata can be included but the buffer size is zero. > > - Wes > > On Sun, Mar 6, 2016 at 12:33 PM, Chao Sun wrote: > &g

Re: I setup a slack team to have a live channel to discuss Arrow

sunc...@apache.org - please invite. On Fri, Mar 11, 2016 at 3:42 PM, Zhe Zhang wrote: > Please invite z...@apache.org. Thanks. > > On Fri, Mar 11, 2016 at 1:25 PM Yiannis Gkoufas > wrote: > > > Hi there, would love an invite as well. > > johngou...@gmail.com > > > > Thanks!! > > > > On 11 March

Add me as contributor

Hi, I'm planning to take on ARROW-2477 . Can someone add me as contributor so I can assign the JIRA to myself? Thanks. Best, Chao

Re: Rust tasks for 0.10.0?

I'm working on ARROW-2583 (very slowly! see WIP here ) which will be a API-breaking change. It is fine to delay this after 0.10.0 release right? On Tue, Jul 24, 2018 at 8:16 PM, Andy Grove wrote: > That's fine. I'l

Re: [DISCUSS] Rust add adapter for parquet

(s/flink/arrow - it is a mistake?) Thanks Renjie for your interest. Yes, one of the next step in parquet-rs is to integrate with Apache Arrow. Actually we just had a discussion about this recently. Feel free to share your comments on the github.

[jira] [Created] (ARROW-3549) Replace i64 with usize for some bit utility functions

Chao Sun created ARROW-3549: --- Summary: Replace i64 with usize for some bit utility functions Key: ARROW-3549 URL: https://issues.apache.org/jira/browse/ARROW-3549 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-3649) Refactor MutableBuffer's resize

Chao Sun created ARROW-3649: --- Summary: Refactor MutableBuffer's resize Key: ARROW-3649 URL: https://issues.apache.org/jira/browse/ARROW-3649 Project: Apache Arrow Issue Type: Improv

[jira] [Created] (ARROW-3664) [Rust] Add benchmark for PrimitiveArrayBuilder

Chao Sun created ARROW-3664: --- Summary: [Rust] Add benchmark for PrimitiveArrayBuilder Key: ARROW-3664 URL: https://issues.apache.org/jira/browse/ARROW-3664 Project: Apache Arrow Issue Type: Sub

[jira] [Created] (ARROW-3665) Implement StructArrayBuilder

Chao Sun created ARROW-3665: --- Summary: Implement StructArrayBuilder Key: ARROW-3665 URL: https://issues.apache.org/jira/browse/ARROW-3665 Project: Apache Arrow Issue Type: Sub-task

[jira] [Created] (ARROW-3690) [Rust] add Rust to integration testing

Chao Sun created ARROW-3690: --- Summary: [Rust] add Rust to integration testing Key: ARROW-3690 URL: https://issues.apache.org/jira/browse/ARROW-3690 Project: Apache Arrow Issue Type: Test

[jira] [Created] (ARROW-3878) [Rust] Improve primitive types

Chao Sun created ARROW-3878: --- Summary: [Rust] Improve primitive types Key: ARROW-3878 URL: https://issues.apache.org/jira/browse/ARROW-3878 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-3939) [Rust] Remove macro definition for ListArrayBuilder

Chao Sun created ARROW-3939: --- Summary: [Rust] Remove macro definition for ListArrayBuilder Key: ARROW-3939 URL: https://issues.apache.org/jira/browse/ARROW-3939 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-3954) [Rust] Add Slice to Array and ArrayData

Chao Sun created ARROW-3954: --- Summary: [Rust] Add Slice to Array and ArrayData Key: ARROW-3954 URL: https://issues.apache.org/jira/browse/ARROW-3954 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-3960) [Rust] remove extern crate for Rust 2018

Chao Sun created ARROW-3960: --- Summary: [Rust] remove extern crate for Rust 2018 Key: ARROW-3960 URL: https://issues.apache.org/jira/browse/ARROW-3960 Project: Apache Arrow Issue Type: Improvement

  1   2   >