Re: Update on C++ query engine work

2021-10-07 Thread Micah Kornfield
I don't have much to add, but it is really cool to see all the progress being made here. On Wed, Sep 29, 2021 at 6:29 AM Neal Richardson wrote: > Hi all, > I wanted to give an update on work that several of us have been doing in > recent months on query processing in C++. Back in March, we circu

Re: [C++] Decimal arithmetic edge cases

2021-10-07 Thread Micah Kornfield
Do we error out regardless of scale, or does rounding occur with scale > 0? Arguably these last three cases should be: > "1" (decimal128(38, 0)) + "1" (decimal128(38, 0)) = "2" (decimal256(39, > 0)) (promote to decimal256) > "1" (decimal256(76, 0)) + "1" (decimal256(76, 0)) = "2" (decimal256(76, >

Re: Re: Re: [DISCUSS][Java] Adding GC-Based reference management strategy for buffers

2021-10-07 Thread Laurent Goujon
Worth also observing that the Java community has been recognizant of the issues with the current approach around direct byte buffer and GC, and has come up with a proposal/implementation to avoid interaction with GC and give more direct control. The proposal (actually, its 3rd iteration) is describ

Re: [DISCUSS] Deprecate user@ in favor for github issues/discussions

2021-10-07 Thread Micah Kornfield
Yeah, I think we can keep the both active. Would the experiment be removing the guidance to use user@? What do you think the success metrics would be? On Tue, Oct 5, 2021 at 8:14 AM Aldrin wrote: > > > > How about trying GitHub issues and/or discussion in a > > specified period without depreca

Re: Re: Re: [DISCUSS][Java] Adding GC-Based reference management strategy for buffers

2021-10-07 Thread Jacques Nadeau
Clearly this patch was driven by an implicit set of needs but it's hard to guess at what they are. As Laurent asked, what is the main goal here? There may be many ways to solve this goal. Some thoughts in general: - The allocator is a finely tuned piece of multithreaded machinery that is used on h

Re: [ANNOUNCE] New Arrow committer: Jiayu Liu

2021-10-07 Thread QP Hou
Congrats Jiayu, welcome to the party! --QP On Thu, Oct 7, 2021 at 3:56 AM Andrew Lamb wrote: > > Hi, > > On behalf of the Arrow PMC, I'm happy to announce that > Jiayu Liu has accepted an invitation to become a > committer on Apache Arrow. Welcome, and thank you for your > contributions! > > > A

Re: Re: Re: [DISCUSS][Java] Adding GC-Based reference management strategy for buffers

2021-10-07 Thread Micah Kornfield
In addition to the points raised by Laurent, I'm concerned about having two possible idioms in the same library. It means code written against the library becomes less portable (you need to know how the memory allocator is using GC or not). I understand manual memory management in Java is tedious

Re:Re: Re: [DISCUSS][Java] Adding GC-Based reference management strategy for buffers

2021-10-07 Thread Hongze Zhang
We don't have to concern about that since no difference will be made on current manual release path unless "MemoryChunkCleaner" is explicitly specified when creating BufferAllocators. Manual ref counting will be only discard/ignored in "MemoryChunkCleaner", while by default "MemoryChunkManager"

Re: [ANNOUNCE] New Arrow committer: Jiayu Liu

2021-10-07 Thread Jorge Cardoso Leitão
Congratulations!!! :) On Thu, Oct 7, 2021, 21:58 Weston Pace wrote: > Congratulations Jiayu Liu! > > On Thu, Oct 7, 2021 at 8:02 AM Yijie Shen > wrote: > > > > Congratulations Jianyu > > > > > > Micah Kornfield 于2021年10月8日 周五上午12:29写道: > > > > > A little late, but welcome and thank you for your

Re: [ANNOUNCE] New Arrow committer: Jiayu Liu

2021-10-07 Thread Weston Pace
Congratulations Jiayu Liu! On Thu, Oct 7, 2021 at 8:02 AM Yijie Shen wrote: > > Congratulations Jianyu > > > Micah Kornfield 于2021年10月8日 周五上午12:29写道: > > > A little late, but welcome and thank you for your contributions! > > > > On Thu, Oct 7, 2021 at 9:06 AM M G wrote: > > > > > Hi everyone, >

Re: [ANNOUNCE] New Arrow committer: Jiayu Liu

2021-10-07 Thread Yijie Shen
Congratulations Jianyu Micah Kornfield 于2021年10月8日 周五上午12:29写道: > A little late, but welcome and thank you for your contributions! > > On Thu, Oct 7, 2021 at 9:06 AM M G wrote: > > > Hi everyone, > > MG here, > > Very nice to be in such a vibrant community and wonderful technology. > > > > Cong

Re: [ANNOUNCE] New Arrow committer: Jiayu Liu

2021-10-07 Thread Micah Kornfield
A little late, but welcome and thank you for your contributions! On Thu, Oct 7, 2021 at 9:06 AM M G wrote: > Hi everyone, > MG here, > Very nice to be in such a vibrant community and wonderful technology. > > Congrats dear Jiayu Liu and thanks for your contributions. > > I suggest > Best Regards

Re: [ANNOUNCE] New Arrow committer: Jiayu Liu

2021-10-07 Thread M G
Hi everyone, MG here, Very nice to be in such a vibrant community and wonderful technology. Congrats dear Jiayu Liu and thanks for your contributions. I suggest Best Regards - *M.Ghiasi* Technology Architect - *"COVID-19 Kills! Wear a mask & regular

Re: [ANNOUNCE] New Arrow committer: Jiayu Liu

2021-10-07 Thread Jiayu Liu
Thanks Andrew and the PMC for the invitation and everyone for the warm welcome. Looking forward to more exciting features in Arrow and Datafusion! On 2021/10/07 13:39:36, Daniël Heres wrote: > Congratulations and thanks for all the work so far! > > Daniël > > Op do 7 okt. 2021 om 15:33 schree

Re: [ANNOUNCE] New Arrow committer: Jiayu Liu

2021-10-07 Thread Daniël Heres
Congratulations and thanks for all the work so far! Daniël Op do 7 okt. 2021 om 15:33 schreef David Li : > Congrats Jiayu! > > -David > > On Thu, Oct 7, 2021, at 07:21, Benson Muite wrote: > > Congratulations Jiayu Liu! > > > > On 10/7/21 1:56 PM, Andrew Lamb wrote: > > > Hi, > > > > > > On beha

Re: [ANNOUNCE] New Arrow committer: Jiayu Liu

2021-10-07 Thread David Li
Congrats Jiayu! -David On Thu, Oct 7, 2021, at 07:21, Benson Muite wrote: > Congratulations Jiayu Liu! > > On 10/7/21 1:56 PM, Andrew Lamb wrote: > > Hi, > > > > On behalf of the Arrow PMC, I'm happy to announce that > > Jiayu Liu has accepted an invitation to become a > > committer on Apache A

Re: [ANNOUNCE] New Arrow committer: Jiayu Liu

2021-10-07 Thread Benson Muite
Congratulations Jiayu Liu! On 10/7/21 1:56 PM, Andrew Lamb wrote: Hi, On behalf of the Arrow PMC, I'm happy to announce that Jiayu Liu has accepted an invitation to become a committer on Apache Arrow. Welcome, and thank you for your contributions! Andrew

[ANNOUNCE] New Arrow committer: Jiayu Liu

2021-10-07 Thread Andrew Lamb
Hi, On behalf of the Arrow PMC, I'm happy to announce that Jiayu Liu has accepted an invitation to become a committer on Apache Arrow. Welcome, and thank you for your contributions! Andrew