Re: [ANNOUNCE] New Arrow committer: Laurent Goujon

2024-11-25 Thread Vibhatha Abeykoon
Congratulations Laurent. Vibhatha Abeykoon On Mon, Nov 25, 2024 at 7:25 PM Weston Pace wrote: > Congratulations Laurent! > > On Mon, Nov 25, 2024 at 4:28 AM wish maple wrote: > > > Congrats! > > > > Best, > > Xuwei Fu > > > > David Li 于2024年11

Re: [VOTE] Release Apache Arrow ADBC 15 - RC1

2024-11-10 Thread Vibhatha Abeykoon
I ran the following on a Mac Sequoia USE_CONDA=1 ./dev/release/verify-release-candidate.sh 15 1 Successfully verified. +1 (non-binding) With Regards, Vibhatha Abeykoon On Mon, Nov 11, 2024 at 8:01 AM Sutou Kouhei wrote: > +1 (binding) > > I ran the following on Debian GNU/

Re: [ANNOUNCE] New Arrow PMC chair: Neil Richardson

2024-10-30 Thread Vibhatha Abeykoon
Congratulations Neil! Vibhatha Abeykoon On Wed, Oct 30, 2024 at 5:41 PM Kevin Gurney wrote: > Thank you for all of your hard work, Andy! Congratulations, Neal! > > > From: Weston Pace > Sent: Wednesday, October 30, 2024 8:07 AM > To: de

Re: [VOTE] Release Apache Arrow nanoarrow 0.6.0

2024-10-10 Thread Vibhatha Abeykoon
I verified on MacOS, I've not mentioned it in the initial response. With Regards, Vibhatha Abeykoon, PhD On Thu, Oct 10, 2024 at 7:25 PM Raúl Cumplido wrote: > +1 > > My local R is in bad shape so I have tested without R: > > TEST_R=0 dev/release/verify-release-

Re: [VOTE] Release Apache Arrow nanoarrow 0.6.0

2024-10-10 Thread Vibhatha Abeykoon
Hi, I have executed the following ``` ./verify-release-candidate.sh 0.6.0 0 ``` Release candidate 0.6.0-RC0 looks good! +1 (non-binding) With Regards, Vibhatha Abeykoon On Thu, Oct 10, 2024 at 12:28 PM Sutou Kouhei wrote: > Hi, > > I also looked at this. It seems that my jsonlit

Re: [ANNOUNCE] New Arrow committer: Will Ayd

2024-10-02 Thread Vibhatha Abeykoon
Congratulations, Will! On Wed, Oct 2, 2024 at 3:18 PM Joris Van den Bossche < jorisvandenboss...@gmail.com> wrote: > Congratulations Will, and we are happy to have you! > > On Wed, 2 Oct 2024 at 00:11, Benjamin Kietzman > wrote: > > > > Congratulations, Will! > > > > On Tue, Oct 1, 2024 at 3:07 

Re: [CROWDSOURCING] Arrow board report due October 9

2024-09-30 Thread Vibhatha Abeykoon
Hi Andy, Thanks for sharing, I have updated the Java section. With Regards, Vibhatha Abeykoon On Mon, Sep 30, 2024 at 1:48 PM Ruoxi Sun wrote: > Hi Andy, > > I've added some notes to the "Acero & Compute" section. > > Thanks. > > *Regards,* > *Rossi

[Java] Gandiva LLVM Build Issue

2024-09-25 Thread Vibhatha Abeykoon
highly appreciate some support from the Gandiva maintainers. [1] https://github.com/apache/arrow/issues/43769 [2] https://github.com/apache/arrow/pull/43978 [3] https://github.com/apache/arrow/issues/43981 With Regards, Vibhatha Abeykoon

Re: Arrow Maintainer Dashboard

2024-08-29 Thread Vibhatha Abeykoon
. This doesn't need to change but is merely an observation. With Regards, Vibhatha Abeykoon On Wed, Aug 7, 2024 at 6:51 PM Raúl Cumplido wrote: > Hi, > > If I want to filter and only see the issues with no replies for Python for > example. > > Kind regards, > > Raúl

Re: [VOTE][Julia] Release Apache Arrow Julia 2.7.3 RC1

2024-08-29 Thread Vibhatha Abeykoon
+1 (non-binding) Tested on macOS. On Thu, Aug 29, 2024 at 3:46 PM Raúl Cumplido wrote: > +1 (binding) > > Tested on Ubuntu 22.04 > > El jue, 29 ago 2024 a las 7:06, Jacob Quinn () > escribió: > > > > +1. Tested on macos. > > > > On Wed, Aug 28, 2024 at 6:00 PM Sutou Kouhei wrote: > > > > > Hi,

Re: [DISCUSS] Drop Java 11 support in Arrow

2024-08-06 Thread Vibhatha Abeykoon
Thanks Dane for once again pushing the topic on Java language support. In terms of project maintenance and long term growth, I am happy with this change. Regarding the usage of `--add-opens`, it would still be okay, given the fact that we provided that option either way. But in future, I think we

Re: [DISCUSS][Acero] Upgrading to 64-bit row offsets in row table

2024-08-06 Thread Vibhatha Abeykoon
+1 Thanks for the proposal and it is a good move. On Tue, Aug 6, 2024 at 6:35 AM Jacob Wujciak wrote: > Thanks for the clear write up in the issue and PR! > > +1 it is clear that this is something that users want and the downsides > seem minimal. > > Velox also switched to 64bit about a year ag

Re: [VOTE][Format] Bool8 Canonical Extension Type

2024-08-05 Thread Vibhatha Abeykoon
+1 (non-binding) I reviewed the spec update. On Tue, Aug 6, 2024 at 5:22 AM Jacob Wujciak wrote: > +1 (non-binding) > > Am Mo., 5. Aug. 2024 um 17:57 Uhr schrieb Dewey Dunnington > : > > > +1 (binding). Thanks for this addition! > > > > Looked through the spec and C++/Python PRs. > > > > On Mon

Re: [DISCUSS][Java] Protobuf 4.x

2024-06-19 Thread Vibhatha Abeykoon
Thanks for initiating this discussion. We recently encountered this issue [1] as mentioned in this discussion. I think this sounds like a reasonable plan to me. But I have doubts about supporting 4,x and 3.x. [1]. https://github.com/apache/arrow/issues/41997 On Fri, Jun 14, 2024 at 1:59 AM Norm

Re: [VOTE] Release Apache Arrow nanoarrow 0.5.0

2024-05-23 Thread Vibhatha Abeykoon
+1 (non-binding) I have tested on Ubuntu 22.04 ./verify-release-candidate.sh 0.5.0 0 With Regards, Vibhatha Abeykoon On Thu, May 23, 2024 at 3:21 PM Raúl Cumplido wrote: > +1 (binding) > > I've tested successfully on Ubuntu 22.04 without R. > > TEST_R=0 ./verify-release-

Re: [VOTE] Release Apache Arrow ADBC 12 - RC4

2024-05-20 Thread Vibhatha Abeykoon
+1 (non-binding) USE_CONDA=1 ./dev/release/verify-release-candidate.sh 12 4 With Regards, Vibhatha Abeykoon On Mon, May 20, 2024 at 5:50 PM David Li wrote: > My vote: +1 (binding) > > Are any other PMC members able to take a look? > > On Fri, May 17, 2024, at 23:36, Dewey D

Re: [VOTE] Release Apache Arrow 16.1.0 - RC1

2024-05-09 Thread Vibhatha Abeykoon
: * Python 3.10.12 * gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0 * openjdk version "21.0.2" 2024-01-16 * Ubuntu 22.04.4 LTS Verifying C++, Python and Java With Regards, Vibhatha Abeykoon On Thu, May 9, 2024 at 7:56 PM Gang Wu wrote: > +1 (non-binding) > > > TEST_DEFAULT

Re: [ANNOUNCE] New Arrow committer: Dane Pitkin

2024-05-07 Thread Vibhatha Abeykoon
Congratulations Dane!!! Vibhatha Abeykoon On Wed, May 8, 2024 at 4:02 AM Jacob Wujciak wrote: > Congrats! > > Am Di., 7. Mai 2024 um 23:19 Uhr schrieb Bryce Mecum >: > > > Congrats Dane! > > > > On Tue, May 7, 2024 at 5:53 AM Joris Van den Bossche > &g

Re: [VOTE] Release Apache Arrow 16.0.0 - RC0

2024-04-17 Thread Vibhatha Abeykoon
I executed the following # Verifying C++ ```bash TEST_DEFAULT=0 TEST_CPP=1 ./verify-release-candidate.sh 16.0.0 0 ``` # Verifying C++ and Python ```bash TEST_DEFAULT=0 TEST_CPP=1 TEST_PYTHON=1 verify-release-candidate.sh 16.0.0 0 ``` # Verifying C++ and Java ```bash TEST_DEFAULT=0 TEST_INTEGR

Re: [C++][Acero] Request for early review of PR on adding residual filter support to swiss join

2024-01-08 Thread Vibhatha Abeykoon
Hi Ruoxi, I am taking a look at the PR, and will continue the discussion on Github. With Regards, Vibhatha Abeykoon

Re: [ANNOUNCE] New Arrow committer: Felipe Oliveira Carvalho

2023-12-07 Thread Vibhatha Abeykoon
Congratulations Felipe. Vibhatha Abeykoon On Fri, Dec 8, 2023 at 12:25 AM David Li wrote: > Congrats Felipe! > > On Thu, Dec 7, 2023, at 13:02, Raúl Cumplido wrote: > > Congratulations Felipe! > > > > El jue, 7 dic 2023, 18:02, Dane Pitkin > > es

Re: [ANNOUNCE] New Arrow committer: James Duong

2023-11-22 Thread Vibhatha Abeykoon
Congratulations James. With Regards, Vibhatha Abeykoon, PhD On Sat, Nov 18, 2023 at 2:46 AM Ian Cook wrote: > Congratulations James! > > On Thu, Nov 16, 2023 at 3:45 AM Sutou Kouhei wrote: > > > On behalf of the Arrow PMC, I'm happy to announce that James Duong > &g

Re: [ANNOUNCE] New Arrow PMC member: Raúl Cumplido

2023-11-13 Thread Vibhatha Abeykoon
Congratulations Raúl !!! On Tue, Nov 14, 2023 at 10:54 AM wish maple wrote: > Congrats Raul! > > Best, > Xuwei Fu > > Andrew Lamb 于2023年11月14日周二 03:28写道: > > > The Project Management Committee (PMC) for Apache Arrow has invited > > Raúl Cumplido to become a PMC member and we are pleased to ann

Re: [ANNOUNCE] New Arrow committer: Xuwei Fu

2023-10-23 Thread Vibhatha Abeykoon
Congratulations Xuwei! On Mon, Oct 23, 2023 at 6:38 PM Weston Pace wrote: > Congratulations Xuwei! > > On Mon, Oct 23, 2023 at 3:38 AM wish maple wrote: > > > Thanks kou and every nice person in arrow community! > > > > I've learned a lot during learning and contribution to arrow and > > parque

Re: [ANNOUNCE] New Arrow PMC member: Jonathan Keane

2023-10-16 Thread Vibhatha Abeykoon
Congratulations Jon! On Mon, Oct 16, 2023 at 9:28 PM Kevin Gurney wrote: > Congratulations, Jonathan! > > > From: Dane Pitkin > Sent: Monday, October 16, 2023 11:52 AM > To: dev@arrow.apache.org > Subject: Re: [ANNOUNCE] New Arrow PMC member: Jonathan Keane >

Re: [ANNOUNCE] New Arrow PMC member: Dewey Dunnington

2023-06-23 Thread Vibhatha Abeykoon
Congratulations Dewey! On Fri, Jun 23, 2023 at 4:16 PM Alenka Frim wrote: > Congratulations Dewey!! 🎉 > > On Fri, Jun 23, 2023 at 12:10 PM Raúl Cumplido > wrote: > > > Congratulations Dewey! > > > > El vie, 23 jun 2023, 11:55, Andrew Lamb escribió: > > > > > The Project Management Committee (P

Re: [ANNOUNCE] New Arrow PMC member: Matt Topol

2023-05-03 Thread Vibhatha Abeykoon
Congratulations Matt! On Thu, May 4, 2023 at 7:35 AM Ian Cook wrote: > Congratulations Matt!!! > > On Wed, May 3, 2023 at 9:55 PM Yibo Cai wrote: > > > > Congrats Matt! > > > > On 5/4/23 07:07, Krisztián Szűcs wrote: > > > Congrats Matt! > > > > > > On Wed, May 3, 2023 at 11:44 PM Rok Mihevc >

Re: [ANNOUNCE] New Arrow PMC member: Will Jones

2023-03-13 Thread Vibhatha Abeykoon
Congratulations Will. On Tue, Mar 14, 2023 at 6:53 AM Gang Wu wrote: > Congrats, Will! > > Best, > Gang > > On Tue, Mar 14, 2023 at 9:21 AM Junming Chen > wrote: > > > Congrats, Will!😄 > > > > From: David Li > > Sent: Tuesday, March 14, 2023 5:16 AM > > To: dev

Re: [ANNOUNCE] New Arrow committer: Jacob Wujciak

2022-12-15 Thread Vibhatha Abeykoon
committer on Apache Arrow. > Welcome, > > and > > > > thank you for your contributions! > > > > > > > > Nic > > > -- Vibhatha Abeykoon

Re: [ANNOUNCE] New Arrow committer: Raúl Cumplido

2022-12-05 Thread Vibhatha Abeykoon
nounce that Raúl > > > Cumplido has accepted an invitation to become a committer on > > > Apache Arrow. Welcome, and thank you for your contributions! > > > > > Congratulations Raúl > > > -- Vibhatha Abeykoon

Re: Parser for ExecPlans

2022-11-09 Thread Vibhatha Abeykoon
+1 for this idea. We could visualize it as a JSON, but with its nested and lengthy nature, it would be kind of hard to show it or actually publish it when we have a very complex query. As Weston suggested, at the moment we have a lengthy Substrait test file mainly because the space is taken by the

Re: [ANNOUNCE] New Arrow committer: Curtis Vogt

2022-11-03 Thread Vibhatha Abeykoon
I'm happy to announce that Curtis Vogt > > > has accepted an invitation to become a committer on Apache > > > Arrow. Welcome, and thank you for your contributions! > > > -- Vibhatha Abeykoon

Re: [ANNOUNCE] New Arrow committer: Yang Jiang

2022-11-03 Thread Vibhatha Abeykoon
gt; > Congrats !!! > > > > > > > > > > > > > > > > > > > > > > > > > > > David Li 于2022年11月3日周四 07:31写道: > > > > > > > > > > > > > > > > > > > Congrats Yang! > > > > > > > > > > > > > > > > > > > > On Wed, Nov 2, 2022, at 17:09, Andy Grove wrote: > > > > > > > > > > > On behalf of the Arrow PMC, I'm happy to announce that > > Yang > > > > Jiang > > > > > > > > > > > has accepted an invitation to become a committer on > > Apache > > > > > > > > > > > Arrow. Welcome, and thank you for your contributions! > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- Vibhatha Abeykoon

Re: [ANNOUNCE] New Arrow committer: Will Jones

2022-10-27 Thread Vibhatha Abeykoon
Congratulations Will! On Fri, Oct 28, 2022 at 6:40 AM Li Jin wrote: > congrats! > > On Thu, Oct 27, 2022 at 9:03 PM Matt Topol wrote: > > > Congrats Will! > > > > On Thu, Oct 27, 2022 at 9:02 PM Ian Cook wrote: > > > > > Congratulations Will! > > > > > > On Thu, Oct 27, 2022 at 19:56 Sutou Kou

Re: [ANNOUNCE] New Arrow committer: Bogumił Kamiński

2022-10-25 Thread Vibhatha Abeykoon
t; > > > > On behalf of the Arrow PMC, I'm happy to announce that Bogumił Kamiński > > > has accepted an invitation to become a committer on Apache > > > Arrow. Welcome, and thank you for your contributions! > > > > > > Thanks, > > > -- > > > kou > > > -- Vibhatha Abeykoon

Re: [ANNOUNCE] New Arrow PMC member: Jacob Quinn

2022-10-25 Thread Vibhatha Abeykoon
t; The Project Management Committee (PMC) for Apache Arrow has invited > > > Jacob Quinn to become a PMC member and we are pleased to announce > > > that Jacob Quinn has accepted. > > > > > > Congratulations and welcome! > > > -- Vibhatha Abeykoon

Re: [ANNOUNCE] New Arrow PMC member: Nicola Crane

2022-10-25 Thread Vibhatha Abeykoon
gt; > > > > > > > > > > >> The Project Management Committee (PMC) for Apache Arrow has > > invited > > > > > >> Nicola Crane to become a PMC member and we are pleased to > announce > > > > > >> that Nicola Crane has accepted. > > > > > >> > > > > > >> Congratulations and welcome! > > > > > >> > > > > > > > > > > > > > > > > > -- > thanks > ashish > -- Vibhatha Abeykoon

Re: [ANNOUNCE] New Arrow committer: Dan Harris

2022-09-20 Thread Vibhatha Abeykoon
he Arrow PMC, I'm happy to announce that Dan Harris > > > has accepted an invitation to become a committer on Apache > > > Arrow. Welcome, and thank you for your contributions! > > > > > > Andrew > > > > > > -- Vibhatha Abeykoon

Re: [ANNOUNCE] New Arrow committer: Remzi Yang

2022-09-10 Thread Vibhatha Abeykoon
> > On behalf of the Arrow PMC, I'm happy to announce that Remzi Yang > > > has accepted an invitation to become a committer on Apache > > > Arrow. Welcome, and thank you for your contributions! > > > > > > Andrew > > > -- Vibhatha Abeykoon

Re: [ANNOUNCE] New Arrow committer: Yanghong Zhong

2022-09-08 Thread Vibhatha Abeykoon
e Arrow PMC, I'm happy to announce that Yanghong > Zhong > > >> > has accepted an invitation to become a committer on Apache > > >> > Arrow. Welcome, and thank you for your contributions! > > >> > > > >> > Andrew > > >> > > > >> > -- Vibhatha Abeykoon

Re: [ANNOUNCE] New Arrow PMC member: L. C. Hsieh

2022-09-07 Thread Vibhatha Abeykoon
> > The Project Management Committee (PMC) for Apache Arrow has invited > > > > > L. C. Hsieh to become a PMC member and we are pleased to announce > > > > > that L. C. Hsieh has accepted. > > > > > > > > > > Congratulations and welcome! > > > > > > > > > > -- Vibhatha Abeykoon

Re: [ANNOUNCE] New Arrow PMC member: L. C. Hsieh

2022-09-05 Thread Vibhatha Abeykoon
Congratulations! With Regards, Vibhatha Abeykoon, PhD On Mon, Sep 5, 2022 at 5:44 PM Rok Mihevc wrote: > Congrats! > > On Sun, Sep 4, 2022 at 8:14 PM Daniël Heres wrote: > > > Congratulations! > > > > On Sun, Sep 4, 2022, 19:37 L. C. Hsieh wrote: > >

Re: [ANNOUNCE] New Arrow PMC member: Weston Pace

2022-09-05 Thread Vibhatha Abeykoon
Project Management Committee (PMC) for Apache Arrow has invited > >> Weston Pace to become a PMC member and we are pleased to announce > >> that Weston Pace has accepted. > >> > >> Congratulations and welcome! > >> > > > -- Vibhatha Abeykoon

Re: Arrow FunctionRegsitry usage in Python

2022-06-23 Thread Vibhatha Abeykoon
Hello Mura, You can also take a look at the compute registration example [1], [2] in the Arrow source code to get an idea how to write a custom function and use it in C++. Assuming your objective is to add a new function to C++ permanently and use it in Python, you may need to take a look at the e

Re: [ANNOUNCE] New Arrow committers: Dewey Dunnington, Alenka Frim, and Rok Mihevc

2022-06-22 Thread Vibhatha Abeykoon
> > >> >>> On behalf of the Arrow PMC, I'm happy to announce that > > >> >>> > > >> >>> Dewey Dunnington > > >> >>> Alenka Frim > > >> >>> Rok Mihevc > > >> >>> > > >> >>> have all accepted invitations to become committers on Apache > Arrow! > > >> >>> Welcome, thank you for all your contributions so far, and we look > > forward > > >> >>> to continuing to drive Apache Arrow forward to an even better > place > > in > > >> >> the > > >> >>> future. > > >> >>> > > >> >>> Neal > > >> >> > > >> > > > > -- Vibhatha Abeykoon

Re: data-source UDFs

2022-06-06 Thread Vibhatha Abeykoon
> > > > fragments using potentially expensive directory listing. Metadata > > > > catalogs (e.g. hive) and table formats (e.g. iceberg) often have ways > > > > of storing precomputed versions of this information. A dataset that > > > > is capable of figuring out what files to scan from a catalog would be > > > > valuable. This dataset might use the same filesystem fragment to do > > > > the actual scan. > > > > > > > > * Table metadata > > > > > > > > Very similar to the catalogs discussion is the idea of "table > > > > metadata". This is less about reading data and more about describing > > > > the data. For example, metadata about any ordering of the incoming > > > > data, unique constraints, not-null constraints, etc. All of this > > > > information can be used by exec nodes to simplify query processing. > > > > For example, if you are grouping on a set of keys and one of the keys > > > > is ordered then you implement group by with a streaming (not pipeline > > > > breaking) implementation. > > > > > > > >> that allows utilizing existing Python APIs that knows how to read > data > > > >> source as a stream of record batches. > > > > > > > > We have a class called arrow::datasetOneShotFragment > > > > which knows how to convert a python iterator into a scannable source. > > > > This might serve your needs. This was also written when things were > > > > more dataset-oriented. It might also be interesting to create a > > > > python source node which does the same sort of thing, bypassing the > > > > scanner, although I don't know that there would be much concrete > > > > benefit. > > > > > > > > I hope this information is helpful! It is just background though. I > > > > think I might need to understand your needs in a bit more detail > > > > before I can offer any kind of prescriptive advice. > > > > > > > > On Fri, Jun 3, 2022 at 8:51 AM Li Jin wrote: > > > >> > > > >> Actually, "UDF" might be the wrong terminology here - This is more > of a > > > >> "custom Python data source" than "Python user defined functions". > (Although > > > >> under the hood it can probably reuse lots of the UDF logic to > execute the > > > >> custom data source) > > > >> > > > >> On Fri, Jun 3, 2022 at 2:49 PM Li Jin > wrote: > > > >> > > > >> > What Yaron is going for is really something similar to custom > data source > > > >> > in Spark ( > > > >> > > https://levelup.gitconnected.com/easy-guide-to-create-a-custom-read-data-source-in-apache-spark-3-194afdc9627a > ) > > > >> > that allows utilizing existing Python APIs that knows how to read > data > > > >> > source as a stream of record batches. > > > >> > > > > >> > > > > >> > > -- Vibhatha Abeykoon

Re: data-source UDFs

2022-06-03 Thread Vibhatha Abeykoon
h". > * In Arrow: Adding a UdfSourceExecNode into which a (source-UDF-kind > of) function can be plugged. > * In PyArrow: Following the design of scalar UDFs, and hopefully > reusing much of it. > > Cheers, > Yaron. > -- Vibhatha Abeykoon

Re: RFC: Out of Process Python UDFs in Arrow Compute

2022-05-10 Thread Vibhatha Abeykoon
it) > (2) Add a Substrait relation/expression that captures the the UDF > (3) Deserialize the Substrait relation/expression in Arrow compute and > execute the UDF (either using the approach in the current Scalar UDF > prototype or do sth else) > > Once we solved these, I think we a

Re: RFC: Out of Process Python UDFs in Arrow Compute

2022-05-06 Thread Vibhatha Abeykoon
@Li Thank you for the proposal and this discussion is very interesting. And also @Yaron, thanks for the note on the distributed execution and hard-to-debug nature when threads and processes from two systems try to perform a task seamlessly. There are very important points that are raised in this

Re: [ANNOUNCE] New Arrow committer: Liang-Chi Hsieh

2022-04-28 Thread Vibhatha Abeykoon
; > cutl...@gmail.com> > >> > > wrote: > >> > > > > > > >> > > > > > Congratulations!! That's great news and really glad to have > you on > >> > > the > >> > > > > > project! > >> > > > > > > >> > > > > > On Wed, Apr 27, 2022, 11:44 AM Andrew Lamb < > al...@influxdata.com> > >> > > wrote: > >> > > > > > > >> > > > > > > On behalf of the Arrow PMC, I'm happy to announce that > Liang-Chi > >> > > Hsieh > >> > > > > > > has accepted an invitation to become a committer on Apache > >> > > > > > > Arrow. Welcome, and thank you for your contributions! > >> > > > > > > > >> > > > > > > Andrew > >> > > > > > > > >> > > > -- Vibhatha Abeykoon

Re: [ANNOUNCE] New Arrow committers: Raphael Taylor-Davies, Wang Xudong, Yijie Shen, and Kun Liu

2022-03-14 Thread Vibhatha Abeykoon
with and learn from you all. > > > > >>>>>>>>> > > > > >>>>>>>>> -Original Message- > > > > >>>>>>>>> From: Andrew Lamb > > > > >>>>>>>>> Sent: Wednesday, March 9, 2022 8:59 AM > > > > >>>>>>>>> To: dev > > > > >>>>>>>>> Subject: [ANNOUNCE] New Arrow committers: Raphael > > > Taylor-Davies, > > > > >>>>> Wang > > > > >>>>>>>>> Xudong, Yijie Shen, and Kun Liu > > > > >>>>>>>>> > > > > >>>>>>>>> On behalf of the Arrow PMC, I'm happy to announce that > > > > >>>>>>>>> > > > > >>>>>>>>> Raphael Taylor-Davies > > > > >>>>>>>>> Wang Xudong > > > > >>>>>>>>> Yijie Shen > > > > >>>>>>>>> Kun Liu > > > > >>>>>>>>> > > > > >>>>>>>>> Have all accepted invitations to become committers on > Apache > > > > Arrow! > > > > >>>>>>>>> Welcome, thank you for all your contributions so far, and > we > > > look > > > > >>>>>> forward > > > > >>>>>>>>> to continuing to drive Apache Arrow forward to an even > better > > > > place > > > > >>>>>> in > > > > >>>>>>>> the > > > > >>>>>>>>> future. > > > > >>>>>>>>> > > > > >>>>>>>>> This exciting growth in committers mirrors the growth of > the > > > > Arrow > > > > >>>>>> Rust > > > > >>>>>>>>> community. > > > > >>>>>>>>> > > > > >>>>>>>>> Andrew > > > > >>>>>>>>> > > > > >>>>>>>>> p.s. sorry for the somewhat impersonal email; I was trying > to > > > > avoid > > > > >>>>>>>>> several very similar emails. I am truly excited for each of > > > these > > > > >>>>>>>>> individuals. > > > > >>>>>>>>> > > > > >>>>>>>> > > > > >>>>>> > > > > >>>>> > > > > > > > > > > -- Vibhatha Abeykoon

Re: [ANNOUNCE] New Arrow committer: Jacob Quinn

2022-02-24 Thread Vibhatha Abeykoon
> > >> > > > > >> Congrats Jacob! > > > > >> > > > > >> On Thu, Feb 24, 2022 at 1:50 PM Wes McKinney > > > > > wrote: > > > > >> > > > > >> > On behalf of the Arrow PMC, I'm happy to announce that Jacob > Quinn has > > > > >> > accepted an invitation to become a committer on Apache Arrow. > Welcome, > > > > >> > and thank you for your contributions! > > > > >> > > > > > >> > Wes > > > > >> > > > > > > -- Vibhatha Abeykoon

Re: [ANNOUNCE] New Arrow PMC member: QP Hou

2022-02-17 Thread Vibhatha Abeykoon
eciate all of your contributions and > > > guidance. > > > > > > > > > > > > From: Sutou Kouhei > > > > > > Date: Thursday, February 17, 2022 at 3:17 PM > > > > > > To: dev@arrow.apache.org > > > > > > Subject: [ANNOUNCE] New Arrow PMC member: QP Hou > > > > > > The Project Management Committee (PMC) for Apache Arrow has > invited > > > > > > QP Hou to become a PMC member and we are pleased to announce > > > > > > that QP Hou has accepted. > > > > > > > > > > > > Congratulations and welcome! > > > > > > > > > > -- Vibhatha Abeykoon

Re: [ANNOUNCE] New Arrow PMC chair: Kouhei Sutou

2022-01-25 Thread Vibhatha Abeykoon
Congrats Kou! On Tue, Jan 25, 2022 at 11:13 PM Ian Joiner wrote: > Congrats Kou! > > On Tuesday, January 25, 2022, Wes McKinney wrote: > > > I am pleased to announce that we have a new PMC chair and VP as per > > our newly started tradition of rotating the chair once a year. I have > > resigne

Re: [ANNOUNCE] New Arrow committer: Alessandro Molina

2022-01-05 Thread Vibhatha Abeykoon
t; ~Eduardo > > > > > > > > > > > > On Wed, Jan 5, 2022 at 7:34 AM Wes McKinney > > > > wrote: > > > > > > > > > > > > > On behalf of the Arrow PMC, I'm happy to announce that > Alessandro > > &

Re: [ANNOUNCE] New Arrow committer: Rémi Dattai

2021-12-07 Thread Vibhatha Abeykoon
Congratulations! With Regards, Vibhatha Abeykoon, PhD On Wed, Dec 8, 2021 at 8:08 AM Weston Pace wrote: > Congratulations! > > On Tue, Dec 7, 2021 at 4:02 PM Jacky Lee wrote: > > > > Congratulations, Rémi! > > > > Supun Kamburugamuve 于2021年12月8日周三 0

Re: Wrap Unwarp Scalars in Cython API

2021-03-24 Thread Vibhatha Abeykoon
Great!. This sounds good. With Regards, Vibhatha Abeykoon On Tue, Mar 23, 2021 at 5:38 AM Antoine Pitrou wrote: > > Hi Vibhatha, > > The APIs exist and are declared (in Cython) as: > > cdef public object pyarrow_wrap_scalar(const shared_ptr[CScalar]& > sp_scalar)

Re: Wrap Unwarp Scalars in Cython API

2021-03-22 Thread Vibhatha Abeykoon
The use case is to pass a Scalar created in Python to a kernel written in C++ backend which supports arrow data types. To support this I need to unwrap the Pyarrow Scalar to a C++ arrow Scalar. With Regards, Vibhatha Abeykoon On Mon, Mar 22, 2021 at 11:15 PM Benjamin Kietzman wrote: > I&#x

Wrap Unwarp Scalars in Cython API

2021-03-22 Thread Vibhatha Abeykoon
Hello, Is there a way to wrap and unwrap Scalars using the Cython API? I am following the docs: https://arrow.apache.org/docs/python/extending.html But I couldn't find an option. Not sure if I am following the correct docs. With Regards, Vibhatha Abeykoon, PhD Candidate | Research Assi

Re: python module pyarrow.compute is not found

2020-11-27 Thread Vibhatha Abeykoon
make sure you point to that Python when you're building from the source. With Regards, Vibhatha Abeykoon On Fri, Nov 27, 2020 at 11:41 AM Kirill Lykov wrote: > ARROW_COMPUTE was enabled because ARROW_PYTHON was enabled (I double > checked). > And sanity check helped -- I shoul

Re: Development with C++ and Cython APIs in Arrow

2020-11-09 Thread Vibhatha Abeykoon
Thanks for these suggestions. Will take a look into these approaches. With Regards, Vibhatha Abeykoon On Fri, Nov 6, 2020 at 2:43 PM Uwe L. Korn wrote: > The pip package (explicitly the wheels) should contain the C++ libraries > and headers. So it should be sufficient for your useca

Re: Development with C++ and Cython APIs in Arrow

2020-11-06 Thread Vibhatha Abeykoon
One more question about packaging, here when the API requires both Cython and C++ APIs, Pyarrow dependency must also be built from the source? Or is it practical to use the same version of Arrow using Pip? With Regards, Vibhatha Abeykoon On Fri, Nov 6, 2020 at 9:59 AM Vibhatha Abeykoon wrote

Re: Development with C++ and Cython APIs in Arrow

2020-11-06 Thread Vibhatha Abeykoon
Hello Uwe, Nice example. I will follow this. With Regards, Vibhatha Abeykoon On Fri, Nov 6, 2020 at 9:36 AM Uwe L. Korn wrote: > Hello Vibhatha, > > the best is to set a relative RPATH on the libraries. An example for this > can be seen in the turbodbc sources: > https://

Re: PyArrow Compute API

2020-11-05 Thread Vibhatha Abeykoon
I understand. I will take a look at the APIs. With Regards, Vibhatha Abeykoon On Thu, Nov 5, 2020 at 5:38 PM Wes McKinney wrote: > You can help by opening Jira issues for adding new functions or adding > new type cases to functions. Since Arrow is a volunteer-based project > t

PyArrow Compute API

2020-11-05 Thread Vibhatha Abeykoon
e neg, etc. I am following: https://arrow.apache.org/docs/python/api/compute.html With Regards, Vibhatha Abeykoon

Development with C++ and Cython APIs in Arrow

2020-11-03 Thread Vibhatha Abeykoon
when packaging the project, I am not quite sure whether this is the correct approach. For instance, when generating a pip package, this workflow is not a good solution. Any comments and suggestions? With Regards, Vibhatha Abeykoon,

Re: Cython API Runtime Error

2020-10-31 Thread Vibhatha Abeykoon
I was able to solve the issue. Please ignore my previous email. With Regards, Vibhatha Abeykoon On Fri, Oct 30, 2020 at 9:47 AM Vibhatha Abeykoon wrote: > Hello, > > I am upgrading an existing C++/Cython/Python library written on Arrow > 0.16.0 to > 2.0.0. The build complet

Cython API Runtime Error

2020-10-30 Thread Vibhatha Abeykoon
I use PyArrow Cython API in wrapping and unwrapping objects as well. Is this due to a Cython version mismatch or any upgrading options missing from my end? The Cython version used here is 0.29.21. With Regards, Vibhatha Abeykoon, PhD Candidate | Research Assistant, Digital Science Cen

Re: Pyarrow building from source along with CPP Libraries to link to another Cython API

2020-05-01 Thread Vibhatha Abeykoon
Sorry for the confusion, this must go to the user mailing list. With Regards, Vibhatha Abeykoon, Research Assistant, Intelligent Systems Engineering, Indiana University Bloomington, Cell : +1-812-955-1394 Web: https://www.vibhatha.org <https://www.linkedin.com/in/vibhathaabeykoon/> On Th

Pyarrow building from source along with CPP Libraries to link to another Cython API

2020-04-30 Thread Vibhatha Abeykoon
Hi, I am trying to integrate Arrow with an application that I am developing. Here I build Arrow from the source (CPP) and use the API to develop some custom functions to do a scientific calculation after data loaded with Arrow table API. On top of this, I develop a Cython API to design a python AP