Re: [Rust] [Discuss] proposal to redesign Arrow crate to resolve safety violations

Awesome. Thanks Wes. I have now initiated the vote for both projects. Best, Jorge On Sat, Jul 10, 2021 at 1:26 PM Wes McKinney wrote: > The process for updating the website is described on > > https://incubator.apache.org/guides/website.html > > It looks like you need to add the new entries t

Re: [MATLAB] arrow_13202 Enabling CI on Debian for MATLAB submissions

Hi, Thanks for sharing the current status. We need to add matlab-actions/* GitHub actions to allow list to use them in apache/arrow. Could you request it by creating a new JIRA issue for INFRA? See also: https://issues.apache.org/jira/browse/INFRA-21239 > I started by adding > arrow/.github/wo

[Rust] 5.0.0 release blog post

As we prepare for the 5.0.0, hopefully later this week, I started gathering some thoughts for a blog post. Here is a google doc [1] to begin collaborating; Hopefully others can chip in and help make the release sound as amazing as it is; We can move it to a PR for the arrow-site when ready. Thanks

[MATLAB] arrow_13202 Enabling CI on Debian for MATLAB submissions

Hello Team, I have been working to enable CI and testing for the MATLAB code on the Apache Arrow project. matlab-actions matlab-actions is essentially MATLAB with GitHub Actions in which we can run MATLAB scripts/ functions including tests. I have be

Re: [Java] Async Client Usage

Hey Devin, I don't think anyone's actively working on this. I do agree async Flight APIs would be useful. Fortunately for us, gRPC Java is natively asynchronous underneath, so this should be reasonably straightforward. If you'd like to take this up, feel free to ping me on the PR for review (@l

[Java] Async Client Usage

Hi, I'm currently in the process of doing some integration work with the Java FlightClient/FlightStream. I'm hoping to consume FlightStream in an asynchronous manner, but the current methods `FlightStream#next` and `FlightStream#getRoot` are blocking. Does it make sense to expose additional hooks

Re: [DISCUSS] What is the Plasma status currently?

I see. To add more context - as an outsider comment - I've heard "Ray is so good for our case because they use this awesome Plasma storage" :). This might be an overly-narrow view of course and once we start seeing more Ray usage with Airflow, I might revise this, but this is the impression I have

Re: [DISCUSS] What is the Plasma status currently?

hi Jarek — since Plasma isn't really promoted as a standalone component in Ray (rather, it's an implementation detail of how Ray works — their documentation is FWIW out of date, claiming that Plasma is still being developed in Arrow), I'm not sure there is a particular conflict right now. Ray shoul

Re: Apache Arrow Cookbook

I requested its creation here https://github.com/apache/arrow-cookbook If you can set up a PR into this repo (not sure if I need to push an empty "initial commit" repo, but let me know), please make sure everyone who has contributed has an ICLA on file with the ASF secretary. I'm not sure that it

Re: [DISCUSS] What is the Plasma status currently?

Thanks. Interesting story then with the back-forth moves. I wonder if there might be some confusion between then Ray "Plasma" and Arrow "Plasma" (as they seem to be different now). I guess neither Ray nor Arrow has the name "trademark" on it in any way (nice name BTW). Maybe (and I am sure Ray fou

Re: [DISCUSS] What is the Plasma status currently?

Hi Jarek, Your understanding sounds about right to me. That said, we are still building and shipping Plasma for those that have come to depend on it and will continue to do so unless/until it becomes a maintenance burden. But no one active in the Arrow community is working on Plasma. Neal On Tue,

Re: Apache Arrow Cookbook

How should we move forward to "request" an arrow-cookbook repository under the apache organization? Is there a form or request that has to be submitted? Another thing we were wondering, is that being able to deal with contributions using GitHub Issues would lower the barrier for users who find issu

[DISCUSS] What is the Plasma status currently?

Hello Arrow Community, We've had a very interesting talk at the Apache Airflow Summit about Airflow + Ray (which is really cool BTW and I am looking forward to capabilities it will give to Airflow) and we had some discussions that followed. From what I understand (maybe I am wrong?) the Plasma