I see. To add more context - as an outsider comment - I've heard "Ray is so good for our case because they use this awesome Plasma storage" :). This might be an overly-narrow view of course and once we start seeing more Ray usage with Airflow, I might revise this, but this is the impression I have so far at least.
I do not see it as a conflict to be honest, more as a potential source of confusion. J, On Tue, Jul 13, 2021 at 3:04 PM Wes McKinney <wesmck...@gmail.com> wrote: > hi Jarek — since Plasma isn't really promoted as a standalone > component in Ray (rather, it's an implementation detail of how Ray > works — their documentation is FWIW out of date, claiming that Plasma > is still being developed in Arrow), I'm not sure there is a particular > conflict right now. Ray should update their documentation to eliminate > references to Apache Arrow. > > Thanks, > Wes > > On Tue, Jul 13, 2021 at 7:39 AM Jarek Potiuk <ja...@potiuk.com> wrote: > > > > Thanks. Interesting story then with the back-forth moves. > > > > I wonder if there might be some confusion between then Ray "Plasma" and > > Arrow "Plasma" (as they seem to be different now). I guess neither Ray > nor > > Arrow has the name "trademark" on it in any way (nice name BTW). Maybe > (and > > I am sure Ray founders are listening here ;) ) - there should be some > > effort from Ray to trademark it and get some nice "Rename > > agreement/clarification" with Arrow since Arrow does not seem to care :) > ? > > > > The reason I am suggesting it, is when I first heard of it, and searched, > > and asked my friend - he mentioned to me that it WILL be forked in the > > future but it's the same now. Which I understand already happened and > it's > > not the same already. > > > > I only found out the story by knowing the Apache Way and digging > 8 > month > > back in the devlist. So - just a suggestion - maybe worth clarifying it > as > > Ray becomes more and more popular - both Arrow community and Ray might > > suffer due to people understanding the relation and state differently and > > jumping to assumptions (as my friend did). > > > > J. > > > > On Tue, Jul 13, 2021 at 2:18 PM Neal Richardson < > neal.p.richard...@gmail.com> > > wrote: > > > > > Hi Jarek, > > > Your understanding sounds about right to me. That said, we are still > > > building and shipping Plasma for those that have come to depend on it > and > > > will continue to do so unless/until it becomes a maintenance burden. > But no > > > one active in the Arrow community is working on Plasma. > > > > > > Neal > > > > > > On Tue, Jul 13, 2021 at 3:07 AM Jarek Potiuk <pot...@apache.org> > wrote: > > > > > > > Hello Arrow Community, > > > > > > > > We've had a very interesting talk at the Apache Airflow Summit about > > > > Airflow + Ray (which is really cool BTW and I am looking forward to > > > > capabilities it will give to Airflow) and we had some discussions > that > > > > followed. From what I understand (maybe I am wrong?) the Plasma > which was > > > > initially developed in Ray, then contributed to Arrow, and then ( > > > > > > > > https://lists.apache.org/thread.html/r65b2852e4cddb1af8bff06d789bf3822d67777c5dfcd481414acd3d7%40%3Cdev.arrow.apache.org%3E > > > ) > > > > forked (?) by Ray and is kind-of abandoned in Arrow and not really > > > > maintained in Arrow any more (and likely Ray version and Arrow > version > > > are > > > > not compatible /exchangeable). > > > > > > > > Is this correct understanding ? Any more comments or maybe > explanation > > > > what is the relation between Arrow's Plasma and Ray's Plasma? > > > > > > > > Just to explain my interest - I am a PMC of Apache Airflow, I am an > > > > independent Open-Source contributor and advisor, and I am genuinely > > > > interested in Open-source business models and rationale of > stakeholders > > > and > > > > how this plays out with individuals and the ASF/PMC and I wanted to > > > > understand the current state of Plasma :) > > > > > > > > J. > > > > > > > > > > > > > > > > > -- > > +48 660 796 129 > -- +48 660 796 129
