Re: Arrow Flight usage with graph databases

2022-09-08 Thread Wes McKinney
hi Bill — you can unsubscribe by e-mailing dev-unsubscr...@arrow.apache.org On Tue, Sep 6, 2022 at 2:40 PM Bill Zhao wrote: > > unsubscribe > > Valentyn Kahamlyk 于2022年7月18日周一 16:56写道: > > > > Hi All, > > > > I'm investigating the possibility of using Arrow Flight with graph > > databases, and

Re: Arrow Flight usage with graph databases

2022-09-06 Thread Bill Zhao
unsubscribe Valentyn Kahamlyk 于2022年7月18日周一 16:56写道: > > Hi All, > > I'm investigating the possibility of using Arrow Flight with graph databases, > and exploring how to enable Arrow Flight endpoint in Apache Tinkerpop Gremlin > server. > > Now graph databases use several incompatible protocols

Re: Arrow Flight usage with graph databases

2022-08-08 Thread Valentyn Kahamlyk
ight server that >> produces >> >> python record objects (JSON structured records). >> >> Those Python record objects are then converted into an Arrow Formatted >> >> Table using pa.Table.from_pylist(). >> >> The Arrow Table is then sent back to the

Re: Arrow Flight usage with graph databases

2022-08-05 Thread Valentyn Kahamlyk
GraphQL flight server that produces > >> python record objects (JSON structured records). > >> Those Python record objects are then converted into an Arrow Formatted > >> Table using pa.Table.from_pylist(). > >> The Arrow Table is then sent back to the client to co

Re: Arrow Flight usage with graph databases

2022-07-28 Thread Lee, David
the client to complete the original >> Fight RPC request. >> >> -Original Message- >> From: Matthew Topol >> Sent: Wednesday, July 27, 2022 5:10 PM >> To: dev@arrow.apache.org >> Subject: Re: Arrow Flight usage with graph databases >> >>

Re: Arrow Flight usage with graph databases

2022-07-27 Thread Matthew Topol
ol > Sent: Wednesday, July 27, 2022 5:10 PM > To: dev@arrow.apache.org > Subject: Re: Arrow Flight usage with graph databases > > External Email: Use caution with links and attachments > > > So this is sightly different than what I was doing and spoke about. As far > a

RE: Arrow Flight usage with graph databases

2022-07-27 Thread Lee, David
@arrow.apache.org Subject: Re: Arrow Flight usage with graph databases External Email: Use caution with links and attachments So this is sightly different than what I was doing and spoke about. As far as I can tell from your links, you are evaluating the graphql using that graphql server and then

Re: Arrow Flight usage with graph databases

2022-07-27 Thread Matthew Topol
riginal Message- > From: Gavin Ray > Sent: Wednesday, July 20, 2022 11:15 AM > To: dev@arrow.apache.org > Subject: Re: Arrow Flight usage with graph databases > > External Email: Use caution with links and attachments > > > > > > We considered the option to a

RE: Arrow Flight usage with graph databases

2022-07-27 Thread Lee, David
L (Schema Definition Language) and generate an equivalent Arrow schema based on the subset of data points requested. -Original Message- From: Gavin Ray Sent: Wednesday, July 20, 2022 11:15 AM To: dev@arrow.apache.org Subject: Re: Arrow Flight usage with graph databases External Email: Use ca

Re: Arrow Flight usage with graph databases

2022-07-20 Thread Gavin Ray
> > We considered the option to analyze data to build a schema on the fly, > however it will be quite an expensive operation which will not allow us to > get performance benefits from using Arrow Flight. I'm not sure if you'll be able to avoid generating a schema on the fly, if it's anything like

Re: Arrow Flight usage with graph databases

2022-07-19 Thread Valentyn Kahamlyk
Hi David, We are planning to use Flight for the prototype. We are also planning to use Flight SQL as a reference, however we wanted to explore ideas whether Arrow Flight Graph can be implemented on top of Arrow Flight (similar to Arrow Flight SQL). Graph databases generally do not expose or enfor

Re: Arrow Flight usage with graph databases

2022-07-18 Thread David Li
Hi Valentyn, Just to make sure, is this Flight or Flight SQL? I ask since Flight itself does not have a notion of transactions in the first place. I'm also curious what the intended target client application is. Not being familiar with graph databases myself, I'll try to give some comments… La

Arrow Flight usage with graph databases

2022-07-18 Thread Valentyn Kahamlyk
Hi All, I'm investigating the possibility of using Arrow Flight with graph databases, and exploring how to enable Arrow Flight endpoint in Apache Tinkerpop Gremlin server. Now graph databases use several incompatible protocols that make it difficult to use and spread the technology. A common feat