gt; So if my local node has memory constraints, will it be able to stream
> > data
> > > from an Apache Flight datasource and stream it back to a different Apache
> > > Flight target?
> > > If the answer is yes, is it because there will be a Remote Dataset
> > c
> > Adam Lippai
> >
> > On Tue, Apr 12, 2022 at 4:14 PM James Duong .invalid>
> > wrote:
> >
> >> Hi Adam,
> >>
> >> Arrow Flight can be used to provide an RPC framework that returns
> datasets
> >> (sent over the wire as ar
sed to provide an RPC framework that returns datasets
>> (sent over the wire as arrow buffers) and exposes them from a FlightClient
>> as Arrow RecordBatches without serialization. Is this what you mean by
>> remote datasets?
>> Arrow Flight SQL is an application layer
> Hi Adam,
>
> Arrow Flight can be used to provide an RPC framework that returns datasets
> (sent over the wire as arrow buffers) and exposes them from a FlightClient
> as Arrow RecordBatches without serialization. Is this what you mean by
> remote datasets?
> Arrow Flight SQL is an ap
pr 12, 2022, at 15:51, Adam Lippai wrote:
> Hi,
>
> I saw really nice features like groupby and join developed recently.
> I like how Dataset is supported for joins and how streamed processing is
> gaining momentum in Arrow.
>
> Does Apache Arrow have the concept of remote datase
Hi Adam,
Arrow Flight can be used to provide an RPC framework that returns datasets
(sent over the wire as arrow buffers) and exposes them from a FlightClient
as Arrow RecordBatches without serialization. Is this what you mean by
remote datasets?
Arrow Flight SQL is an application layer built on
Hi,
I saw really nice features like groupby and join developed recently.
I like how Dataset is supported for joins and how streamed processing is
gaining momentum in Arrow.
Does Apache Arrow have the concept of remote datasets eg using Arrow
Flight? Or will this happen directly using S3 and
