re is interest.
> > > >
> > > >
> > > > Yaron.
> > > > ____
> > > > From: David Li
> > > > Sent: Wednesday, August 17, 2022 4:25 PM
> > > > To: dev@arrow.apache.org
> > > >
for
> > other
> > > sources in SourceNode (e.g., streams of RecordBatch, ExecBatch, or
> > > ArrayVector) which I could make a PR for, if there is interest.
> > >
> > >
> > > Yaron.
> > >
> > > From: D
> > From: David Li
> > Sent: Wednesday, August 17, 2022 4:25 PM
> > To: dev@arrow.apache.org
> > Subject: Re: [C++] Read Flight data source into Acero
> >
> > Convert the reader to a RecordBatchReader [1], turn it into an
> > AsyncGenerator [2],
ams of RecordBatch, ExecBatch, or
> ArrayVector) which I could make a PR for, if there is interest.
>
>
> Yaron.
>
> From: David Li
> Sent: Wednesday, August 17, 2022 4:25 PM
> To: dev@arrow.apache.org
> Subject: Re: [C++] Read Flight data source
4:25 PM
To: dev@arrow.apache.org
Subject: Re: [C++] Read Flight data source into Acero
Convert the reader to a RecordBatchReader [1], turn it into an AsyncGenerator
[2], then wrap it in a SourceNode (though I think SourceNode should just expose
a helper for wrapping a RecordBatchReader like it
Convert the reader to a RecordBatchReader [1], turn it into an AsyncGenerator
[2], then wrap it in a SourceNode (though I think SourceNode should just expose
a helper for wrapping a RecordBatchReader like it already does for Tables).
[1]:
https://github.com/apache/arrow/blob/8474ee5a3ed725d4bb5
I don't have any pointers, but just wanted to mention that I am going to
try and figure this out quite a bit in the next week. I can try to create
some relevant cookbook recipes as I plod along.
Aldrin Montana
Computer Science PhD Student
UC Santa Cruz
On Wed, Aug 17, 2022 at 9:15 AM Li Jin wro
Correction: I have a flight::FlightStreamReader (not Flight::StreamReader)
On Wed, Aug 17, 2022 at 12:12 PM Li Jin wrote:
> Hi,
>
> I have a Flight data source (effectively a Flight::StreamReader) and I'd
> like to create an Acero source node from it. I wonder if something already
> exists to do
Hi,
I have a Flight data source (effectively a Flight::StreamReader) and I'd
like to create an Acero source node from it. I wonder if something already
exists to do that or if not, perhaps some pointers for me to take a look
at?
Thanks,
Li
