> > > it could execute that function during the call to StartProducing.
> > >
> > > On Tue, Sep 13, 2022 at 4:05 PM Li Jin wrote:
> > >>
> > >> Thanks Yaron for the pointer to that PR.
> > >>
> > >> On Tue, Sep 13, 2022 at 4:43 PM Yaro
BatchReader, then another
> >> > possibility is using an upcoming PR (
> >> > https://github.com/apache/arrow/pull/14041) that enables SourceNode to
> >> > accept it. You would need to know the schema when configuring the
> >> > SourceNode, but you won't need t
Reader, then another
>> > possibility is using an upcoming PR (
>> > https://github.com/apache/arrow/pull/14041) that enables SourceNode to
>> > accept it. You would need to know the schema when configuring the
>> > SourceNode, but you won't need to derived fr
for the GetSchema method. I think you
> > > should pass the schema obtained by (the wrapped) GetSchema to an Ibis
> > node,
> > > rather than defining a new Ibis node that would have to access the
> > network
> > > to get the schema on its own.
> > >
> > > Given the above, I agree with
cept it. You would need to know the schema when configuring the
> SourceNode, but you won't need to derived from SourceNode.
>
>
> Yaron.
>
> From: Li Jin
> Sent: Tuesday, September 13, 2022 3:58 PM
> To: dev@arrow.apache.org
> Subje
from SourceNode.
Yaron.
From: Li Jin
Sent: Tuesday, September 13, 2022 3:58 PM
To: dev@arrow.apache.org
Subject: Re: Integration between Flight and Acero
Update:
I am going to try what David Li suggested here:
https://lists.apache.org/t
twork
> to get the schema on its own.
>
> Given the above, I agree with you that when the Acero node is created its
> schema would already be known.
>
>
> Yaron.
>
> From: Li Jin
> Sent: Thursday, September 1, 2022 2:49 PM
> To: dev
that when the Acero node is created its
schema would already be known.
Yaron.
From: Li Jin
Sent: Thursday, September 1, 2022 2:49 PM
To: dev@arrow.apache.org
Subject: Re: Integration between Flight and Acero
Thanks David. I think my original question might not h
Thanks David. I think my original question might not have been accurate so
I will try to rephrase my question:
My ultimate goal is to add an ibis source node:
class MyStorageTable(ibis.TableNode, sch.HasSchema):
url = ... # e.g. "my_storage://my_path"
begin = ... # e.g. "20220101"
end
Hi Li,
It'd depend on how exactly you expect everything to fit together, and I think
the way you'd go about it would depend on what exactly the application is. For
instance, you could have the application code do everything up through DoGet
and get a reader, then create a SourceNode from the re
10 matches
Mail list logo
