Re: pyarrow dataset API

2022-11-03 Thread Weston Pace
> > simpler). But your changes to scanner/dataset might not map as > > cleanly. When I get close to the point of switching (right now I'm > > hoping to get this wrapped up before or during the winter holidays) > > I'd like to work with you to ensure we

Re: pyarrow dataset API

2022-11-03 Thread Chang She
se changes? Anyways, excited about the roadmap you listed and thanks for the discussion! -C > -- Forwarded message - > From: Weston Pace > Date: Wed, Nov 2, 2022 at 4:55 PM > Subject: Re: pyarrow dataset API > To: > > > FileSystemDataset is part of

Re: pyarrow dataset API

2022-11-02 Thread Weston Pace
ay, November 1, 2022, Chang She wrote: > > > Hi there, > > > > The pyarrow dataset API is marked experimental so I'm curious if y'all > > have made any decisions on it for upcoming releases. Specifically, any > > thoughts on making the Scanner and things like F

Re: pyarrow dataset API

2022-11-01 Thread Micah Kornfield
Moving conversation to dev@ which is more appropriate place to discuss. On Tuesday, November 1, 2022, Chang She wrote: > Hi there, > > The pyarrow dataset API is marked experimental so I'm curious if y'all > have made any decisions on it for upcoming releases. Specifica