RE: Apache Arrow filesystem question

2022-10-27 Thread Jerry Adair
makes it into that release (11.0.0), so hopefully the contributors will make that happen. -Original Message- From: Wes McKinney Sent: Thursday, October 27, 2022 4:42 PM To: dev@arrow.apache.org Subject: Re: Apache Arrow filesystem question [You don't often get email from wesmck...@gmai

Re: Apache Arrow filesystem question

2022-10-27 Thread Wes McKinney
t; To: dev@arrow.apache.org > Subject: RE: Apache Arrow filesystem question > > There are fsspec implementations to support other filesystems. > > https://pypi.org/project/pyarrowfs-adlgen2/ > > -Original Message- > From: Jerry Adair > Sent: Wednesday, October 26, 2022 1

RE: Apache Arrow filesystem question

2022-10-26 Thread Lee, David
- From: Lee, David Sent: Wednesday, October 26, 2022 11:04 AM To: dev@arrow.apache.org Subject: RE: Apache Arrow filesystem question There are fsspec implementations to support other filesystems. https://pypi.org/project/pyarrowfs-adlgen2/ -Original Message- From: Jerry Adair Sent

Re: Apache Arrow filesystem question

2022-10-26 Thread Jacob Wujciak
The azure implementation is underway but did not make it into 10.0.0: https://issues.apache.org/jira/browse/ARROW-2034 On Wed, Oct 26, 2022 at 7:59 PM Jerry Adair wrote: > Hi- > > I am curious about the Apache Arrow filesystem support. I noticed that > there are classes for S3 and GCS. I am cu

RE: Apache Arrow filesystem question

2022-10-26 Thread Lee, David
There are fsspec implementations to support other filesystems. https://pypi.org/project/pyarrowfs-adlgen2/ -Original Message- From: Jerry Adair Sent: Wednesday, October 26, 2022 10:59 AM To: dev@arrow.apache.org Subject: RE: Apache Arrow filesystem question External Email: Use

RE: Apache Arrow filesystem question

2022-10-26 Thread Jerry Adair
Hi- I am curious about the Apache Arrow filesystem support. I noticed that there are classes for S3 and GCS. I am currently using those classes to read/write from/to those cloud storage options. However I noticed that there is no class for Azure (ADLS). And so I am curious why that is? Doe