Hi Arrow Dev,
For filesystems that contact remote services is there any sort of
connection caching to avoid the cost of reconnecting each time?  If so, at
what scope does the cache live (e.g. each FileSystem object, or process
global)?

For context, Iceberg is trying to wrap pyarrow Filesystems for IO [1] and
we are trying to figure out what the lifecycle for File Systems should be.

Thanks,
Micah

[1] https://github.com/apache/iceberg/pull/4081

Reply via email to