matko commented on issue #1008: URL: https://github.com/apache/datafusion-python/issues/1008#issuecomment-2624657749
Looking at what is exposed for producing the object store objects in datafusion-python, it looks like this is only a subset of what obstore allows. It should therefore be viable to make the datafusion-python ObjectStore objects either remember their construction arguments, or query them from the built ObjectStore, and expose them in a way that lets us then construct the equivalent obstore version from python (maybe allowing augmenting this with some extras, like `ClientConfig` and `RetryConfig` which this library offers). something like, ```python df_store = datafusion.object_store.GoogleCloud('my-cool-bucket') store = df_store.as_obstore() ``` with `as_obstore` optionally taking a `ClientConfig` and `RetryConfig`. I'll try to implement this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org