kylebarron commented on issue #1008:
URL:
https://github.com/apache/datafusion-python/issues/1008#issuecomment-2624807853
> this is only a subset of what obstore allows
Yes, `obstore` is a full binding to `object_store` and intends to allow the
full configuration that you can do in R
matko commented on issue #1008:
URL:
https://github.com/apache/datafusion-python/issues/1008#issuecomment-2624807123
> Wouldn't that in effect be constructing our own stable FFI API across
libraries? I'm not sure that's possible and/or maintainable.
What I was imagining was rather a
kylebarron commented on issue #1008:
URL:
https://github.com/apache/datafusion-python/issues/1008#issuecomment-2624792344
> Solving the FFI problem seems very unfeasible.
Maybe... @timsaucer mentioned on discord I think that he was considering
looking into it, similar to his work on
matko commented on issue #1008:
URL:
https://github.com/apache/datafusion-python/issues/1008#issuecomment-2624657749
Looking at what is exposed for producing the object store objects in
datafusion-python, it looks like this is only a subset of what obstore allows.
It should therefore be vi
matko commented on issue #1008:
URL:
https://github.com/apache/datafusion-python/issues/1008#issuecomment-2624656629
Looking at what is exposed for producing the object store objects in
datafusion-python, it looks like this is only a subset of what obstore allows.
It should therefore be vi
matko commented on issue #1008:
URL:
https://github.com/apache/datafusion-python/issues/1008#issuecomment-2624107750
Thanks for pointing out obstore! I did not know about this library. This
looks very useful :)
Solving the FFI problem seems very unfeasible. Maybe one day in the future
R
kylebarron commented on issue #1008:
URL:
https://github.com/apache/datafusion-python/issues/1008#issuecomment-2622430293
I agree! This is why I created
[obstore](https://github.com/developmentseed/obstore). It's a fast Python
binding for `object_store`.
> However, it's useful to be
matko opened a new issue, #1008:
URL: https://github.com/apache/datafusion-python/issues/1008
**Is your feature request related to a problem or challenge? Please describe
what you are trying to do.**
I need to be able to delete old resources generated by `write_parquet()` and
similar met
