Re: [Discuss] Iceberg View Interoperability

2024-10-22 Thread Will Raschkowski
It’s all nascent, but we have a relatively solid experience going from Spark to Substrait [1], Substrait to Calcite [2], and Calcite to one of its supported SQL dialects [3]. All these translations are Java-based. [1]: https://github.com/substrait-io/substrait-java/pull/271 [2]: https://github.c

Re: [DISCUSS] Use iceberg-rust as pyiceberg file io

2024-08-02 Thread Will Raschkowski
Xuanwo, would PyIceberg and iceberg-rust share the underlying OpenDAL implementations via pyo3 / fsspec bindings? From: Joe Stein Sent: Thursday, August 1, 2024 3:37 AM To: dev@iceberg.apache.org Subject: Re: [DISC