zhangfengcdt opened a new issue, #248:
URL: https://github.com/apache/sedona-db/issues/248
In the DataFusion 50 upgrade, we added `config_options:
Arc::new(ConfigOptions::default())` to all `ScalarFunctionArgs` and
`ScalarFunctionExpr::new` calls throughout the codebase to satisfy the new API
requirements.
While this works functionally, it means these UDF calls don't respect
user-configured DataFusion options that might affect query behavior.
Proposed Improvement
Pass actual `ConfigOptions` from the session/context through the call stack
instead of creating default instances.
Locations to Address
- `rust/sedona/src/show.rs`**
- `rust/sedona-geoparquet/src/writer.rs` - BBox UDF calls (lines with
`ScalarFunctionExpr::new`)
- `rust/sedona-geoparquet/src/file_opener.rs` - Any UDF invocations
- `rust/sedona-spatial-join/src/optimizer.rs` - Already gets config from
context, verify it's passed through
- `rust/sedona-testing/src/testers.rs` - Test utilities (lower priority,
defaults likely fine for tests)
Please also find other locations that might be relevant.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
