xudong963 commented on issue #23329: URL: https://github.com/apache/datafusion/issues/23329#issuecomment-4912860165
@Jefffrey Thanks! A config-driven return type is technically possible now via `ScalarUDFImpl::with_updated_config`. But I still think an input-driven return type is the better default fix here. Reusing the existing `map_string_types_to_utf8view` or parquet `schema_force_view_types` options would be misleading because those control SQL type mapping / parquet schema inference, not scalar function output semantics. Adding a new option would also add another schema/planning mode and more test/code paths for these functions. My preference would be: - `Utf8 -> Utf8` - `LargeUtf8 -> LargeUtf8` - `Utf8View -> Utf8View` and keep the zero-copy optimized path for `Utf8View` inputs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
