comphead commented on issue #15162: URL: https://github.com/apache/datafusion/issues/15162#issuecomment-2722845310
one of the options yes, as `item` is heavily used across datafusion physical layers there will be difficult to align schema without changes in DF. So I'll try to make this coercion before calling datafusion code. Schema would flow like this Spark -> `element` -> coerce -> `item` - run DF code -> coerce -> `element` -> Spark. As we need to coerce only schema without copying/modifying arrays so should be relatively cheap -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
