Omega359 commented on issue #14536: URL: https://github.com/apache/datafusion/issues/14536#issuecomment-2661094974
I took a look into this. DataFusion delegates the formatting off to arrow-cast which doesn't currently have support for trying multiple times with different types. I see a few possibilities: 1. DataFusion casts all dates to timestamps and send them through. Not as efficient for the typical use case 2. DataFusion on receiving a format Err from arrow potentially casts the type (date -> timestamp, etc) and retries. 3. We submit a PR to arrow-rs to attempt the casting of dates to timestamps in the display code in arrow-cast upon receiving a format failure. 4. DataFusion skips arrow-cast for the displaying of date/times/timestamps/duration and handles it internally. I'm not a huge fan of this option. I'm leaning towards option 3 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
