Re: [I] Datafusion can't seem to handle schema evolution [datafusion]

2025-02-19 Thread via GitHub
alamb commented on issue #14753: URL: https://github.com/apache/datafusion/issues/14753#issuecomment-2668334767 Possibly related: - https://github.com/apache/datafusion/issues/14755 - https://github.com/apache/datafusion/issues/14757 -- This is an automated message from the Apache Gi

Re: [I] Datafusion can't seem to handle schema evolution [datafusion]

2025-02-18 Thread via GitHub
TheBuilderJR closed issue #14753: Datafusion can't seem to handle schema evolution URL: https://github.com/apache/datafusion/issues/14753 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] Datafusion can't seem to handle schema evolution [datafusion]

2025-02-18 Thread via GitHub
TheBuilderJR commented on issue #14753: URL: https://github.com/apache/datafusion/issues/14753#issuecomment-2666342013 Actually this does seem to work with the latest version of datafusion! -- This is an automated message from the Apache Git Service. To respond to the message, please log o

[I] Datafusion can't seem to handle schema evolution [datafusion]

2025-02-18 Thread via GitHub
TheBuilderJR opened a new issue, #14753: URL: https://github.com/apache/datafusion/issues/14753 ### Describe the bug Basically I want 1) Schema evolution so if we add more fields, I don't have to remigrate all the old data 2) Compaction support so I can take multiple parquet