Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-04-15 Thread via GitHub
FishManHome commented on PR #12659: URL: https://github.com/apache/hudi/pull/12659#issuecomment-2808578728 > > > data must be written into the Hudi table before querying will not throw an error indicating that the added fields do not exist. > > > > > > make sure schema evolution i

Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-22 Thread via GitHub
cshuo commented on PR #12659: URL: https://github.com/apache/hudi/pull/12659#issuecomment-2608708951 @liucongjy we'd better track the problem in a new issue or the origin issue, and it would be helpful if you can put more details, e.g., table creating ddl, alter ddl, and select clause. --

Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-21 Thread via GitHub
liucongjy commented on PR #12659: URL: https://github.com/apache/hudi/pull/12659#issuecomment-2606499006 > > data must be written into the Hudi table before querying will not throw an error indicating that the added fields do not exist. > > make sure schema evolution is enabled, `hood

Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-21 Thread via GitHub
liucongjy commented on PR #12659: URL: https://github.com/apache/hudi/pull/12659#issuecomment-2606216270 > > data must be written into the Hudi table before querying will not throw an error indicating that the added fields do not exist. > > make sure schema evolution is enabled, `hood

Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-21 Thread via GitHub
liucongjy commented on PR #12659: URL: https://github.com/apache/hudi/pull/12659#issuecomment-2606214565 > > Is the code you submitted modified based on Hudi1.0? When I tested the submitted code on Hudi 0.15, I still got the same error as before > > The main change is in the construct

Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-21 Thread via GitHub
cshuo commented on PR #12659: URL: https://github.com/apache/hudi/pull/12659#issuecomment-2606209020 > data must be written into the Hudi table before querying will not throw an error indicating that the added fields do not exist. make sure schema evolution is enabled, `hoodie.schema.

Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-21 Thread via GitHub
liucongjy commented on PR #12659: URL: https://github.com/apache/hudi/pull/12659#issuecomment-2606166119 I tested it again. After adding fields to the Hudi table, data must be written into the Hudi table before querying will not throw an error indicating that the added fields do not exist.

Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-21 Thread via GitHub
cshuo commented on PR #12659: URL: https://github.com/apache/hudi/pull/12659#issuecomment-2606165029 > ![1737512944121](https://private-user-images.githubusercontent.com/17332932/405451051-c0bd3f7e-3bc4-4e37-88a9-8032c5c5c301.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY

Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-21 Thread via GitHub
liucongjy commented on PR #12659: URL: https://github.com/apache/hudi/pull/12659#issuecomment-2606148217 ![1737512944121](https://github.com/user-attachments/assets/c0bd3f7e-3bc4-4e37-88a9-8032c5c5c301) Is the code you submitted modified based on Hudi1.0? When I tested the submitted

Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-20 Thread via GitHub
danny0405 merged PR #12659: URL: https://github.com/apache/hudi/pull/12659 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apac

Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-17 Thread via GitHub
hudi-bot commented on PR #12659: URL: https://github.com/apache/hudi/pull/12659#issuecomment-2597769884 ## CI report: * d891c0ab1f4a28bf95d98ba82c40ce01753ea90e Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2931)

Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-17 Thread via GitHub
hudi-bot commented on PR #12659: URL: https://github.com/apache/hudi/pull/12659#issuecomment-2597637711 ## CI report: * db9097873b25d3030045fbc5d3ad7d208263ad40 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2925)

Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12659: URL: https://github.com/apache/hudi/pull/12659#issuecomment-2597639779 ## CI report: * db9097873b25d3030045fbc5d3ad7d208263ad40 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2925)

Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12659: URL: https://github.com/apache/hudi/pull/12659#issuecomment-2597631345 ## CI report: * db9097873b25d3030045fbc5d3ad7d208263ad40 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2925)

Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12659: URL: https://github.com/apache/hudi/pull/12659#issuecomment-2597533318 ## CI report: * 0a0be89fd6e79531a39125bb4679ba3f4ec47ab7 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2917)

Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12659: URL: https://github.com/apache/hudi/pull/12659#issuecomment-2597531771 ## CI report: * 0a0be89fd6e79531a39125bb4679ba3f4ec47ab7 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2917)

Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12659: URL: https://github.com/apache/hudi/pull/12659#issuecomment-2597411681 ## CI report: * 0a0be89fd6e79531a39125bb4679ba3f4ec47ab7 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2917)

Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12659: URL: https://github.com/apache/hudi/pull/12659#issuecomment-2597343317 ## CI report: * 0a0be89fd6e79531a39125bb4679ba3f4ec47ab7 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2917)

Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12659: URL: https://github.com/apache/hudi/pull/12659#issuecomment-2597342133 ## CI report: * 0a0be89fd6e79531a39125bb4679ba3f4ec47ab7 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

[PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-16 Thread via GitHub
cshuo opened a new pull request, #12659: URL: https://github.com/apache/hudi/pull/12659 ### Change Logs Fix the exception happens when hive scan hudi table after new column is added. ### Impact Consolidating hive scan to support more schema evolution scenarios. ##