[ https://issues.apache.org/jira/browse/HIVE-27187?focusedWorklogId=853452&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-853452 ]
ASF GitHub Bot logged work on HIVE-27187: ----------------------------------------- Author: ASF GitHub Bot Created on: 28/Mar/23 15:21 Start Date: 28/Mar/23 15:21 Worklog Time Spent: 10m Work Description: kasakrisz opened a new pull request, #4166: URL: https://github.com/apache/hive/pull/4166 <!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://cwiki.apache.org/confluence/display/Hive/HowToContribute 2. Ensure that you have created an issue on the Hive project JIRA: https://issues.apache.org/jira/projects/HIVE/summary 3. Ensure you have added or run the appropriate tests for your PR: 4. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP]HIVE-XXXXX: Your PR title ...'. 5. Be sure to keep the PR description updated to reflect all changes. 6. Please write your PR title to summarize what this PR proposes. 7. If possible, provide a concise example to reproduce the issue for a faster review. --> ### What changes were proposed in this pull request? * Enable Incremental rebuild plan transformation of materialized view stored by iceberg and definition contains aggregate. * query the acid sort columns from storage handler in case of non native tables when transforming the AST plan of the MV rebuild ### Why are the changes needed? Improve MV rebuild performance ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? ``` mvn test -Dtest.output.overwrite -DskipSparkTests -Dtest=TestMiniLlapLocalCliDriver -Dqfile=materialized_view_create_rewrite_5.q,materialized_view_create_rewrite_6.q -pl itests/qtest -Pitests mvn test -Dtest.output.overwrite -Dtest=TestIcebergCliDriver -Dqfile=mv_iceberg_orc7.q -pl itests/qtest-iceberg -Pitests,iceberg -Drat.skip ``` Issue Time Tracking ------------------- Worklog Id: (was: 853452) Remaining Estimate: 0h Time Spent: 10m > Incremental rebuild of materialized view having aggregate and stored by > iceberg > ------------------------------------------------------------------------------- > > Key: HIVE-27187 > URL: https://issues.apache.org/jira/browse/HIVE-27187 > Project: Hive > Issue Type: Improvement > Components: Iceberg integration, Materialized views > Reporter: Krisztian Kasa > Assignee: Krisztian Kasa > Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > Currently incremental rebuild of materialized view stored by iceberg which > definition query contains aggregate operator is transformed to an insert > overwrite statement which contains a union operator if the source tables > contains insert operations only. One branch of the union scans the view the > other produces the delta. > This can be improved further: transform the statement to a multi insert > statement representing a merge statement to insert new aggregations and > update existing. -- This message was sent by Atlassian Jira (v8.20.10#820010)