[
https://issues.apache.org/jira/browse/IMPALA-12829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016393#comment-18016393
]
ASF subversion and git services commented on IMPALA-12829:
----------------------------------------------------------
Commit e4364cd24435b3885202a894aeee9221dddf6d25 in impala's branch
refs/heads/master from Zoltan Borok-Nagy
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=e4364cd24 ]
IMPALA-14358: Event processing can invalidate Iceberg tables
IMPALA-12829 added extra code to CatalogServiceCatalog's
reloadTableIfExists() that can throw a ClassCastException when it
reloads an Iceberg table. When it happens during event processing
the event processor invalidates the table.
This usually happens when another engine updates an Iceberg table. It
then causes slow table loading times as the tables need to be fully
reloaded instead of just doing an incremental table loading.
This patches fixes the ClassCastException by moving the cast into an
if statement.
Testing
* e2e tests added
Change-Id: I892cf326a72024674facad6750893352b982c658
Reviewed-on: http://gerrit.cloudera.org:8080/23349
Reviewed-by: Csaba Ringhofer <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Skip processing abort_txn and commit_txn events if the table is HMS sync
> disabled
> ---------------------------------------------------------------------------------
>
> Key: IMPALA-12829
> URL: https://issues.apache.org/jira/browse/IMPALA-12829
> Project: IMPALA
> Issue Type: Bug
> Components: Catalog
> Reporter: Sai Hemanth Gantasala
> Assignee: Sai Hemanth Gantasala
> Priority: Critical
> Labels: catalog-2024
>
> For transactional tables, the event processor is not skipping abort_txn and
> commit_txn events if the table is HMS sync disabled using
> {{impala.disableHmsSync}} set to true on HMS table property.
> This processing is unnecessary and helps to improve event processor lag by
> skipping abort_txn and commit_txn_event events if the corresponding
> transactional tables are HMS sync disabled.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
