Quanlong Huang created IMPALA-14210:
---------------------------------------
Summary: Impala native functions are not updated by AlterDatabase
events
Key: IMPALA-14210
URL: https://issues.apache.org/jira/browse/IMPALA-14210
Project: IMPALA
Issue Type: Bug
Components: Catalog
Reporter: Quanlong Huang
Impala native functions are registered in the db properties using keys with
prefix "
impala_registered_function_", e.g.
{code:java}
"impala_registered_function_identity_tmp(BIGINT)"="HBgFbXlfZGIYDGlkZW50aXR5X3RtcAAVBBkcGRwVABwVDAAAABwZHBUAHBUMAAAAEigUaWRlbnRpdHlfdG1wKEJJR0lOVCkYNGhkZnM6Ly9sb2NhbGhvc3Q6MjA1MDAvdGVzdC13YXJlaG91c2UvbGliVGVzdFVkZnMuc28cGDtfWjhJZGVudGl0eVBOMTBpbXBhbGFfdWRmMTVGdW5jdGlvbkNvbnRleHRFUktOU185QmlnSW50VmFsRQAhAA=="{code}
The value is a base64 encoded string of a TFunction.
[https://github.com/apache/impala/blob/a766f197a7fd0297ab736ed24bd35f7c4568927e/fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java#L2098]
When one catalogd adds a new native function, the db properties is also updated
and included in the corresponding ALTER_DATABASE HMS notification event.
When applying this event in another catalogd, it should also update the
functions. Currently we just update the msDb object:
[https://github.com/apache/impala/blob/a766f197a7fd0297ab736ed24bd35f7c4568927e/fe/src/main/java/org/apache/impala/catalog/events/MetastoreEvents.java#L2342]
This is identified while debugging test_metadata_after_failover for
IMPALA-14074.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
