This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from 8ade19fa8d2 [fix](iceberg) fix unstable iceberg case (#60646)
add 2c851489101 [refactor](paimon) Per-catalog Paimon metadata cache with
two-level table+snapshot structure (#60478)
No new revisions were added by this update.
Summary of changes:
.../CatalogScopedCacheMgr.java} | 25 ++-
.../apache/doris/datasource/ExternalCatalog.java | 1 -
.../doris/datasource/ExternalMetaCacheMgr.java | 133 ++++++--------
.../doris/datasource/ExternalSchemaCache.java | 13 +-
.../datasource/iceberg/IcebergExternalCatalog.java | 70 +++-----
.../datasource/iceberg/IcebergMetadataCache.java | 135 +++++++-------
.../doris/datasource/iceberg/IcebergUtils.java | 14 +-
.../iceberg/cache/ContentFileEstimator.java | 194 ---------------------
.../iceberg/cache/IcebergManifestCache.java | 27 ++-
.../iceberg/cache/ManifestCacheValue.java | 20 +--
.../doris/datasource/metacache/CacheSpec.java | 152 ++++++++++++++++
.../datasource/paimon/PaimonExternalCatalog.java | 23 +++
.../datasource/paimon/PaimonExternalTable.java | 52 +++---
.../datasource/paimon/PaimonMetadataCache.java | 152 +++++++++++-----
.../datasource/paimon/PaimonMetadataCacheMgr.java | 51 ------
.../datasource/paimon/PaimonSnapshotCacheKey.java | 60 -------
.../PaimonTableCacheValue.java} | 32 ++--
.../doris/datasource/paimon/PaimonUtils.java | 64 +++++++
.../datasource/paimon/source/PaimonScanNode.java | 5 +-
.../metastore/AbstractIcebergProperties.java | 20 +++
.../org/apache/doris/regression/suite/Suite.groovy | 35 +++-
.../iceberg/test_iceberg_manifest_cache.groovy | 5 +-
.../iceberg/test_iceberg_table_cache.groovy | 2 +-
.../iceberg/test_iceberg_table_meta_cache.groovy | 18 +-
.../paimon/test_paimon_table_meta_cache.groovy | 128 ++++++++++++++
25 files changed, 786 insertions(+), 645 deletions(-)
copy fe/fe-core/src/main/java/org/apache/doris/{metric/AutoMappedMetric.java
=> datasource/CatalogScopedCacheMgr.java} (59%)
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/iceberg/cache/ContentFileEstimator.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/metacache/CacheSpec.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/paimon/PaimonMetadataCacheMgr.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/paimon/PaimonSnapshotCacheKey.java
copy
fe/fe-core/src/main/java/org/apache/doris/datasource/{iceberg/IcebergTableCacheValue.java
=> paimon/PaimonTableCacheValue.java} (56%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/paimon/PaimonUtils.java
create mode 100644
regression-test/suites/external_table_p0/paimon/test_paimon_table_meta_cache.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
