This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
from 80dd027ce2e [opt](join) For left semi/anti join without mark join
conjunct and without other conjucnts, stop probing after matching one row
(#34703)
new 6c515e0c76a [fix](group commit) Make compatibility issues on
serializing and deserializing wal file more clear (#34793)
new f7801948ad8 fix backup and restore failed between
force_replication_allocation setted and not setted clusters (#34608)
new 30a036e7a48 [feature](mtmv) create mtmv support partitions rollup
(#31812)
new 38bac76b376 [opt](mtmv) Cache materialization check result for
performance (#34301)
new 6b1c441258a [fix](group_commit) Wal reader should check block length
to avoid reading empty block (#34792)
new 1e53a2a81d1 [Improve](inverted index) improve query performance by not
using output index result column (#34281)
new 4a8df535537 [Chore](rollup) check duplicate column name when create
table with rollup (#34827)
new 71caf88ec15 [opt](mtmv) Optimize the logic of slot mapping generate
for performance (#34597)
new 5719f6ff0c6 [fix](planner) fix date_xxx functions without complete
function signature (#34761)
new 8264078a9a8 [fix](nereids)4 phase agg may lost parameter in some case
(#34816)
new a07876e807d [fix](planner)correlated predicate should include isnull
predicate (#34833)
new 849eeb39e9c [fix](load) skip sending cancel rpc if VNodeChannel is not
inited (#34897)
new 4b96f9834fd [fix](move-memtable) change brpc connection type to single
(#34883)
new dff61715461 [fix](auto inc) db_id and table_id should be int64_t
instead of int32_t (#34912)
new 0febfc10e45 [Fix](inverted index) fix wrong fs in
inverted_index_file_writer (#34903)
new 5d1f5968ebe [fix](case)fix PolicyTest testMergeFilterNereidsPlanner
failed (#34637)
new b51a4212d68 [fix](txn insert) Fix txn insert values error when connect
to follower fe (#34950)
new db273d578f0 [Fix](tablet id) use int64_t instead of int32_t or
uint32_t for tablet_id (#34962)
The 18 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/agent/be_exec_version_manager.h | 1 +
be/src/olap/iterators.h | 2 +-
be/src/olap/rowset/segment_v2/column_reader.h | 4 +-
.../segment_v2/inverted_index_file_writer.cpp | 2 +-
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 4 +-
be/src/olap/rowset/segment_v2/segment_iterator.h | 4 +-
be/src/olap/schema_cache.cpp | 4 +-
be/src/olap/schema_cache.h | 4 +-
be/src/olap/tablet_schema.h | 12 +-
be/src/olap/utils.h | 4 +-
be/src/olap/wal/wal_reader.cpp | 3 +
be/src/runtime/descriptors.h | 4 +-
be/src/util/brpc_client_cache.h | 6 +-
be/src/vec/exec/format/wal/wal_reader.cpp | 11 +-
be/src/vec/sink/autoinc_buffer.cpp | 7 +
be/src/vec/sink/load_stream_stub.cpp | 6 +-
be/src/vec/sink/writer/vtablet_writer.cpp | 4 +
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 7 +-
.../org/apache/doris/analysis/RestoreStmt.java | 5 +
.../org/apache/doris/analysis/StmtRewriter.java | 3 +-
.../org/apache/doris/backup/BackupJobInfo.java | 4 +
.../java/org/apache/doris/backup/RestoreJob.java | 4 +
.../main/java/org/apache/doris/catalog/MTMV.java | 40 +--
.../apache/doris/job/extensions/mtmv/MTMVTask.java | 6 +-
.../doris/mtmv/MTMVPartitionExprDateTrunc.java | 228 ++++++++++++++++
.../doris/mtmv/MTMVPartitionExprFactory.java | 39 +++
.../doris/mtmv/MTMVPartitionExprService.java | 60 +++++
.../org/apache/doris/mtmv/MTMVPartitionInfo.java | 39 ++-
.../org/apache/doris/mtmv/MTMVPartitionUtil.java | 79 +++---
.../MTMVRelatedPartitionDescGeneratorService.java | 38 +++
.../MTMVRelatedPartitionDescInitGenerator.java | 34 +++
...latedPartitionDescOnePartitionColGenerator.java | 67 +++++
.../MTMVRelatedPartitionDescRollUpGenerator.java | 142 ++++++++++
...TMVRelatedPartitionDescSyncLimitGenerator.java} | 145 +++-------
.../org/apache/doris/mtmv/MTMVRelatedTableIf.java | 29 --
.../main/java/org/apache/doris/mtmv/MTMVUtil.java | 100 +------
.../doris/mtmv/RelatedPartitionDescResult.java | 53 ++++
.../java/org/apache/doris/nereids/memo/Memo.java | 46 ++++
.../doris/nereids/parser/LogicalPlanBuilder.java | 24 +-
.../mv/AbstractMaterializedViewRule.java | 49 +++-
.../mv/LogicalCompatibilityContext.java | 7 +-
.../exploration/mv/MaterializationContext.java | 13 +
.../exploration/mv/mapping/ExpressionMapping.java | 23 --
.../rules/exploration/mv/mapping/Mapping.java | 24 +-
.../exploration/mv/mapping/RelationMapping.java | 18 ++
.../rules/exploration/mv/mapping/SlotMapping.java | 50 ++--
.../rules/implementation/AggregateStrategies.java | 2 +-
.../trees/plans/commands/info/CreateMTMVInfo.java | 86 ++----
.../trees/plans/commands/info/CreateTableInfo.java | 4 +
.../commands/info/MTMVPartitionDefinition.java | 215 +++++++++++++++
.../plans/commands/info/RollupDefinition.java | 14 +-
.../insert/BatchInsertIntoTableCommand.java | 4 +-
.../trees/plans/commands/insert/InsertUtils.java | 29 +-
.../java/org/apache/doris/rewrite/FEFunctions.java | 68 +++++
...TMVRelatedPartitionDescRollUpGeneratorTest.java | 152 +++++++++++
...elatedPartitionDescSyncLimitGeneratorTest.java} | 45 +---
.../java/org/apache/doris/mtmv/MTMVUtilTest.java | 65 -----
.../java/org/apache/doris/policy/PolicyTest.java | 5 +-
.../mtmv_p0/test_hive_limit_partition_mtmv.out | 14 +
.../data/mtmv_p0/test_rollup_partition_mtmv.out | 16 ++
.../correctness_p0/test_subquery_with_agg.groovy | 41 +++
.../mtmv_p0/test_hive_limit_partition_mtmv.groovy | 129 +++++----
.../mtmv_p0/test_rollup_partition_mtmv.groovy | 292 +++++++++++++++++++++
.../test_mv_useless/test_dup_mv_useless.groovy | 23 ++
.../suites/nereids_p0/create_table/ddl/table.sql | 2 +-
.../suites/nereids_syntax_p0/agg_4_phase.groovy | 2 +
.../datetime_functions/test_date_function.groovy | 45 ++++
67 files changed, 2090 insertions(+), 621 deletions(-)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/mtmv/MTMVPartitionExprDateTrunc.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/mtmv/MTMVPartitionExprFactory.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/mtmv/MTMVPartitionExprService.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/mtmv/MTMVRelatedPartitionDescGeneratorService.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/mtmv/MTMVRelatedPartitionDescInitGenerator.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/mtmv/MTMVRelatedPartitionDescOnePartitionColGenerator.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/mtmv/MTMVRelatedPartitionDescRollUpGenerator.java
copy fe/fe-core/src/main/java/org/apache/doris/mtmv/{MTMVUtil.java =>
MTMVRelatedPartitionDescSyncLimitGenerator.java} (56%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/mtmv/RelatedPartitionDescResult.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/info/MTMVPartitionDefinition.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/mtmv/MTMVRelatedPartitionDescRollUpGeneratorTest.java
copy fe/fe-core/src/test/java/org/apache/doris/mtmv/{MTMVUtilTest.java =>
MTMVRelatedPartitionDescSyncLimitGeneratorTest.java} (64%)
create mode 100644 regression-test/data/mtmv_p0/test_rollup_partition_mtmv.out
create mode 100644
regression-test/suites/mtmv_p0/test_rollup_partition_mtmv.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
