This is an automated email from the ASF dual-hosted git repository. lijibing pushed a change to branch high-priority-column in repository https://gitbox.apache.org/repos/asf/doris.git
from 60b02d3f62c Example Modify audit log documents (#31192) add 2d2e9e661cb [fix](stream-load) print stream load profile for pipeline and pipelinex (#31198) add e0e3c3873d1 [fix](Nereids): OuterJoinAssoc reject literal condition (#31172) add 7c056601d14 [Enhancement](group commit) Add bvar and log for group commit (#31017) add 95a235121e7 [feature](cloud) add more cases to cloud_p0 (#31221) add 9aa23a630ef [fix](regression) cloud_p0 should not enable group_commit (#31232) add 90d9707bb63 [regression test]Optimize testUniqueModelSchemaKeyChange (#31150) add c8a793ad6ae [Exec](RF) Support merge remote rf local first (#31067) add b8675bc5d20 [Enhancement] [plsql] support drop store procedure (#30966) (#31001) add 92e1f687e40 [chore](columns) remove update_hashes_with_value for SipHash (#31224) add 35f05fd8713 [fix](audit) The time field in the audit log table is set to the millisecond level (#31096) add c46bcb2f86c Window function sum/avg does not support distinct document modification (#31066) add 8949307ecfa [log](query) add debug log for check query visible version (#31217) add a6f0a4616d6 [fix](group_commit)Fix bound checking problem when reading wal block (#31112) add bd782437631 [doc](create table) add since version for some new features (#30506) add 83ad7a6c210 [pipelineX](refactor) Delete subclasses inherited from Dependency (#31216) add 87ea5244a60 [refine](pipelinex) get sink local state does not require an id. #31195 add b2c0a407a83 [bugfix](docs)Fix some spelling mistakes in english doc (#31241) add 0544f23f2d3 [Improve](InPredict) enhance in predict with struct type (#30840) add 54db467349a [fix](invert index) fix the error issue in the unit test remove_element_only_in_table (#31238) add ba333686d4c [fix](txn insert) Txn insert can not write to table with mv (#31167) add fbc68faea25 Update multi-tenant.md (#31256) add c8376952252 [improvement](hudi)Obtain partition information through HMS's API (#30962) add dcd2afdb4e8 [test](regression) add regression test for schange change of complex type (#31207) add faeb4522814 [Fix](Job)TVF Query JOB Concurrent Reading and Writing Causes Exception (#31248) add 52f4bd51596 [fix][doc] one of the Chinese document references is missing #31236 add d69b14e4903 [fix](chore) fix cloud bin/start.sh permission (#31184) add abb98747a64 [fix](Nereids) simplify airthmetic should not change return type (#31237) add 001af83dbe8 [ci](cloud) add cloud p1 pipeline (#31239) add 223419ff672 [chore](ci) Update .asf.yaml (#31272) add 4f9ef13076b [doc](doc)add some k8s doc (#31194) add ea948c42eb8 Revert "[chore](ci) Update .asf.yaml (#31272)" (#31281) add b62d5ab81da [nereids] downgrade bucket shuffle if tablet num < instance num (#31222) add 07162c46389 [fix](keyword) add BELONG as reserve keyword (#31230) add f8202f9e3d3 [update](hudi) update hudi version to 0.14.1 and compatible with flink hive catalog (#31181) add 8dd4528f37f [Fix](seq-col) Fix sequence column check fail #31252 add 8f60ecffb2a [fix](memory) Fix LRU cache frequent prune (#31220) add 08afd3f4eaa [fix](mtmv) fix mtmv workload group case failed (#31218) add 5797ad9bf73 [regression-test](VariantType) fix and disable unstable case (#31269) add 937909f7d50 [opt](Nereids)choose better column for count star (#31227) add f74b138e3f4 [fix](Nereids) not equals and hashCode should contains generate flag (#31123) add 67ec4190205 [Feature](pipeline) Trace pipeline scheduling (part I) (#31027) add f46f7e2cb2d [fix](create table) Optimize create table function `createPartitionWithIndices` parameters (#31234) add bc9043f97ed [tools] update tools script (#31286) add c08f356e64c [chore](ci) change bucket to keep track of costs (#31274) add 7d1fd1b441b [fix](nereids)show error message if use wrong alias to bind the table (#31264) add b15e83fe1b2 [enhancement](fe) Accelerate replay journal when meta out of date (#31161) add 602af279696 [fix](inverted index) Fix inverted index for MOR unique table (#31051) add 83ec378b6b5 [Feature](explode) support explode map type (#30151) add 1351e224f2b fix partial-update doc (#30612) add 7479fa35ba9 [tools] remove useless conf (#31295) add 4cfd9ee67f4 [fix](jdbc catalog) Fix Resource Closing Logic After Connection Abort (#31219) add 20506a02667 fix total task exec time is far more than actual (#31279) add 449f0c010c0 [docs](fix) modify identity in DROP-USER.md (#30891) add f3ece87b424 [test](mtmv)add p0 filter case (#31271) add 3213c52114b [opt](cancel) Cancel get result future immediately if query is cancelled (#31228) add 18f73292c19 [fix](merge-cloud) support ip/variant type in cloud mode (#31283) add b3a54b4af4c Improve show column stats performance. (#31298) add 48ad8bc52a0 [fix](join) incorrect result of mark join in nested loop join (#31280) add dbd3d31c424 [Feature](function) Support xxhash function like murmur hash function (#31193) add f8feaf4e7d4 [fix](script) Fix `start_fe.sh` missing `METADATA_FAILURE_RECOVERY` with foreground (#31258) add 4403e3012c1 Refactor get row count related interface, add row count cache for external table. (#31276) No new revisions were added by this update. Summary of changes: .github/workflows/comment-to-trigger-teamcity.yml | 58 +- be/src/agent/be_exec_version_manager.h | 1 + be/src/common/compiler_util.h | 2 + be/src/common/config.cpp | 4 +- be/src/common/config.h | 6 +- be/src/exec/data_sink.cpp | 19 - be/src/exec/data_sink.h | 3 - be/src/exprs/runtime_filter.cpp | 77 +-- be/src/exprs/runtime_filter.h | 24 +- be/src/exprs/runtime_filter_slots.h | 11 +- .../action/adjust_tracing_dump.cpp} | 47 +- .../src/http/action/adjust_tracing_dump.h | 26 +- be/src/io/fs/file_system.h | 13 +- be/src/io/fs/local_file_system.h | 13 +- be/src/io/fs/local_file_writer.h | 9 +- be/src/olap/compaction.cpp | 4 +- be/src/olap/olap_server.cpp | 13 +- be/src/olap/rowset/beta_rowset_reader.cpp | 22 +- be/src/olap/rowset/segment_v2/segment_iterator.cpp | 13 +- be/src/olap/storage_engine.h | 1 + be/src/pipeline/exec/aggregation_sink_operator.h | 12 +- be/src/pipeline/exec/aggregation_source_operator.h | 12 +- be/src/pipeline/exec/analytic_sink_operator.cpp | 2 +- be/src/pipeline/exec/analytic_sink_operator.h | 12 +- be/src/pipeline/exec/analytic_source_operator.cpp | 6 +- be/src/pipeline/exec/analytic_source_operator.h | 10 +- be/src/pipeline/exec/assert_num_rows_operator.h | 4 +- be/src/pipeline/exec/data_queue.h | 5 - be/src/pipeline/exec/datagen_operator.cpp | 9 +- .../distinct_streaming_aggregation_operator.cpp | 2 +- .../exec/distinct_streaming_aggregation_operator.h | 4 +- be/src/pipeline/exec/empty_set_operator.h | 4 +- be/src/pipeline/exec/es_scan_operator.cpp | 2 +- be/src/pipeline/exec/exchange_sink_buffer.h | 5 +- be/src/pipeline/exec/exchange_sink_operator.cpp | 5 +- be/src/pipeline/exec/exchange_sink_operator.h | 62 +-- be/src/pipeline/exec/exchange_source_operator.cpp | 4 +- be/src/pipeline/exec/exchange_source_operator.h | 26 +- be/src/pipeline/exec/file_scan_operator.cpp | 2 +- be/src/pipeline/exec/hashjoin_build_sink.cpp | 28 +- be/src/pipeline/exec/hashjoin_build_sink.h | 18 +- be/src/pipeline/exec/hashjoin_probe_operator.cpp | 4 +- be/src/pipeline/exec/hashjoin_probe_operator.h | 10 +- be/src/pipeline/exec/join_build_sink_operator.cpp | 20 +- be/src/pipeline/exec/join_build_sink_operator.h | 6 +- be/src/pipeline/exec/join_probe_operator.cpp | 24 +- be/src/pipeline/exec/join_probe_operator.h | 8 +- be/src/pipeline/exec/multi_cast_data_stream_sink.h | 12 +- .../exec/multi_cast_data_stream_source.cpp | 3 +- .../pipeline/exec/multi_cast_data_stream_source.h | 15 +- be/src/pipeline/exec/multi_cast_data_streamer.h | 6 +- .../exec/nested_loop_join_build_operator.cpp | 8 +- .../exec/nested_loop_join_build_operator.h | 10 +- .../exec/nested_loop_join_probe_operator.cpp | 16 +- .../exec/nested_loop_join_probe_operator.h | 10 +- be/src/pipeline/exec/olap_scan_operator.cpp | 4 +- .../pipeline/exec/partition_sort_sink_operator.cpp | 2 +- .../pipeline/exec/partition_sort_sink_operator.h | 12 +- .../exec/partition_sort_source_operator.cpp | 2 +- .../pipeline/exec/partition_sort_source_operator.h | 14 +- be/src/pipeline/exec/repeat_operator.h | 4 +- be/src/pipeline/exec/result_sink_operator.cpp | 3 +- be/src/pipeline/exec/result_sink_operator.h | 13 +- be/src/pipeline/exec/scan_operator.cpp | 24 +- be/src/pipeline/exec/scan_operator.h | 47 +- be/src/pipeline/exec/select_operator.h | 4 +- be/src/pipeline/exec/set_probe_sink_operator.cpp | 5 +- be/src/pipeline/exec/set_probe_sink_operator.h | 21 +- be/src/pipeline/exec/set_sink_operator.cpp | 4 +- be/src/pipeline/exec/set_sink_operator.h | 16 +- be/src/pipeline/exec/set_source_operator.cpp | 2 +- be/src/pipeline/exec/set_source_operator.h | 12 +- be/src/pipeline/exec/sort_sink_operator.cpp | 2 +- be/src/pipeline/exec/sort_sink_operator.h | 12 +- be/src/pipeline/exec/sort_source_operator.cpp | 2 +- be/src/pipeline/exec/sort_source_operator.h | 10 +- .../pipeline/exec/streaming_aggregation_operator.h | 4 +- be/src/pipeline/exec/union_sink_operator.h | 12 +- be/src/pipeline/exec/union_source_operator.h | 12 +- be/src/pipeline/pipeline.cpp | 13 +- be/src/pipeline/pipeline.h | 18 +- be/src/pipeline/pipeline_fragment_context.cpp | 52 +- be/src/pipeline/pipeline_fragment_context.h | 13 +- be/src/pipeline/pipeline_task.h | 11 +- be/src/pipeline/pipeline_tracing.cpp | 158 ++++++ be/src/pipeline/pipeline_tracing.h | 83 +++ be/src/pipeline/pipeline_x/dependency.cpp | 2 +- be/src/pipeline/pipeline_x/dependency.h | 46 +- .../local_exchange/local_exchange_sink_operator.h | 13 +- .../local_exchange_source_operator.cpp | 11 - .../local_exchange_source_operator.h | 15 +- .../pipeline_x/local_exchange/local_exchanger.h | 1 - be/src/pipeline/pipeline_x/operator.cpp | 168 +++--- be/src/pipeline/pipeline_x/operator.h | 46 +- .../pipeline_x/pipeline_x_fragment_context.cpp | 101 ++-- .../pipeline_x/pipeline_x_fragment_context.h | 9 +- be/src/pipeline/pipeline_x/pipeline_x_task.cpp | 22 +- be/src/pipeline/pipeline_x/pipeline_x_task.h | 7 +- be/src/pipeline/task_scheduler.cpp | 80 ++- be/src/pipeline/task_scheduler.h | 3 - be/src/runtime/buffer_control_block.cpp | 2 +- be/src/runtime/buffer_control_block.h | 6 +- be/src/runtime/exec_env.h | 25 +- be/src/runtime/exec_env_init.cpp | 2 + be/src/runtime/fragment_mgr.cpp | 7 +- be/src/runtime/group_commit_mgr.cpp | 4 + be/src/runtime/group_commit_mgr.h | 4 + be/src/runtime/memory/cache_manager.cpp | 18 +- be/src/runtime/memory/cache_manager.h | 19 + be/src/runtime/memory/cache_policy.h | 2 +- be/src/runtime/memory/lru_cache_policy.h | 30 +- be/src/runtime/query_context.cpp | 24 +- be/src/runtime/query_context.h | 11 +- be/src/runtime/runtime_filter_mgr.cpp | 91 ++- be/src/runtime/runtime_filter_mgr.h | 32 +- be/src/runtime/runtime_state.cpp | 42 +- be/src/runtime/runtime_state.h | 26 +- be/src/service/http_service.cpp | 16 +- be/src/util/hash_util.hpp | 11 + be/src/util/thrift_util.cpp | 34 +- be/src/util/thrift_util.h | 20 +- be/src/vec/columns/column.h | 22 - be/src/vec/columns/column_array.cpp | 5 - be/src/vec/columns/column_array.h | 3 - be/src/vec/columns/column_complex.h | 11 +- be/src/vec/columns/column_const.cpp | 16 - be/src/vec/columns/column_const.h | 3 - be/src/vec/columns/column_decimal.cpp | 6 - be/src/vec/columns/column_decimal.h | 2 - be/src/vec/columns/column_map.cpp | 5 - be/src/vec/columns/column_map.h | 3 - be/src/vec/columns/column_nullable.cpp | 19 - be/src/vec/columns/column_nullable.h | 2 - be/src/vec/columns/column_string.h | 5 - be/src/vec/columns/column_struct.cpp | 5 - be/src/vec/columns/column_struct.h | 3 - be/src/vec/columns/column_vector.cpp | 6 - be/src/vec/columns/column_vector.h | 3 - be/src/vec/exec/format/wal/wal_reader.cpp | 21 +- be/src/vec/exec/join/vhash_join_node.cpp | 6 +- be/src/vec/exec/join/vnested_loop_join_node.cpp | 4 +- be/src/vec/exec/join/vnested_loop_join_node.h | 9 +- be/src/vec/exec/runtime_filter_consumer.cpp | 23 +- be/src/vec/exec/runtime_filter_consumer.h | 4 +- be/src/vec/exec/scan/pip_scanner_context.h | 6 +- be/src/vec/exec/scan/scanner_context.h | 1 - be/src/vec/exec/vdata_gen_scan_node.cpp | 9 +- .../table_function/table_function_factory.cpp | 2 + be/src/vec/exprs/table_function/vexplode_map.cpp | 125 +++++ be/src/vec/exprs/table_function/vexplode_map.h | 68 +++ be/src/vec/exprs/vin_predicate.cpp | 3 + be/src/vec/functions/function_fake.cpp | 15 + be/src/vec/functions/function_hash.cpp | 153 ++++-- .../src/vec/functions/function_struct_in.cpp | 21 +- be/src/vec/functions/function_struct_in.h | 169 ++++++ be/src/vec/functions/in.h | 3 +- be/src/vec/functions/simple_function_factory.h | 2 + be/src/vec/runtime/shared_hash_table_controller.h | 7 +- be/src/vec/runtime/vdata_stream_recvr.cpp | 10 +- be/src/vec/runtime/vdata_stream_recvr.h | 18 +- be/src/vec/sink/group_commit_block_sink.cpp | 8 +- be/src/vec/sink/vdata_stream_sender.cpp | 3 +- be/src/vec/sink/vdata_stream_sender.h | 4 +- .../inverted_index_searcher_cache_test.cpp | 2 +- be/test/vec/columns/column_hash_func_test.cpp | 59 +- be/test/vec/exec/vwal_scanner_test.cpp | 155 +++--- be/test/vec/function/function_hash_test.cpp | 64 +++ bin/start_fe.sh | 2 +- build.sh | 1 + cloud/script/start.sh | 4 +- .../hive/scripts/create_preinstalled_table.hql | 14 + .../community/design/doris_storage_optimization.md | 4 +- .../developer-guide/cpp-diagnostic-code.md | 2 +- .../commit-format-specification.md | 2 +- docs/en/community/join-community.md | 2 +- .../release-and-verify/release-complete.md | 2 +- .../http-actions/fe/debug-point-action.md | 6 +- .../admin-manual/http-actions/fe/metrics-action.md | 2 +- docs/en/docs/admin-manual/privilege-ldap/ranger.md | 2 +- docs/en/docs/advanced/compute-node.md | 2 +- docs/en/docs/advanced/partition/auto-partition.md | 2 +- .../data-operate/update-delete/partial-update.md | 2 +- docs/en/docs/data-table/hit-the-rollup.md | 2 +- docs/en/docs/install/k8s-deploy/debug-crash.md | 73 +++ .../k8s-deploy/expansion-and-contraction.md | 100 ++++ docs/en/docs/install/k8s-deploy/root-user-use.md | 63 +++ docs/en/docs/lakehouse/multi-catalog/hudi.md | 6 + .../hash-functions/murmur-hash3-32.md | 2 + .../hash-functions/murmur-hash3-64.md | 2 + .../{murmur-hash3-32.md => xxhash-32.md} | 52 +- .../sql-functions/hash-functions/xxhash-64.md | 85 +++ .../sql-functions/table-functions/explode_map.md | 131 +++++ .../window-functions/window-function-avg.md | 2 +- .../window-functions/window-function-sum.md | 2 +- .../Create/CREATE-TABLE.md | 4 +- docs/sidebars.json | 9 +- docs/zh-CN/docs/admin-manual/multi-tenant.md | 1 + .../data-operate/update-delete/partial-update.md | 2 +- docs/zh-CN/docs/data-table/hit-the-rollup.md | 2 +- docs/zh-CN/docs/install/k8s-deploy/debug-crash.md | 73 +++ .../k8s-deploy/expansion-and-contraction.md | 100 ++++ .../zh-CN/docs/install/k8s-deploy/root-user-use.md | 63 +++ docs/zh-CN/docs/lakehouse/multi-catalog/hudi.md | 6 + .../hash-functions/murmur-hash3-32.md | 4 +- .../hash-functions/murmur-hash3-64.md | 4 +- .../{murmur-hash3-32.md => xxhash-32.md} | 53 +- .../sql-functions/hash-functions/xxhash-64.md | 84 +++ .../sql-functions/table-functions/explode_map.md | 132 +++++ .../window-functions/window-function-avg.md | 2 +- .../window-functions/window-function-sum.md | 2 +- .../Account-Management-Statements/DROP-USER.md | 2 +- .../Create/CREATE-TABLE.md | 4 +- .../org/apache/doris/hudi/BaseSplitReader.scala | 2 +- .../java/org/apache/doris/jdbc/JdbcExecutor.java | 60 +- .../main/java/org/apache/doris/common/Config.java | 4 + .../antlr4/org/apache/doris/nereids/DorisLexer.g4 | 1 + .../antlr4/org/apache/doris/nereids/DorisParser.g4 | 4 +- .../antlr4/org/apache/doris/nereids/PLParser.g4 | 4 + fe/fe-core/src/main/cup/sql_parser.cup | 4 +- .../java/org/apache/doris/analysis/IndexDef.java | 16 +- .../apache/doris/analysis/NativeInsertStmt.java | 63 ++- .../apache/doris/analysis/ShowColumnStatsStmt.java | 4 + .../doris/catalog/BuiltinScalarFunctions.java | 4 + .../catalog/BuiltinTableGeneratingFunctions.java | 4 + .../main/java/org/apache/doris/catalog/Column.java | 8 + .../main/java/org/apache/doris/catalog/Env.java | 94 ++-- .../java/org/apache/doris/catalog/FunctionSet.java | 1 + .../org/apache/doris/catalog/InternalSchema.java | 2 +- .../java/org/apache/doris/catalog/OlapTable.java | 7 +- .../main/java/org/apache/doris/catalog/Table.java | 29 +- .../java/org/apache/doris/catalog/TableIf.java | 9 +- .../cloud/datasource/CloudInternalCatalog.java | 53 +- .../main/java/org/apache/doris/common/Status.java | 1 + .../apache/doris/common/util/PropertyAnalyzer.java | 4 +- .../doris/datasource/ExternalMetaCacheMgr.java | 10 +- .../doris/datasource/ExternalRowCountCache.java | 112 ++++ .../org/apache/doris/datasource/ExternalTable.java | 15 +- .../apache/doris/datasource/InternalCatalog.java | 154 +++--- .../doris/datasource/hive/HMSExternalTable.java | 88 +-- .../hudi/source/HudiCachedPartitionProcessor.java | 27 +- .../hudi/source/HudiPartitionProcessor.java | 4 +- .../doris/datasource/hudi/source/HudiScanNode.java | 28 +- .../doris/datasource/jdbc/JdbcExternalTable.java | 26 - .../org/apache/doris/job/base/AbstractJob.java | 7 +- .../doris/load/routineload/RoutineLoadJob.java | 9 +- .../doris/nereids/parser/LogicalPlanBuilder.java | 21 +- .../properties/ChildrenPropertiesRegulator.java | 58 ++ .../nereids/rules/analysis/BindExpression.java | 41 +- .../doris/nereids/rules/analysis/BindSink.java | 11 +- .../doris/nereids/rules/analysis/SlotBinder.java | 3 + .../rules/exploration/join/OuterJoinAssoc.java | 2 +- .../exploration/join/OuterJoinAssocProject.java | 2 +- .../mv/AbstractMaterializedViewRule.java | 12 +- .../expression/rules/SimplifyArithmeticRule.java | 3 +- .../doris/nereids/rules/rewrite/ColumnPruning.java | 42 +- .../nereids/rules/rewrite/EliminateNotNull.java | 11 +- .../nereids/rules/rewrite/EliminateOuterJoin.java | 9 +- .../nereids/rules/rewrite/InferAggNotNull.java | 25 +- .../nereids/rules/rewrite/InferFilterNotNull.java | 26 +- .../doris/nereids/stats/StatsCalculator.java | 2 +- .../nereids/trees/expressions/Expression.java | 1 - .../nereids/trees/expressions/InPredicate.java | 10 + .../doris/nereids/trees/expressions/Not.java | 27 +- .../functions/executable/NumericArithmetic.java | 8 +- .../functions/generator/ExplodeMap.java | 80 +++ .../functions/generator/ExplodeMapOuter.java | 80 +++ .../expressions/functions/scalar/XxHash32.java | 72 +++ .../expressions/functions/scalar/XxHash64.java | 72 +++ .../trees/expressions/literal/StructLiteral.java | 13 +- .../expressions/visitor/ScalarFunctionVisitor.java | 10 + .../visitor/TableGeneratingFunctionVisitor.java | 10 + .../apache/doris/nereids/trees/plans/PlanType.java | 3 +- .../trees/plans/commands/DeleteFromCommand.java | 24 +- .../trees/plans/commands/DropProcedureCommand.java | 62 +++ .../trees/plans/commands/info/IndexDefinition.java | 16 +- .../trees/plans/logical/LogicalGenerate.java | 30 +- .../trees/plans/visitor/CommandVisitor.java | 5 + .../apache/doris/nereids/util/ExpressionUtils.java | 14 +- .../doris/nereids/util/TypeCoercionUtils.java | 11 +- .../org/apache/doris/planner/OlapScanNode.java | 5 + .../src/main/java/org/apache/doris/plsql/Exec.java | 33 ++ .../doris/plugin/audit/AuditLoaderPlugin.java | 2 +- .../main/java/org/apache/doris/qe/Coordinator.java | 10 +- .../java/org/apache/doris/qe/ResultReceiver.java | 47 +- .../java/org/apache/doris/qe/SessionVariable.java | 11 +- .../java/org/apache/doris/qe/ShowExecutor.java | 40 +- .../apache/doris/service/FrontendServiceImpl.java | 2 +- .../apache/doris/statistics/AnalysisManager.java | 5 +- ...CacheLoader.java => BasicAsyncCacheLoader.java} | 17 +- .../statistics/ColumnStatisticsCacheLoader.java | 2 +- .../apache/doris/statistics/HMSAnalysisTask.java | 4 +- .../doris/statistics/HistogramCacheLoader.java | 2 +- .../doris/statistics/OlapScanStatsDerive.java | 2 +- .../doris/statistics/StatisticConstants.java | 1 - .../doris/statistics/StatisticsCacheKey.java | 1 + .../doris/statistics/StatisticsRepository.java | 13 + .../doris/statistics/util/StatisticsUtil.java | 9 +- .../apache/doris/common/PropertyAnalyzerTest.java | 2 +- .../doris/load/routineload/RoutineLoadJobTest.java | 4 +- .../doris/nereids/jobs/joinorder/TPCHTest.java | 40 +- .../nereids/rules/rewrite/InferAggNotNullTest.java | 4 +- fe/pom.xml | 2 +- gensrc/script/doris_builtins_functions.py | 6 +- .../data/external_table_p2/hive/test_hive_hudi.out | 16 + .../data/index_p0/test_bitmap_index.out | 6 +- regression-test/data/insert_p0/txn_insert.out | 12 + .../inverted_index_p0/test_inverted_index_mor.out | 30 + .../join/test_nestedloop_semi_anti_join.out | 9 + .../hash_functions/test_hash_function.out | 17 + .../sql_functions/table_function/explode_map.out | 51 ++ .../eliminate_not_null/eliminate_not_null.out | 16 +- .../test_simplify_arithmetic.out | 3 + .../nereids_syntax_p0/inpredicate_with_struct.out | 19 + .../join/test_nestedloop_semi_anti_join.out | 9 + .../hash_functions/test_hash_function.out | 17 + .../test_unique_model_schema_key_change.out | 121 ++++ ...ut => test_segcompaction_unique_keys_index.out} | 0 .../doris/regression/action/ExplainAction.groovy | 7 +- .../org/apache/doris/regression/suite/Suite.groovy | 4 +- .../pipeline/cloud_p0/conf/be_custom.conf | 1 - .../pipeline/cloud_p0/conf/fe_custom.conf | 3 - .../cloud_p0/conf/regression-conf-custom.groovy | 2 +- .../{cloud_p0 => cloud_p1}/conf/be_custom.conf | 1 - .../{cloud_p0 => cloud_p1}/conf/fe_custom.conf | 3 - .../cloud_p1/conf/regression-conf-custom.groovy | 1 + .../conf/session_variables.sql | 0 regression-test/pipeline/common/doris-utils.sh | 13 +- regression-test/pipeline/common/github-utils.sh | 4 + regression-test/pipeline/common/teamcity-utils.sh | 2 + .../suites/datatype_p0/scalar_types/load.groovy | 54 ++ .../sql/unique2_bitmap_index_q01_bool.sql | 0 .../sql/unique2_bitmap_index_q02_tinyint.sql | 0 .../sql/unique2_bitmap_index_q03_smallint.sql | 0 .../sql/unique2_bitmap_index_q04_int.sql | 0 .../sql/unique2_bitmap_index_q05_bigint.sql | 0 .../sql/unique2_bitmap_index_q06_largeint.sql | 0 .../sql/unique2_bitmap_index_q07_float.sql | 0 .../sql/unique2_bitmap_index_q08_double.sql | 0 .../sql/unique2_bitmap_index_q09_decimal.sql | 0 .../sql/unique2_bitmap_index_q10_decimalv3.sql | 0 .../sql/unique2_bitmap_index_q11_date.sql | 0 .../sql/unique2_bitmap_index_q12_datetime.sql | 0 .../sql/unique2_bitmap_index_q13_datev2.sql | 0 .../sql/unique2_bitmap_index_q14_datetimev2.sql | 0 .../sql/unique2_bitmap_index_q15_char.sql | 0 .../sql/unique2_bitmap_index_q16_varchar.sql | 0 .../sql/unique2_bitmap_index_q17_string.sql | 0 .../hive/test_hive_parquet.groovy | 10 + .../external_table_p2/hive/test_hive_hudi.groovy | 6 + .../test_build_index_fault.groovy | 4 +- .../suites/index_p0/test_bitmap_index.groovy | 4 +- regression-test/suites/insert_p0/txn_insert.groovy | 21 +- .../test_index_compaction_null.groovy | 1 + .../inverted_index_p0/test_bitmap_index.groovy | 2 +- .../inverted_index_p0/test_build_index.groovy | 4 +- .../inverted_index_p0/test_inverted_index.groovy | 2 +- .../test_inverted_index_mor.groovy | 78 +++ .../suites/inverted_index_p0/test_show_data.groovy | 2 + .../suites/mtmv_p0/test_workload_group_mtmv.groovy | 2 +- .../join/test_nestedloop_semi_anti_join.groovy | 8 + .../hash_functions/test_hash_function.groovy | 8 + .../table_function/explode_map.groovy | 55 ++ .../bind_relation/bind_view.groovy | 7 + .../test_simplify_arithmetic.groovy} | 26 +- .../filter_equal_or_notequal.groovy | 609 +++++++++++++++++++++ .../inpredicate_with_struct.groovy | 41 ++ .../suites/plsql_p0/test_plsql_loop_cursor.groovy | 4 + .../join/test_nestedloop_semi_anti_join.groovy | 9 + .../hash_functions/test_hash_function.groovy | 8 + .../test_unique_model_schema_key_change.groovy | 270 +++++++++ .../test_segcompaction_unique_keys_index.groovy | 55 +- .../suites/statistics/test_analyze_mv.groovy | 42 +- .../test_double_write_when_schema_change.groovy | 4 +- ...heListOfTopRepositoriesChangedOverTheYears7.sql | 59 +- regression-test/suites/variant_p2/sql/sql08.sql | 2 +- tools/tpcds-tools/bin/create-tpcds-tables.sh | 5 + tools/tpcds-tools/bin/run-tpcds-queries.sh | 12 +- .../constraints/build-fk-constraints.sql | 3 + .../constraints/build-pk-constraints.sql | 2 + .../constraints/build-uk-constraints.sql | 1 + 380 files changed, 6125 insertions(+), 2102 deletions(-) copy be/src/{io/fs/local_file_writer.h => http/action/adjust_tracing_dump.cpp} (52%) copy regression-test/suites/query_p0/sql_functions/hash_functions/test_hash_function.groovy => be/src/http/action/adjust_tracing_dump.h (65%) create mode 100644 be/src/pipeline/pipeline_tracing.cpp create mode 100644 be/src/pipeline/pipeline_tracing.h create mode 100644 be/src/vec/exprs/table_function/vexplode_map.cpp create mode 100644 be/src/vec/exprs/table_function/vexplode_map.h copy regression-test/suites/query_p0/sql_functions/hash_functions/test_hash_function.groovy => be/src/vec/functions/function_struct_in.cpp (65%) create mode 100644 be/src/vec/functions/function_struct_in.h create mode 100644 docs/en/docs/install/k8s-deploy/debug-crash.md create mode 100644 docs/en/docs/install/k8s-deploy/expansion-and-contraction.md create mode 100644 docs/en/docs/install/k8s-deploy/root-user-use.md copy docs/en/docs/sql-manual/sql-functions/hash-functions/{murmur-hash3-32.md => xxhash-32.md} (53%) create mode 100644 docs/en/docs/sql-manual/sql-functions/hash-functions/xxhash-64.md create mode 100644 docs/en/docs/sql-manual/sql-functions/table-functions/explode_map.md create mode 100644 docs/zh-CN/docs/install/k8s-deploy/debug-crash.md create mode 100644 docs/zh-CN/docs/install/k8s-deploy/expansion-and-contraction.md create mode 100644 docs/zh-CN/docs/install/k8s-deploy/root-user-use.md copy docs/zh-CN/docs/sql-manual/sql-functions/hash-functions/{murmur-hash3-32.md => xxhash-32.md} (53%) create mode 100644 docs/zh-CN/docs/sql-manual/sql-functions/hash-functions/xxhash-64.md create mode 100644 docs/zh-CN/docs/sql-manual/sql-functions/table-functions/explode_map.md create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/ExternalRowCountCache.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/generator/ExplodeMap.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/generator/ExplodeMapOuter.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/XxHash32.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/XxHash64.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/DropProcedureCommand.java rename fe/fe-core/src/main/java/org/apache/doris/statistics/{StatisticsCacheLoader.java => BasicAsyncCacheLoader.java} (80%) create mode 100644 regression-test/data/inverted_index_p0/test_inverted_index_mor.out create mode 100644 regression-test/data/nereids_p0/sql_functions/table_function/explode_map.out create mode 100644 regression-test/data/nereids_rules_p0/expression/simplify_arithmetic/test_simplify_arithmetic.out create mode 100644 regression-test/data/nereids_syntax_p0/inpredicate_with_struct.out create mode 100644 regression-test/data/schema_change_p0/test_unique_model_schema_key_change.out copy regression-test/data/segcompaction_p2/{test_segcompaction_unique_keys_mow_index.out => test_segcompaction_unique_keys_index.out} (100%) copy regression-test/pipeline/{cloud_p0 => cloud_p1}/conf/be_custom.conf (93%) copy regression-test/pipeline/{cloud_p0 => cloud_p1}/conf/fe_custom.conf (92%) create mode 100644 regression-test/pipeline/cloud_p1/conf/regression-conf-custom.groovy copy regression-test/pipeline/{cloud_p0 => cloud_p1}/conf/session_variables.sql (100%) copy regression-test/suites/{datatype_p2 => datatype_p0}/scalar_types/sql/unique2_bitmap_index_q01_bool.sql (100%) copy regression-test/suites/{datatype_p2 => datatype_p0}/scalar_types/sql/unique2_bitmap_index_q02_tinyint.sql (100%) copy regression-test/suites/{datatype_p2 => datatype_p0}/scalar_types/sql/unique2_bitmap_index_q03_smallint.sql (100%) copy regression-test/suites/{datatype_p2 => datatype_p0}/scalar_types/sql/unique2_bitmap_index_q04_int.sql (100%) copy regression-test/suites/{datatype_p2 => datatype_p0}/scalar_types/sql/unique2_bitmap_index_q05_bigint.sql (100%) copy regression-test/suites/{datatype_p2 => datatype_p0}/scalar_types/sql/unique2_bitmap_index_q06_largeint.sql (100%) copy regression-test/suites/{datatype_p2 => datatype_p0}/scalar_types/sql/unique2_bitmap_index_q07_float.sql (100%) copy regression-test/suites/{datatype_p2 => datatype_p0}/scalar_types/sql/unique2_bitmap_index_q08_double.sql (100%) copy regression-test/suites/{datatype_p2 => datatype_p0}/scalar_types/sql/unique2_bitmap_index_q09_decimal.sql (100%) copy regression-test/suites/{datatype_p2 => datatype_p0}/scalar_types/sql/unique2_bitmap_index_q10_decimalv3.sql (100%) copy regression-test/suites/{datatype_p2 => datatype_p0}/scalar_types/sql/unique2_bitmap_index_q11_date.sql (100%) copy regression-test/suites/{datatype_p2 => datatype_p0}/scalar_types/sql/unique2_bitmap_index_q12_datetime.sql (100%) copy regression-test/suites/{datatype_p2 => datatype_p0}/scalar_types/sql/unique2_bitmap_index_q13_datev2.sql (100%) copy regression-test/suites/{datatype_p2 => datatype_p0}/scalar_types/sql/unique2_bitmap_index_q14_datetimev2.sql (100%) copy regression-test/suites/{datatype_p2 => datatype_p0}/scalar_types/sql/unique2_bitmap_index_q15_char.sql (100%) copy regression-test/suites/{datatype_p2 => datatype_p0}/scalar_types/sql/unique2_bitmap_index_q16_varchar.sql (100%) copy regression-test/suites/{datatype_p2 => datatype_p0}/scalar_types/sql/unique2_bitmap_index_q17_string.sql (100%) create mode 100644 regression-test/suites/inverted_index_p0/test_inverted_index_mor.groovy create mode 100644 regression-test/suites/nereids_p0/sql_functions/table_function/explode_map.groovy copy regression-test/suites/{nereids_p0/sql_functions/hash_functions/test_hash_function.groovy => nereids_rules_p0/expression/simplify_arithmetic/test_simplify_arithmetic.groovy} (60%) create mode 100644 regression-test/suites/nereids_rules_p0/mv/dimension_equal/filter_equal_or_notequal.groovy create mode 100644 regression-test/suites/nereids_syntax_p0/inpredicate_with_struct.groovy create mode 100644 regression-test/suites/schema_change_p0/test_unique_model_schema_key_change.groovy create mode 100644 tools/tpcds-tools/constraints/build-fk-constraints.sql create mode 100644 tools/tpcds-tools/constraints/build-pk-constraints.sql create mode 100644 tools/tpcds-tools/constraints/build-uk-constraints.sql --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org