This is an automated email from the ASF dual-hosted git repository.
zykkk pushed a change to branch auto-pick-43348-branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
discard cfc8ccdbc4b [fix](test) fix clickhouse jdbc catalog func with cast
push down case (#43348)
add c3e6702d287 branch-2.1: [fix](array-funcs)fix array funcs which ret
can be nullable (#43354)
add 12bb38eab37 [fix](build index)Fix build index failed on renamed column
(#42882)(#43246)(#43336) (#43266)
add 7de7541ec6e branch-2.1: [fix](ES Catalog)Only like on keyword can be
applied to wildcard query (#43400)
add f6ddd818cd7 [tests](inverted index)Add and improve add/drop index
cases (#36811) (#43463)
add 1ac00ea9830 branch-2.1: [feat](doris compose) Copy lastest compose
code from master branch (#43464)
add 90da65c7b87 [fix](block-reader) Make rowsets union iterating work
(#40877) (#43175)
add 6006907c79f [improve](restore) Compress backup/restore job log size by
compress (#42463)
add 1b6d47d351f [fix](task) Abort creating replica task if sending RPC
failed #42276 (#42963)
add 031ee992e71 [feature](binlog) Allow BarrierLog to wrap another binlog
#42993 (#43485)
add 69eb02b96f1 [chore](restore) Save restore stmt to the resp if
RestoreSnapshot failed #42933 (#42985)
add 80de533b7c7 [improve](backup) Only compress the running backup/restore
job #43177 #43278 (#43487)
add 31480d11d7e [improve](task) Support splitting agent batch tasks
automatically #42703 (#43483)
add 2e8753b0cdd [fix](restore) Add synchronized to avoid concurrent
modification #43172 (#43486)
add 57c794ba771 [fix](backup) Fix compressed backup job #43197 (#43484)
add 8f2f4e93947 [feature](binlog) Wrap rename table/column binlog in
BarrierLog #43033 (#43168)
add 2ba88ed2a80 [improve](report) split agent batch tasks automaticlly
#43257 (#43365)
add 95cfe72f614 [test](p0) fix load stream leak in injection cases
(#42681) (#43505)
add fefc8a8efbe branch-2.1: [fix](new_json_reader)fix new_json_reader core
(#43188)
add 9d7bc5b7652 [pick](branch-2.1) pick #38215 (#43386)
add 5195d61b6f6 [fix](profile) update_rpc_time when enable_verbose_profile
= false (#43096)
add d9339564496 [branch-2.1](timezone) Preload time offset in datetime
(#42395) (#42607)
add e8d4c4cb7a8 branch-2.1: [fix](regression) fix flaky partial update
cases (#43143)
add 486dfe9f420 branch-2.1: [fix](auth)Fix concurrency issue during role
manager upgrade (#43194)
add fba06b33b9f [cherry-pick](branch-2.1)add SessionVariable for
enableCooldownReplicaAffinity (#42675)
add 625a1ea6ad0 branch-2.1: [Optimize](Expr) Opt getting value of VLitreal
(#43249)
add fe1b8d44fdc branch-2.1: [fix](mtmv)Fix the problem where the job does
not exist, which prevents the deletion of MTMV (#43325)
add 80fd76677ed branch-2.1: [Improvement](LDAP Auth)Enhance LDAP
authentication with a configurable group filter (#43293)
add ea67e3a6b47 branch-2.1: [enhance](mtmv)MTMV interface optimization
(#43329)
add 1d740ff8256 [fix](auditlog) set isQuery to true when query is short
circuited (#42647) (#43345)
add 182f37f8371 [fix](planner) NullLiteral should always having a correct
Type and set to be analyzed (#43371)
add 5ac3aee460c branch-2.1: [opt](max-compute) avoid repeated location
path creation (#43383)
add 4c7e495392d [cherry-pick](branch-2.1) fix wrong property of S3
resource (#43413)
add 8867a826bca [opt](arm) Optimize the BlockBloomFilter::bucket_find on
ARM platform… (#43508)
add 72b1e2a346c [fix](Outfile) forbid parallel outfile if pipeline engine
enabled. (#43437)
add b9e5d878fc7 [refine](bits) refine bytes_mask_to_bits_mask code
(#38360) (#43511)
add 91eb8f83656 branch-2.1: [chore](log) Use correct error type of uneven
user behaviour (#43494)
add 138103f9eba [opt](arm)Remove negative optimizations of SSE2NEON on
memcmp for ARM… (#43510)
add ebe6b4d4db9 [Opt](Serde) optimize serialization to string on variant
type (#43237) (#43342)
add e073b575cce [Opt](TabletSchema) reuse TabletColumn info to reduce mem
(#42448) (#43349)
add 5dda61b410c [fix](backup) Load backup meta and job info bytes from
disk #43276 (#43519)
add 5939200076f [Impl](Nereids) add propagateNullLiteral trait for special
functions (#42256) (#43491)
add d95a3131346 [fix](test) fix clickhouse jdbc catalog func with cast
push down case (#43348)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (cfc8ccdbc4b)
\
N -- N -- N refs/heads/auto-pick-43348-branch-2.1 (d95a3131346)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
be/src/exprs/block_bloom_filter.hpp | 36 ++-
be/src/exprs/block_bloom_filter_impl.cc | 29 +-
be/src/olap/compaction.cpp | 4 +-
be/src/olap/merger.cpp | 26 +-
be/src/olap/rowset/beta_rowset_reader.cpp | 6 +
be/src/olap/rowset/rowset.h | 8 +-
be/src/olap/rowset/rowset_reader_context.h | 2 +
.../rowset/segment_v2/inverted_index_writer.cpp | 17 +
.../olap/rowset/segment_v2/inverted_index_writer.h | 19 +-
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 30 +-
...ema_cache.cpp => tablet_column_object_pool.cpp} | 44 ++-
be/src/olap/tablet_column_object_pool.h | 60 ++++
be/src/olap/tablet_reader.cpp | 1 +
be/src/olap/tablet_reader.h | 1 +
be/src/olap/tablet_schema.cpp | 57 ++--
be/src/olap/tablet_schema.h | 20 +-
be/src/olap/tablet_schema_cache.cpp | 21 +-
be/src/olap/task/index_builder.cpp | 41 ++-
be/src/pipeline/exec/exchange_sink_buffer.cpp | 20 +-
be/src/pipeline/exec/result_sink_operator.cpp | 5 +-
be/src/runtime/exec_env.h | 6 +
be/src/runtime/exec_env_init.cpp | 4 +
be/src/runtime/memory/cache_policy.h | 6 +-
be/src/util/arrow/row_batch.cpp | 37 ++-
be/src/util/arrow/row_batch.h | 11 +-
be/src/util/block_compression.cpp | 1 +
be/src/util/simd/bits.h | 80 ++++-
be/src/util/timezone_utils.cpp | 50 ++-
be/src/util/timezone_utils.h | 3 +
be/src/vec/columns/column_array.cpp | 5 +-
be/src/vec/columns/column_decimal.cpp | 37 ++-
be/src/vec/columns/column_map.cpp | 2 +-
be/src/vec/columns/column_object.cpp | 24 +-
be/src/vec/columns/column_vector.cpp | 38 +--
be/src/vec/columns/columns_common.cpp | 37 ++-
be/src/vec/common/memcmp_small.h | 2 +-
be/src/vec/exec/format/json/new_json_reader.cpp | 5 +
be/src/vec/exprs/vliteral.cpp | 11 +-
.../vec/functions/array/function_array_distance.h | 2 +-
.../vec/functions/array/function_array_element.h | 2 +-
be/src/vec/functions/array/function_array_index.h | 8 +-
.../array/function_array_with_constant.cpp | 4 +-
be/src/vec/olap/block_reader.cpp | 43 +--
be/src/vec/olap/block_reader.h | 3 +-
be/src/vec/olap/vcollect_iterator.cpp | 1 +
be/src/vec/runtime/vparquet_transformer.cpp | 3 +-
be/src/vec/sink/vmemory_scratch_sink.cpp | 2 +-
be/src/vec/sink/vresult_sink.cpp | 4 +-
be/test/olap/rowid_conversion_test.cpp | 7 +-
be/test/testutil/run_all_tests.cpp | 4 +
be/test/util/timezone_utils_test.cpp | 144 +++++++++
.../serde/data_type_serde_arrow_test.cpp | 4 +-
conf/ldap.conf | 1 +
docker/runtime/doris-compose/Dockerfile | 23 +-
docker/runtime/doris-compose/Readme.md | 58 +++-
docker/runtime/doris-compose/cluster.py | 225 ++++++++++---
docker/runtime/doris-compose/command.py | 349 +++++++++++++++++----
docker/runtime/doris-compose/database.py | 171 ++++++----
docker/runtime/doris-compose/doris-compose.py | 9 +-
.../{requirements.txt => format-code.sh} | 9 +-
docker/runtime/doris-compose/requirements.txt | 2 +
docker/runtime/doris-compose/resource/common.sh | 13 +-
.../runtime/doris-compose/resource/entrypoint.sh | 68 ++++
docker/runtime/doris-compose/resource/init_be.sh | 8 +-
.../runtime/doris-compose/resource/init_cloud.sh | 12 +-
docker/runtime/doris-compose/resource/init_fe.sh | 43 ++-
docker/runtime/doris-compose/utils.py | 23 +-
.../main/java/org/apache/doris/common/Config.java | 34 +-
.../java/org/apache/doris/common/LdapConfig.java | 6 +
.../java/org/apache/doris/alter/AlterJobV2.java | 2 +-
.../apache/doris/alter/SchemaChangeHandler.java | 4 +
.../org/apache/doris/alter/SchemaChangeJobV2.java | 2 +-
.../apache/doris/analysis/BuildIndexClause.java | 2 +-
.../apache/doris/analysis/CreateIndexClause.java | 2 +-
.../org/apache/doris/analysis/CreateTableStmt.java | 3 +-
.../java/org/apache/doris/analysis/IndexDef.java | 5 +
.../org/apache/doris/analysis/NullLiteral.java | 1 +
.../org/apache/doris/analysis/StringLiteral.java | 2 +-
.../java/org/apache/doris/backup/AbstractJob.java | 12 +-
.../org/apache/doris/backup/BackupHandler.java | 50 ++-
.../java/org/apache/doris/backup/BackupJob.java | 117 +++++--
.../java/org/apache/doris/backup/RestoreJob.java | 286 ++++++++++-------
.../org/apache/doris/binlog/BinlogManager.java | 20 ++
.../java/org/apache/doris/catalog/EsTable.java | 5 +-
.../main/java/org/apache/doris/catalog/Index.java | 20 +-
.../doris/catalog/MaterializedIndexMeta.java | 7 +
.../java/org/apache/doris/catalog/OlapTable.java | 5 -
.../apache/doris/common/MarkedCountDownLatch.java | 14 +
.../doris/datasource/es/EsExternalTable.java | 16 +-
.../doris/datasource/es/EsSchemaCacheValue.java | 37 +++
.../org/apache/doris/datasource/es/EsUtil.java | 19 +-
.../apache/doris/datasource/es/QueryBuilders.java | 102 +++---
.../doris/datasource/es/source/EsScanNode.java | 6 +-
.../doris/datasource/hive/HMSExternalTable.java | 22 +-
.../maxcompute/source/MaxComputeScanNode.java | 8 +-
.../property/constants/S3Properties.java | 4 +-
.../apache/doris/job/extensions/mtmv/MTMVTask.java | 18 +-
.../org/apache/doris/master/ReportHandler.java | 2 +-
.../org/apache/doris/mtmv/MTMVBaseTableIf.java | 36 +++
.../java/org/apache/doris/mtmv/MTMVJobManager.java | 2 +-
.../org/apache/doris/mtmv/MTMVRelatedTableIf.java | 16 +-
.../doris/mysql/authenticate/ldap/LdapClient.java | 18 +-
.../apache/doris/mysql/privilege/RoleManager.java | 5 +-
.../glue/translator/ExpressionTranslator.java | 3 +-
.../expression/rules/FoldConstantRuleOnFE.java | 4 +-
.../doris/nereids/trees/expressions/Divide.java | 3 +-
.../trees/expressions/ExpressionEvaluator.java | 13 -
.../nereids/trees/expressions/IntegralDivide.java | 3 +-
.../doris/nereids/trees/expressions/Mod.java | 3 +-
.../functions/PropagateNullLiteral.java | 26 ++
.../trees/expressions/functions/scalar/Acos.java | 3 +-
.../scalar/AppendTrailingCharIfAbsent.java | 3 +-
.../trees/expressions/functions/scalar/Asin.java | 3 +-
.../functions/scalar/BitmapFromArray.java | 3 +-
.../functions/scalar/BitmapFromBase64.java | 3 +-
.../functions/scalar/BitmapFromString.java | 3 +-
.../expressions/functions/scalar/BitmapMax.java | 3 +-
.../expressions/functions/scalar/BitmapMin.java | 3 +-
.../functions/scalar/BitmapSubsetInRange.java | 3 +-
.../functions/scalar/BitmapSubsetLimit.java | 3 +-
.../expressions/functions/scalar/ConvertTz.java | 3 +-
.../functions/scalar/CryptoFunction.java | 3 +-
.../trees/expressions/functions/scalar/Date.java | 3 +-
.../expressions/functions/scalar/DateFormat.java | 3 +-
.../expressions/functions/scalar/DayCeil.java | 3 +-
.../expressions/functions/scalar/DayFloor.java | 3 +-
.../functions/scalar/DigitalMasking.java | 3 +-
.../trees/expressions/functions/scalar/Dlog10.java | 3 +-
.../trees/expressions/functions/scalar/Dsqrt.java | 3 +-
.../trees/expressions/functions/scalar/Fmod.java | 3 +-
.../expressions/functions/scalar/FromBase64.java | 3 +-
.../expressions/functions/scalar/FromDays.java | 3 +-
.../expressions/functions/scalar/FromUnixtime.java | 3 +-
.../functions/scalar/GetJsonDouble.java | 3 +-
.../functions/scalar/GetJsonString.java | 3 +-
.../expressions/functions/scalar/HourCeil.java | 3 +-
.../expressions/functions/scalar/HourFloor.java | 3 +-
.../trees/expressions/functions/scalar/Ln.java | 3 +-
.../trees/expressions/functions/scalar/Log10.java | 3 +-
.../trees/expressions/functions/scalar/Log2.java | 3 +-
.../trees/expressions/functions/scalar/Lpad.java | 3 +-
.../expressions/functions/scalar/MonthCeil.java | 3 +-
.../expressions/functions/scalar/MonthFloor.java | 3 +-
.../expressions/functions/scalar/ParseUrl.java | 3 +-
.../trees/expressions/functions/scalar/Pmod.java | 3 +-
.../functions/scalar/RegexpExtract.java | 3 +-
.../functions/scalar/RegexpExtractAll.java | 3 +-
.../functions/scalar/RegexpReplace.java | 3 +-
.../functions/scalar/RegexpReplaceOne.java | 3 +-
.../trees/expressions/functions/scalar/Repeat.java | 3 +-
.../trees/expressions/functions/scalar/Rpad.java | 3 +-
.../expressions/functions/scalar/SecondCeil.java | 3 +-
.../expressions/functions/scalar/SecondFloor.java | 3 +-
.../expressions/functions/scalar/SplitPart.java | 3 +-
.../trees/expressions/functions/scalar/Sqrt.java | 3 +-
.../expressions/functions/scalar/StAngle.java | 3 +-
.../functions/scalar/StAngleSphere.java | 3 +-
.../functions/scalar/StAreaSquareKm.java | 3 +-
.../functions/scalar/StAreaSquareMeters.java | 3 +-
.../expressions/functions/scalar/StAstext.java | 3 +-
.../expressions/functions/scalar/StContains.java | 3 +-
.../functions/scalar/StDistanceSphere.java | 3 +-
.../functions/scalar/StGeometryFromWKB.java | 3 +-
.../functions/scalar/StGeometryfromtext.java | 3 +-
.../functions/scalar/StGeomfromtext.java | 3 +-
.../functions/scalar/StLinefromtext.java | 3 +-
.../expressions/functions/scalar/StPoint.java | 3 +-
.../functions/scalar/StPolyfromtext.java | 3 +-
.../expressions/functions/scalar/StPolygon.java | 3 +-
.../trees/expressions/functions/scalar/StX.java | 3 +-
.../trees/expressions/functions/scalar/StY.java | 3 +-
.../expressions/functions/scalar/StrToDate.java | 3 +-
.../expressions/functions/scalar/SubReplace.java | 3 +-
.../trees/expressions/functions/scalar/ToDate.java | 3 +-
.../expressions/functions/scalar/ToDateV2.java | 3 +-
.../trees/plans/commands/info/IndexDefinition.java | 2 +-
.../java/org/apache/doris/persist/BarrierLog.java | 28 ++
.../java/org/apache/doris/persist/EditLog.java | 10 +-
.../java/org/apache/doris/persist/TableInfo.java | 18 ++
.../doris/persist/TableRenameColumnInfo.java | 4 +
.../org/apache/doris/planner/OlapScanNode.java | 10 +-
.../org/apache/doris/planner/OriginalPlanner.java | 15 +-
.../java/org/apache/doris/qe/SessionVariable.java | 9 +
.../java/org/apache/doris/qe/StmtExecutor.java | 2 +
.../apache/doris/service/FrontendServiceImpl.java | 17 +-
.../java/org/apache/doris/task/AgentBatchTask.java | 48 ++-
.../main/java/org/apache/doris/task/AgentTask.java | 4 +
.../org/apache/doris/task/CreateReplicaTask.java | 17 +
.../org/apache/doris/catalog/OlapTableTest.java | 2 +-
.../doris/common/proc/IndexesProcNodeTest.java | 8 +-
.../doris/external/elasticsearch/EsUtilTest.java | 7 +-
.../external/elasticsearch/QueryBuildersTest.java | 124 ++++++--
.../persist/TableAddOrDropColumnsInfoTest.java | 2 +-
gensrc/thrift/Descriptors.thrift | 1 +
gensrc/thrift/FrontendService.thrift | 2 +
.../data/external_table_p0/es/test_es_query.out | 96 ++++++
.../test_insert_nan.out} | 7 +-
.../test_index_change_on_new_column.out | 4 +
...out => test_index_change_on_renamed_column.out} | 8 +-
...st_index_change_with_cumulative_compaction.out} | 0
.../test_index_change_with_full_compaction.out} | 0
.../test_array_with_inverted_index_all_type.out | 36 ++-
.../org/apache/doris/regression/Config.groovy | 22 +-
.../org/apache/doris/regression/suite/Suite.groovy | 4 +-
.../doris/regression/suite/SuiteCluster.groovy | 232 +++++++++++---
.../test_backup_restore_atomic_with_alter.groovy | 2 +-
.../suites/demo_p0/docker_action.groovy | 2 -
.../external_table_p0/es/test_es_query.groovy | 10 +-
...d_index_with_direct_schema_change_fault.groovy} | 45 ++-
...ld_index_with_light_schema_change_fault.groovy} | 40 +--
...est_match_without_index_fault_injection.groovy} | 4 +-
.../test_writer_v2_fault_injection.groovy | 4 +-
.../suites/insert_p0/test_insert_nan.groovy | 34 ++
.../{ => index_change}/test_add_drop_index.groovy | 0
.../test_add_drop_index_ignore_case_column.groovy | 0
.../test_add_drop_index_repeatly.groovy} | 63 ++--
.../test_add_drop_index_with_data.groovy | 0
.../test_add_drop_index_with_delete_data.groovy | 0
.../{ => index_change}/test_build_index.groovy | 0
.../test_build_index_with_clone_by_docker.groovy | 0
.../test_index_change_on_new_column.groovy | 14 +-
... => test_index_change_on_renamed_column.groovy} | 56 +++-
...index_change_with_cumulative_compaction.groovy} | 6 +-
... test_index_change_with_full_compaction.groovy} | 16 +-
.../test_array_with_inverted_index_all_type.groovy | 4 +
.../test_json_reader_without_object.groovy | 57 ++++
.../fold_constant/fold_constant_nullable.groovy | 178 +++++++++++
.../suites/show_p0/test_show_variables.groovy | 38 +++
228 files changed, 3414 insertions(+), 1109 deletions(-)
copy be/src/olap/{tablet_schema_cache.cpp => tablet_column_object_pool.cpp}
(50%)
create mode 100644 be/src/olap/tablet_column_object_pool.h
create mode 100644 be/test/util/timezone_utils_test.cpp
copy docker/runtime/doris-compose/{requirements.txt => format-code.sh} (90%)
create mode 100644 docker/runtime/doris-compose/resource/entrypoint.sh
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/es/EsSchemaCacheValue.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/mtmv/MTMVBaseTableIf.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/PropagateNullLiteral.java
copy
regression-test/data/{inverted_index_p0/index_change/test_index_change_on_new_column.out
=> insert_p0/test_insert_nan.out} (59%)
copy
regression-test/data/inverted_index_p0/index_change/{test_index_change_on_new_column.out
=> test_index_change_on_renamed_column.out} (53%)
rename
regression-test/data/inverted_index_p0/index_change/{test_index_change_with_compaction.out
=> test_index_change_with_cumulative_compaction.out} (100%)
copy regression-test/data/{compaction/test_compaction_dup_keys.out =>
inverted_index_p0/index_change/test_index_change_with_full_compaction.out}
(100%)
copy
regression-test/suites/{inverted_index_p0/test_build_index_with_clone_by_docker.groovy
=> fault_injection_p0/test_build_index_with_direct_schema_change_fault.groovy}
(66%)
copy
regression-test/suites/{inverted_index_p0/test_build_index_with_clone_by_docker.groovy
=> fault_injection_p0/test_build_index_with_light_schema_change_fault.groovy}
(69%)
rename
regression-test/suites/{inverted_index_p0/test_match_without_index.groovy =>
fault_injection_p0/test_match_without_index_fault_injection.groovy} (96%)
create mode 100644 regression-test/suites/insert_p0/test_insert_nan.groovy
rename regression-test/suites/inverted_index_p0/{ =>
index_change}/test_add_drop_index.groovy (100%)
rename regression-test/suites/inverted_index_p0/{ =>
index_change}/test_add_drop_index_ignore_case_column.groovy (100%)
copy
regression-test/suites/inverted_index_p0/{test_build_index_with_clone_by_docker.groovy
=> index_change/test_add_drop_index_repeatly.groovy} (58%)
rename regression-test/suites/inverted_index_p0/{ =>
index_change}/test_add_drop_index_with_data.groovy (100%)
rename regression-test/suites/inverted_index_p0/{ =>
index_change}/test_add_drop_index_with_delete_data.groovy (100%)
rename regression-test/suites/inverted_index_p0/{ =>
index_change}/test_build_index.groovy (100%)
rename regression-test/suites/inverted_index_p0/{ =>
index_change}/test_build_index_with_clone_by_docker.groovy (100%)
copy
regression-test/suites/inverted_index_p0/index_change/{test_index_change_on_new_column.groovy
=> test_index_change_on_renamed_column.groovy} (62%)
copy
regression-test/suites/inverted_index_p0/index_change/{test_index_change_with_compaction.groovy
=> test_index_change_with_cumulative_compaction.groovy} (98%)
rename
regression-test/suites/inverted_index_p0/index_change/{test_index_change_with_compaction.groovy
=> test_index_change_with_full_compaction.groovy} (96%)
create mode 100644
regression-test/suites/jsonb_p0/test_json_reader_without_object.groovy
create mode 100644
regression-test/suites/nereids_p0/expression/fold_constant/fold_constant_nullable.groovy
create mode 100644 regression-test/suites/show_p0/test_show_variables.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
