This is an automated email from the ASF dual-hosted git repository.
panxiaolei pushed a change to branch refactor_rf
in repository https://gitbox.apache.org/repos/asf/doris.git
discard 119abb6e6cd resolve conflict
discard 1d62fffd50f [test](bloom_filter_func) add case about algorithm
discard 9db6ffffad7 [test](ut) add ut for bloom filter and hybridset (#48698)
discard e1c632b7070 add rpc fail test and eof test
discard a6ed1801105 test RuntimeFilterMergeControllerEntity (#48678)
discard 42f6014e39a test RuntimeFilterMgr (#48672)
discard dd3e10e4eb3 format (#48658)
discard 40a0d634866 test (#48630)
discard 5135dd56f95 test rf utils (#48615)
discard 46f86c77a4a add more ut of roles
discard 81efa99b189 test in or bloom (#48596)
discard d9fb68c61f8 fix UT (#48591)
discard 9a7b38ad4b5 fix compile fail and format
discard f932ac7084b [rf](ut) test minmax/bitmap filter (#48579)
discard f6376bd05a8 fix coredump
discard 74344929d3b [runtime filter](UT) test bloom filter (#48575)
discard 65e855e6ae9 add more test and some fix
discard 8965de9568a [runtime filter](UT) test in filter (#48562)
discard 494b6566cc9 [refactor](runtime filter) Refine null property in runtime
filter (#48534)
discard 47ee4228419 some fix and add ut
discard 7a73c489f82 refactor of RuntimeFilterSlots
add 0078e1f02cb [fix](func) Fix be core dump caused by mem out of bound
(#48693)
add 22cfc09ed9e [opt](vault) Check hdfs connectivity when creating hdfs
storage vault (#48369)
add 5ec7d348bf9 [opt](nereids) speedup huge InPredicate for partition
pruning (#47608)
add 2c18cf2d2d4 [test](cold hot separation) add a cold hot separation
regression test for hdfs (#48452)
add 5e64736aa96 [fix](Nereids) string constant folding process regex delim
by mistake (#48783)
add 6521cb6e182 [bugfix](hive) fix_hive_metastore_client_socket_timeout
(#47378)
add d1ad3e6b673 [Fix](merge-on-write) should re-calculate delete bitmaps
between segments if BE restart before publish (#48775)
add 4d9faeddeac [chore](TableName)remove useless method (#48790)
add 63a601fea42 [refactor](minor) Rename scanners (#48810)
add 00ec5875d21 [fix](load) add lock for
runtime_state->tablet_commit_infos (#48709)
add 2988dc3c274 [enhancement](maxcompute)support maxcompute timestamp
column type. (#48768)
add a9fb3d21695 [Chore](check) modify sanity_check's rows type from int32
to int64 (#48821)
add 58fe4cb29df [refactor](pipeline) Refine pipeline logics (#48795)
add 752fc5e7e06 [Feat](Nereids) refactor show table command (#48833)
add 865b45c35be [improvement](statistics)Support convert ip type to double
for column stats. (#48823)
add 5a15b5dc5fe [Enhancement] (nereids) support show table status command
(#48715)
add 315e6a95942 [Fix](cloud) Should calculate delete bitmaps between
segments when re-calculate for all historical data if cache missed in publish
phase (#48748)
add 2000a5c4762 [fix](binlog) Replaced partition should be record to
Dropped Resources (#48686)
add 3e19f581b32 refactor of RuntimeFilterSlots
add d5817710883 some fix and add ut
add d9a559dc2f1 [refactor](runtime filter) Refine null property in runtime
filter (#48534)
add 9db838121b6 [runtime filter](UT) test in filter (#48562)
add dbc4eacaa20 add more test and some fix
add 5640bdcf6d2 [runtime filter](UT) test bloom filter (#48575)
add 874718c29da fix coredump
add b804ee00000 [rf](ut) test minmax/bitmap filter (#48579)
add 5eb01aa8779 fix compile fail and format
add a1be0a66487 fix UT (#48591)
add aacd25e62dd test in or bloom (#48596)
add 930566af3e0 add more ut of roles
add 74bcdbc464c test rf utils (#48615)
add 6e4173933d9 test (#48630)
add db3ebf6a587 format (#48658)
add 5ee537f3007 test RuntimeFilterMgr (#48672)
add 5e5a483be0f test RuntimeFilterMergeControllerEntity (#48678)
add c51219ca78c add rpc fail test and eof test
add 9d710a686f7 [test](ut) add ut for bloom filter and hybridset (#48698)
add 4b6720a4033 [test](bloom_filter_func) add case about algorithm
add d1953871c2e resolve conflict
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (119abb6e6cd)
\
N -- N -- N refs/heads/refactor_rf (d1953871c2e)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../cloud/cloud_engine_calc_delete_bitmap_task.cpp | 10 +
be/src/io/fs/multi_table_pipe.cpp | 4 +-
be/src/olap/base_tablet.cpp | 3 +
be/src/olap/parallel_scanner_builder.cpp | 14 +-
be/src/olap/parallel_scanner_builder.h | 12 +-
be/src/olap/tablet_meta.cpp | 4 +
be/src/olap/tablet_meta.h | 2 +
be/src/olap/txn_manager.cpp | 11 ++
be/src/pipeline/exec/es_scan_operator.cpp | 6 +-
be/src/pipeline/exec/es_scan_operator.h | 6 +-
be/src/pipeline/exec/file_scan_operator.cpp | 6 +-
be/src/pipeline/exec/file_scan_operator.h | 4 +-
be/src/pipeline/exec/jdbc_scan_operator.cpp | 6 +-
be/src/pipeline/exec/jdbc_scan_operator.h | 6 +-
be/src/pipeline/exec/meta_scan_operator.cpp | 6 +-
be/src/pipeline/exec/meta_scan_operator.h | 6 +-
be/src/pipeline/exec/olap_scan_operator.cpp | 10 +-
be/src/pipeline/exec/olap_scan_operator.h | 6 +-
be/src/pipeline/exec/operator.h | 2 +-
be/src/pipeline/exec/scan_operator.cpp | 4 +-
be/src/pipeline/exec/scan_operator.h | 8 +-
be/src/pipeline/pipeline_fragment_context.cpp | 3 +-
be/src/pipeline/pipeline_fragment_context.h | 17 --
be/src/pipeline/task_scheduler.cpp | 3 -
be/src/runtime/fragment_mgr.cpp | 33 ++--
be/src/runtime/fragment_mgr.h | 3 +-
be/src/runtime/runtime_state.h | 27 ++-
.../runtime/stream_load/stream_load_executor.cpp | 2 +-
be/src/vec/columns/column_string.cpp | 16 +-
be/src/vec/exec/format/csv/csv_reader.cpp | 2 +-
be/src/vec/exec/format/json/new_json_reader.cpp | 2 +-
.../scan/{new_es_scanner.cpp => es_scanner.cpp} | 33 ++--
.../exec/scan/{new_es_scanner.h => es_scanner.h} | 14 +-
.../scan/{vfile_scanner.cpp => file_scanner.cpp} | 76 ++++----
.../exec/scan/{vfile_scanner.h => file_scanner.h} | 20 +-
.../{new_jdbc_scanner.cpp => jdbc_scanner.cpp} | 35 ++--
.../scan/{new_jdbc_scanner.h => jdbc_scanner.h} | 12 +-
.../scan/{vmeta_scanner.cpp => meta_scanner.cpp} | 106 +++++-----
.../exec/scan/{vmeta_scanner.h => meta_scanner.h} | 12 +-
.../{new_olap_scanner.cpp => olap_scanner.cpp} | 37 ++--
.../scan/{new_olap_scanner.h => olap_scanner.h} | 8 +-
be/src/vec/exec/scan/{vscan_node.h => scan_node.h} | 8 +-
be/src/vec/exec/scan/{vscanner.cpp => scanner.cpp} | 27 ++-
be/src/vec/exec/scan/{vscanner.h => scanner.h} | 10 +-
be/src/vec/exec/scan/scanner_context.cpp | 2 +-
be/src/vec/exec/scan/scanner_context.h | 4 +-
be/src/vec/exec/scan/scanner_scheduler.cpp | 14 +-
be/src/vec/exec/scan/scanner_scheduler.h | 2 +-
be/src/vec/functions/function_string.cpp | 14 +-
be/src/vec/sink/writer/vtablet_writer.cpp | 21 +-
be/src/vec/sink/writer/vtablet_writer_v2.cpp | 5 +-
be/test/pipeline/local_exchanger_test.cpp | 2 +-
be/test/scan/scanner_context_test.cpp | 70 +++----
be/test/vec/exec/vfile_scanner_exception_test.cpp | 10 +-
be/test/vec/exec/vwal_scanner_test.cpp | 12 +-
.../doris/maxcompute/MaxComputeColumnValue.java | 12 +-
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 2 +-
.../org/apache/doris/analysis/LargeIntLiteral.java | 2 +-
.../java/org/apache/doris/analysis/TableName.java | 20 --
.../java/org/apache/doris/binlog/DBBinlog.java | 9 +
.../main/java/org/apache/doris/catalog/Env.java | 12 +-
.../org/apache/doris/catalog/HdfsStorageVault.java | 66 ++++++-
.../java/org/apache/doris/catalog/OlapTable.java | 5 +-
.../org/apache/doris/catalog/StorageVault.java | 1 -
.../cache/NereidsSortedPartitionsCacheManager.java | 6 +
.../doris/datasource/hive/HMSExternalCatalog.java | 2 +-
.../datasource/hive/ThriftHMSCachedClient.java | 2 +-
.../maxcompute/MaxComputeExternalCatalog.java | 10 +-
.../maxcompute/MaxComputeExternalTable.java | 1 +
.../maxcompute/source/MaxComputeScanNode.java | 43 +++-
.../property/constants/MCProperties.java | 4 +
.../apache/doris/fs/remote/dfs/DFSFileSystem.java | 2 +-
.../doris/nereids/parser/LogicalPlanBuilder.java | 29 +++
.../rules/exploration/mv/PredicatesSplitter.java | 2 +-
.../rules/expression/rules/ColumnRange.java | 24 ++-
.../rules/OneListPartitionEvaluator.java | 89 +++++++--
.../rules/OneRangePartitionEvaluator.java | 52 +++--
.../nereids/rules/expression/rules/OrToIn.java | 1 -
.../rules/PartitionPredicateToRange.java | 15 +-
.../nereids/trees/expressions/Expression.java | 26 +++
.../nereids/trees/expressions/InPredicate.java | 58 +++++-
.../functions/executable/StringArithmetic.java | 57 +++---
.../trees/expressions/literal/IPv4Literal.java | 5 +
.../trees/expressions/literal/IPv6Literal.java | 5 +
.../nereids/trees/expressions/literal/Literal.java | 98 +++++++---
.../visitor/ExpressionColumnFilterConverter.java | 5 +
.../apache/doris/nereids/trees/plans/PlanType.java | 1 +
.../trees/plans/commands/ShowTableCommand.java | 62 ++----
...bleCommand.java => ShowTableStatusCommand.java} | 184 +++++++++---------
.../trees/plans/commands/info/AliasInfo.java} | 41 ++--
.../trees/plans/commands/info/TableNameInfo.java | 15 ++
.../trees/plans/logical/LogicalOlapScan.java | 6 +-
.../trees/plans/visitor/CommandVisitor.java | 5 +
.../apache/doris/nereids/util/ExpressionUtils.java | 3 +-
.../java/org/apache/doris/nereids/util/Utils.java | 42 ++++
.../persist/ReplacePartitionOperationLog.java | 18 +-
.../java/org/apache/doris/qe/SessionVariable.java | 11 ++
.../doris/statistics/util/StatisticsUtil.java | 12 ++
.../doris/cloud/catalog/HdfsStorageVaultTest.java | 76 +++++++-
.../maxcompute/test_max_compute_timestamp.out | Bin 0 -> 3944 bytes
...st_cloud_multi_segments_re_calc_in_publish.out} | Bin 175 -> 202 bytes
...st_local_multi_segments_re_calc_in_publish.out} | Bin 175 -> 202 bytes
.../test_function_string.out} | Bin 109 -> 121 bytes
.../org/apache/doris/regression/suite/Suite.groovy | 12 ++
.../suites/auth_call/test_dml_analyze_auth.groovy | 9 +-
....groovy => cold_data_compaction_by_hdfs.groovy} | 75 ++++---
.../maxcompute/test_max_compute_timestamp.groovy | 216 +++++++++++++++++++++
...cloud_multi_segments_re_calc_in_publish.groovy} | 81 ++------
..._local_multi_segments_re_calc_in_publish.groovy | 174 +++++++++++++++++
.../test_function_string.groovy} | 34 ++--
.../fold_constant_string_arithmatic.groovy | 123 +++++++++++-
.../suites/statistics/test_analyze_ip_type.groovy | 97 +++++++++
.../vault_p0/create/test_create_vault.groovy | 4 +-
.../test_create_vault_with_case_sensitive.groovy | 7 +-
.../create/test_create_vault_with_kerberos.groovy | 18 +-
.../privilege/test_vault_privilege_restart.groovy | 3 +-
116 files changed, 1942 insertions(+), 850 deletions(-)
rename be/src/vec/exec/scan/{new_es_scanner.cpp => es_scanner.cpp} (83%)
rename be/src/vec/exec/scan/{new_es_scanner.h => es_scanner.h} (82%)
rename be/src/vec/exec/scan/{vfile_scanner.cpp => file_scanner.cpp} (96%)
rename be/src/vec/exec/scan/{vfile_scanner.h => file_scanner.h} (93%)
rename be/src/vec/exec/scan/{new_jdbc_scanner.cpp => jdbc_scanner.cpp} (86%)
rename be/src/vec/exec/scan/{new_jdbc_scanner.h => jdbc_scanner.h} (88%)
rename be/src/vec/exec/scan/{vmeta_scanner.cpp => meta_scanner.cpp} (84%)
rename be/src/vec/exec/scan/{vmeta_scanner.h => meta_scanner.h} (92%)
rename be/src/vec/exec/scan/{new_olap_scanner.cpp => olap_scanner.cpp} (97%)
rename be/src/vec/exec/scan/{new_olap_scanner.h => olap_scanner.h} (93%)
rename be/src/vec/exec/scan/{vscan_node.h => scan_node.h} (90%)
rename be/src/vec/exec/scan/{vscanner.cpp => scanner.cpp} (91%)
rename be/src/vec/exec/scan/{vscanner.h => scanner.h} (97%)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/{ShowTableCommand.java
=> ShowTableStatusCommand.java} (50%)
copy fe/fe-core/src/main/java/org/apache/doris/{planner/PlanNodeId.java =>
nereids/trees/plans/commands/info/AliasInfo.java} (57%)
create mode 100644
regression-test/data/external_table_p2/maxcompute/test_max_compute_timestamp.out
copy
regression-test/data/fault_injection_p0/{test_skip_calc_between_segments.out =>
cloud/test_cloud_multi_segments_re_calc_in_publish.out} (86%)
copy
regression-test/data/fault_injection_p0/{test_skip_calc_between_segments.out =>
test_local_multi_segments_re_calc_in_publish.out} (86%)
copy
regression-test/data/{compaction/test_single_compaction_with_variant_inverted_index.out
=> function_p0/test_function_string.out} (88%)
copy regression-test/suites/cold_heat_separation/{cold_data_compaction.groovy
=> cold_data_compaction_by_hdfs.groovy} (56%)
create mode 100644
regression-test/suites/external_table_p2/maxcompute/test_max_compute_timestamp.groovy
copy
regression-test/suites/fault_injection_p0/{test_skip_calc_between_segments.groovy
=> cloud/test_cloud_multi_segments_re_calc_in_publish.groovy} (59%)
create mode 100644
regression-test/suites/fault_injection_p0/test_local_multi_segments_re_calc_in_publish.groovy
copy regression-test/suites/{correctness/test_float_round_up.groovy =>
function_p0/test_function_string.groovy} (57%)
create mode 100644
regression-test/suites/statistics/test_analyze_ip_type.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
