This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
from b727fd65940 (kerberos)fix hive keberos principal usage
new fd62af82d2e [enhancement](mow) Add bvar for bloom filter and segment
(#32355)
new 0537952573a [Fix](auto-inc) Fix auto inc unique table case (#32393)
new 844dd8b2cec [fix](spill) should wait for merging done before read agg
result (#32537)
new 886aabda31d [Fix](executor) Fix insert select not close coordinator
#32571
new 6888e52365e [pipelineX](fix) Fix illegal memory access (#32602)
new fd0bc720e9a [opt](information_schema) Add DEFAULT_ENCRYPTION column to
schemata table (#32501)
new fe1b7a7b0af Improve analyze stats case, avoid cluster delay caused
failure. (#32507)
new c1d42eaa862 [fix](mtmv)resolve the issue of table version updates in
concurrent situations (#32487)
new ca05129fa1b [fix](auth)node priv can login web ui (#32521)
new d7a3ff1ddf3 [Fix](Outfile) Fix the column type mapping in the
orc/parquet file format (#32281)
new 2cb652a7fa7 [FIX](compile)fix for gcc compile (#32508)
new e7919ab1b6d Add
DISABLE_BUILD_UI/DISABLE_BUILD_SPARK_DPP/DISABLE_BUILD_HIVE_UDF in build.sh
(#32595)
new 60eeff8e187 [enhance](mtmv)refresh mtmv must add auto (#32522)
new 8d6561b32d8 [opt](jdbc catalog) set jdbc test_connection default true
(#32546)
new 06026b2f46c [opt](paimon) add split num and partition num (#32597)
new 26efde29252 [test](Nereids) refine group by eliminate regression test
(#32543)
new 55b7f7f0199 [fix](inverted index) skip read index column data only for
DUP and MOW table (#32594)
new d3bdda6071d [fix](partial update) fix data correctness risk when load
delete sign data into a table with sequence col (#32574)
new 6462d913ca1 [Improvement](brpc) log error message when
AutoReleaseClosure meet brpc error or response… (#32628)
new 6b54171778a [bugfix](deadlock) pipelinex map lock should only scope in
map not about pipelinectx's cancel method (#32622)
new e5d7ff64aa1 [fix](backup) clear snapshot info for cancelled backup job
to reduce log size (#32604)
new 921fab21966 [fix](memory) Fix thread context not initialized in MacOS
(#32570)
new 23c12fd68f8 [fix](join) core caused by null-safe-equal join (#32623)
new 711a4d14e8b [fix](merge-cloud) fix full_compaction case adapts to
cloud mode (#32298)
The 24 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../schema_scanner/schema_schemata_scanner.cpp | 11 +
be/src/olap/iterators.h | 1 +
be/src/olap/primary_key_index.cpp | 7 +
be/src/olap/primary_key_index.h | 10 +
be/src/olap/rowset/beta_rowset_reader.cpp | 2 +
be/src/olap/rowset/segment_v2/bloom_filter.h | 39 ++-
.../segment_v2/bloom_filter_index_writer.cpp | 5 +
.../rowset/segment_v2/bloom_filter_index_writer.h | 9 +-
be/src/olap/rowset/segment_v2/page_io.cpp | 6 +-
be/src/olap/rowset/segment_v2/segment.cpp | 7 +-
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 6 +
be/src/olap/rowset/segment_v2/segment_writer.cpp | 12 +-
.../rowset/segment_v2/vertical_segment_writer.cpp | 12 +-
be/src/pipeline/exec/hashjoin_build_sink.cpp | 16 +-
.../partitioned_aggregation_source_operator.cpp | 6 +
be/src/pipeline/pipeline_fragment_context.cpp | 1 +
be/src/pipeline/pipeline_fragment_context.h | 1 +
be/src/pipeline/pipeline_x/operator.cpp | 9 -
be/src/pipeline/pipeline_x/operator.h | 2 -
.../pipeline_x/pipeline_x_fragment_context.cpp | 1 +
be/src/runtime/fragment_mgr.cpp | 106 ++++---
be/src/runtime/fragment_mgr.h | 7 -
be/src/runtime/query_context.cpp | 32 +-
be/src/util/arrow/block_convertor.cpp | 27 +-
be/src/util/arrow/block_convertor.h | 5 +-
be/src/util/arrow/row_batch.cpp | 14 +-
be/src/util/ref_count_closure.h | 18 ++
.../aggregate_function_collect.h | 2 +-
be/src/vec/common/allocator.cpp | 9 +-
.../common/hash_table/hash_map_context_creator.h | 15 +-
.../vec/data_types/serde/data_type_array_serde.cpp | 4 +-
.../vec/data_types/serde/data_type_array_serde.h | 4 +-
.../vec/data_types/serde/data_type_bitmap_serde.h | 4 +-
.../data_types/serde/data_type_date64_serde.cpp | 2 +-
.../vec/data_types/serde/data_type_date64_serde.h | 4 +-
.../serde/data_type_datetimev2_serde.cpp | 26 +-
.../data_types/serde/data_type_datetimev2_serde.h | 4 +-
.../data_types/serde/data_type_datev2_serde.cpp | 56 +---
.../vec/data_types/serde/data_type_datev2_serde.h | 4 +-
.../data_types/serde/data_type_decimal_serde.cpp | 2 +-
.../vec/data_types/serde/data_type_decimal_serde.h | 4 +-
.../vec/data_types/serde/data_type_hll_serde.cpp | 4 +-
be/src/vec/data_types/serde/data_type_hll_serde.h | 4 +-
.../vec/data_types/serde/data_type_jsonb_serde.cpp | 2 +-
.../vec/data_types/serde/data_type_jsonb_serde.h | 4 +-
.../vec/data_types/serde/data_type_map_serde.cpp | 12 +-
be/src/vec/data_types/serde/data_type_map_serde.h | 4 +-
.../data_types/serde/data_type_nullable_serde.cpp | 4 +-
.../data_types/serde/data_type_nullable_serde.h | 4 +-
.../data_types/serde/data_type_number_serde.cpp | 2 +-
.../vec/data_types/serde/data_type_number_serde.h | 4 +-
.../vec/data_types/serde/data_type_object_serde.h | 4 +-
.../serde/data_type_quantilestate_serde.h | 4 +-
be/src/vec/data_types/serde/data_type_serde.h | 4 +-
.../vec/data_types/serde/data_type_string_serde.h | 4 +-
.../data_types/serde/data_type_struct_serde.cpp | 4 +-
.../vec/data_types/serde/data_type_struct_serde.h | 4 +-
be/src/vec/exec/join/vhash_join_node.cpp | 12 +-
be/src/vec/runtime/vparquet_transformer.cpp | 10 +-
be/src/vec/sink/varrow_flight_result_writer.cpp | 3 +-
be/src/vec/sink/varrow_flight_result_writer.h | 3 +
be/src/vec/sink/vmemory_scratch_sink.cpp | 3 +-
be/src/vec/sink/vmemory_scratch_sink.h | 4 +-
be/src/vec/sink/writer/async_result_writer.h | 8 -
.../serde/data_type_serde_arrow_test.cpp | 12 +-
build.sh | 23 +-
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 2 +-
.../org/apache/doris/analysis/OutFileClause.java | 88 +++---
.../java/org/apache/doris/backup/BackupJob.java | 1 +
.../java/org/apache/doris/catalog/SchemaTable.java | 3 +-
.../doris/datasource/jdbc/JdbcExternalCatalog.java | 8 +-
.../datasource/paimon/source/PaimonScanNode.java | 26 +-
.../doris/httpv2/controller/BaseController.java | 4 +-
.../doris/mysql/privilege/PrivPredicate.java | 4 +
.../functions/table/TableValuedFunction.java | 4 +-
.../commands/insert/AbstractInsertExecutor.java | 1 +
.../main/java/org/apache/doris/qe/Coordinator.java | 10 +-
.../doris/transaction/DatabaseTransactionMgr.java | 21 +-
.../apache/doris/transaction/TableCommitInfo.java | 4 +-
.../unique/test_unique_table_auto_inc.out | 54 ++--
.../data/export_p0/export/test_show_export.out | 300 +++++++++---------
.../test_outfile_expr_generate_col_name.out | 4 +-
.../parquet/test_outfile_parquet_array_type.out | 8 +-
.../parquet/test_outfile_parquet_complex_type.out | 20 +-
.../parquet/test_outfile_parquet_map_type.out | 28 +-
.../data/export_p0/test_export_data_types.out | 24 +-
regression-test/data/export_p0/test_export_orc.out | 200 ++++++------
.../data/export_p0/test_export_parquet.out | 200 ++++++------
.../export/hive_read/orc/test_hive_read_orc.out | 2 +-
.../hive_read/parquet/test_hive_read_parquet.out | 16 +-
.../parquet/test_hive_read_parquet_comlex_type.out | 40 +--
.../test_index_skip_read_data.out | 83 +++++
.../eliminate_gby_key/eliminate_gby_key.out | 164 ----------
.../join/test_half_join_nullable_build_side.out | 8 +
.../test_partial_update_seq_col_delete.out | Bin 1064 -> 1526 bytes
.../test_partial_update_seq_type_delete.out | Bin 3017 -> 2967 bytes
.../test_full_compaction_by_table_id.groovy | 6 +-
.../unique/test_unique_table_auto_inc.groovy | 6 +-
.../parquet/test_outfile_parquet_map_type.groovy | 55 +---
.../suites/export_p0/test_export_data_types.groovy | 348 ++++++---------------
.../suites/export_p0/test_export_orc.groovy | 149 ++-------
.../export/hive_read/orc/test_hive_read_orc.groovy | 12 +-
.../parquet/test_hive_read_parquet.groovy | 12 +-
.../test_hive_read_parquet_comlex_type.groovy | 2 +-
.../test_index_skip_read_data.groovy | 131 ++++++++
.../suites/mtmv_p0/test_agg_table_mtmv.groovy | 2 +-
.../suites/mtmv_p0/test_base_mtmv.groovy | 6 +-
.../suites/mtmv_p0/test_build_mtmv.groovy | 2 +-
.../suites/mtmv_p0/test_hive_mtmv.groovy | 2 +-
.../suites/mtmv_p0/test_hive_olap_mtmv.groovy | 2 +-
.../mtmv_p0/test_limit_partition_mtmv.groovy | 10 +-
.../suites/mtmv_p0/test_mor_table_mtmv.groovy | 2 +-
.../suites/mtmv_p0/test_mow_table_mtmv.groovy | 2 +-
.../mtmv_p0/test_partition_refresh_mtmv.groovy | 18 +-
.../suites/mtmv_p0/test_task_mtmv.groovy | 2 +-
.../suites/mtmv_p0/test_workload_group_mtmv.groovy | 2 +-
.../eliminate_gby_key/eliminate_gby_key.groovy | 108 ++++---
.../cross_join_list_str_increment_create.groovy | 2 +-
.../cross_join_range_date_increment_create.groovy | 2 +-
...cross_join_range_number_increment_create.groovy | 2 +-
.../full_join_list_str_increment_create.groovy | 2 +-
.../full_join_range_date_increment_create.groovy | 2 +-
.../full_join_range_number_increment_create.groovy | 2 +-
.../inner_join_list_str_increment_create.groovy | 2 +-
.../inner_join_range_date_increment_create.groovy | 2 +-
...inner_join_range_number_increment_create.groovy | 2 +-
...left_anti_join_list_str_increment_create.groovy | 2 +-
...ft_anti_join_range_date_increment_create.groovy | 2 +-
..._anti_join_range_number_increment_create.groovy | 2 +-
.../left_join_list_str_increment_create.groovy | 2 +-
.../left_join_range_date_increment_create.groovy | 2 +-
.../left_join_range_number_increment_create.groovy | 2 +-
...left_semi_join_list_str_increment_create.groovy | 2 +-
...ft_semi_join_range_date_increment_create.groovy | 2 +-
..._semi_join_range_number_increment_create.groovy | 2 +-
...ight_anti_join_list_str_increment_create.groovy | 2 +-
...ht_anti_join_range_date_increment_create.groovy | 2 +-
..._anti_join_range_number_increment_create.groovy | 2 +-
.../right_join_list_str_increment_create.groovy | 2 +-
.../right_join_range_date_increment_create.groovy | 2 +-
...right_join_range_number_increment_create.groovy | 2 +-
...ight_semi_join_list_str_increment_create.groovy | 2 +-
...ht_semi_join_range_date_increment_create.groovy | 2 +-
..._semi_join_range_number_increment_create.groovy | 2 +-
.../self_conn_list_str_increment_create.groovy | 2 +-
.../self_conn_range_date_increment_create.groovy | 2 +-
.../self_conn_range_number_increment_create.groovy | 2 +-
.../join/test_half_join_nullable_build_side.groovy | 9 +
.../suites/statistics/analyze_stats.groovy | 55 ++--
.../suites/statistics/test_analyze_mtmv.groovy | 2 +-
.../test_partial_update_seq_col_delete.groovy | 8 +
151 files changed, 1533 insertions(+), 1465 deletions(-)
create mode 100644
regression-test/data/inverted_index_p0/test_index_skip_read_data.out
delete mode 100644
regression-test/data/nereids_rules_p0/eliminate_gby_key/eliminate_gby_key.out
create mode 100644
regression-test/suites/inverted_index_p0/test_index_skip_read_data.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
