This is an automated email from the ASF dual-hosted git repository.
hello-stephen pushed a change to branch agent/branch41-iceberg-system-projection
in repository https://gitbox.apache.org/repos/asf/doris.git
omit 836a849b318 [fix](iceberg) Project Iceberg system table scans (#65262)
add bfd67dd3c39 [branch-4.1](docker) pass env options through
doris-compose up (#64623)
add 4d0af109574 [branch-4.1][fix](case) Fix profile_size_limit docker
suite (#65872)
add 9872aa4675c branch-4.1: [fix](regression) Drop view before its base
tables in test_join5 #65455 (#65725)
add 18226137397 branch-4.1: [fix](streaming-job) Isolate schemas for CDC
snapshot splits #65645 (#65820)
add 39393c5253a branch-4.1: [fix](fe) Keep CDC end offset consistent with
current progress #65688 (#65816)
add 3d357e5bd98 branch-4.1: [fix](arrow-flight-sql) Close temporary
VectorSchemaRoot in createPreparedStatement to fix FE direct memory leak #65311
(#65751)
add efa971b09db branch-4.1: [fix](test) stabilize BDB unmatched
transaction test (#65757)
add 2f63ec48090 [fix](be) Backport BE fixes and refinements to branch-4.1
(#65754)
add 619ce848e45 [branch-4.1][fix](docker) initialize external MS argument
(#65926)
add 04df9cbca52 branch-4.1: [fix](regression) use JDK 17 for Java UDF
builds (#65887)
add 1286bb19770 branch-4.1: [fix](docker) Backport external Docker
improvements (#65913)
add dd73768c734 branch-4.1: [fix](be) Materialize const columns before
block merge #65770 (#65920)
add 3ad8169b87f branch-4.1:[bug](iceberg) use split file format for
iceberg scan (#65760) (#65807)
add 3c4f7a7984a branch-4.1: [fix](load) support compute_group in FE stream
load routing and planning #65571 (#65831)
add 0b4eff14371 branch-4.1: [fix](cloud) set recycler S3 client
requestTimeoutMs to avoid curl-28 on slow DeleteObjects (mirror #49315) #64758
(#65804)
add 8a8d64512e9 [fix](regression) Align map_agg null-key golden on
branch-4.1 (#65879)
add cf0feee3d9c [branch-4.1][fix](test) Stabilize export parallelism CSV
reload (#65932)
add eb93ace3a5a branch-4.1: [fix](brpc) Make secondary package aliases
non-owning #65777 (#65819)
add 2a11f7853b3 branch-4.1: [enhance](cloud) Increase get version timeout
to 30 seconds #65625 (#65748)
add 491819ab4d8 branch-4.1: [feat](job) show first error message for
routine load (#65662)
add d7c7cb53f35 branch-4.1: [regression-test](variant) Fix schema change
wait timeout #65139 (#65317)
add 13e9c9d3da3 branch-4.1: [fix](be) Fix waiter accounting in blocking
queue #65827 (#65941)
add e24b12fe022 [branch-4.1][fix](regression) Avoid loopback HTTP TVF host
(#65877)
add 7b35dcf7fdd branch-4.1: [fix](paimon) Handle special characters in
partition values #65904 (#65938)
add cd5f70ac49c branch-4.1: [fix](fe) Normalize MySQL JDBC URLs for
streaming jobs #65647 (#65949)
add 9e8c558c7dd branch-4.1: [fix](be) Backpressure async group commit by
table WAL count #65362 (#65940)
add 8ab39e4ded9 branch-4.1：[enhance](auth)Hidden the token info during
StreamLoad in BE info #60656 && [enhance](auth)Hidden the auth info during
StreamLoad in BE info #59743 (#65944)
add 3117aaa0dd5 branch-4.1: [fix](be) remove changing segment cache blocks
to index type #65905 (#65948)
add be8b2c9abc3 branch-4.1: [fix](variant) Prefer sparse variant fields
over root value #65660 (#65950)
add 2bf2a08eb54 branch-4.1: [opt](csv reader) optimize nullable string
deserialization in CSV/text load hot path #64476 (#65843)
add 176a2b5ba47 [branch-4-1](fix) Backport selected external scan fixes
(#65935)
add 3347496caae branch-4.1: [fix](test) skip test_flight_record when the
frontend is not on the regression runner #65933 (#65946)
add b58b813a743 branch-4.1: [fix](regression) Stabilize rowsets timestamp
filters #65050 (#65954)
add 248911c5556 branch-4.1: [fix](file-cache): speed up LRU restore
startup path #65174 (#65953)
add e69f225b92a branch-4.1: [fix](fe) Guard auto partition result against
concurrent drops #65282 (#65956)
add 23a0a22521c branch-4.1: [feature](streaming-job) Support OceanBase CDC
streaming jobs #65588 (#65969)
add f1d1f8643fe branch-4.1: [fix](cloud) Preserve resource IDs when
recycling empty rowsets #65862 (#65923)
add e28029d2888 [branch-4.1][fix](test) relax show data size comparison
(#65927)
add b8a2a14dab3 branch-4.1: [fix](s3) Add S3 rate limit observability
#64038 (#65974)
add 192c2dc0487 branch-4.1: [fix](regression) Wait for show config output
before parsing #65486 (#65711)
add 4336f7ecbf0 [fix](iceberg) Project Iceberg system table scans (#65262)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (836a849b318)
\
N -- N -- N refs/heads/agent/branch41-iceberg-system-projection
(4336f7ecbf0)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
be/benchmark/benchmark_arrow_validation.hpp | 382 ++
be/benchmark/benchmark_main.cpp | 88 +-
be/benchmark/parquet/AGENTS.md | 296 ++
be/benchmark/parquet/README.md | 63 +
be/benchmark/parquet/benchmark_parquet_decoder.hpp | 479 +++
be/benchmark/parquet/benchmark_parquet_reader.hpp | 448 +++
be/benchmark/parquet/parquet_benchmark_scenarios.h | 263 ++
be/src/common/config.cpp | 9 +
be/src/common/config.h | 6 +
be/src/core/block/block.cpp | 15 +
be/src/core/block/block.h | 13 +
be/src/core/column/column.h | 17 +-
be/src/core/column/column_decimal.h | 3 +-
be/src/core/column/column_dictionary.h | 17 +-
be/src/core/column/column_nullable.cpp | 10 +-
be/src/core/column/column_nullable.h | 3 +-
be/src/core/column/column_string.cpp | 3 +-
be/src/core/column/column_string.h | 106 +-
be/src/core/column/column_variant.cpp | 5 +
be/src/core/column/column_vector.h | 3 +-
be/src/core/data_type_serde/arrow_validation.h | 320 ++
.../core/data_type_serde/data_type_array_serde.cpp | 5 +
.../data_type_date_or_datetime_serde.cpp | 5 +
.../data_type_serde/data_type_datetimev2_serde.cpp | 190 +-
.../data_type_serde/data_type_datetimev2_serde.h | 5 +
.../data_type_serde/data_type_datev2_serde.cpp | 108 +-
.../core/data_type_serde/data_type_datev2_serde.h | 5 +
.../data_type_serde/data_type_decimal_serde.cpp | 271 +-
.../core/data_type_serde/data_type_decimal_serde.h | 5 +
.../core/data_type_serde/data_type_ipv4_serde.cpp | 5 +
.../core/data_type_serde/data_type_ipv6_serde.cpp | 5 +
.../core/data_type_serde/data_type_jsonb_serde.cpp | 5 +
.../core/data_type_serde/data_type_map_serde.cpp | 5 +
.../data_type_serde/data_type_nullable_serde.cpp | 6 +
.../data_type_serde/data_type_number_serde.cpp | 365 +-
.../core/data_type_serde/data_type_number_serde.h | 5 +
be/src/core/data_type_serde/data_type_serde.cpp | 13 +
be/src/core/data_type_serde/data_type_serde.h | 15 +
.../data_type_serde/data_type_string_serde.cpp | 153 +-
.../core/data_type_serde/data_type_string_serde.h | 5 +
.../data_type_serde/data_type_struct_serde.cpp | 5 +
.../core/data_type_serde/data_type_time_serde.cpp | 107 +
be/src/core/data_type_serde/data_type_time_serde.h | 5 +
.../data_type_timestamptz_serde.cpp | 156 +-
.../data_type_serde/data_type_timestamptz_serde.h | 5 +
.../data_type_serde/data_type_varbinary_serde.cpp | 69 +
.../data_type_serde/data_type_varbinary_serde.h | 6 +
.../core/data_type_serde/parquet_decode_source.h | 392 ++
be/src/core/data_type_serde/parquet_timestamp.h | 95 +
.../operator/group_commit_block_sink_operator.cpp | 9 +-
be/src/exec/operator/operator.h | 2 +
be/src/exec/operator/scan_operator.cpp | 30 +-
be/src/exec/operator/scan_operator.h | 26 +-
be/src/exec/scan/access_path_parser.cpp | 101 +-
be/src/exec/scan/access_path_parser.h | 6 +-
be/src/exec/scan/file_scanner.cpp | 59 +-
be/src/exec/scan/file_scanner.h | 39 +-
be/src/exec/scan/file_scanner_v2.cpp | 337 +-
be/src/exec/scan/file_scanner_v2.h | 48 +
be/src/exec/scan/scanner.cpp | 16 +-
be/src/exec/scan/scanner.h | 10 +-
be/src/exec/sink/viceberg_delete_sink.cpp | 20 +-
be/src/exec/sink/viceberg_delete_sink.h | 4 +
be/src/exec/sink/viceberg_merge_sink.cpp | 3 +
.../sink/writer/iceberg/partition_transformers.cpp | 20 +-
.../writer/iceberg/viceberg_partition_writer.cpp | 10 +-
.../writer/iceberg/viceberg_partition_writer.h | 3 +
be/src/exprs/function/cast/cast_to_decimal.h | 11 +
...efilter_wrapper.cpp => runtime_filter_expr.cpp} | 64 +-
...ntimefilter_wrapper.h => runtime_filter_expr.h} | 27 +-
be/src/exprs/vcompound_pred.h | 8 +
be/src/exprs/vectorized_fn_call.cpp | 151 +-
be/src/exprs/vectorized_fn_call.h | 5 +
be/src/exprs/vexpr.h | 23 +
be/src/exprs/vruntimefilter_wrapper.cpp | 12 +
be/src/exprs/vruntimefilter_wrapper.h | 1 +
be/src/format/arrow/arrow_stream_reader.cpp | 3 +-
be/src/format/csv/csv_reader.cpp | 59 +-
be/src/format/csv/csv_reader.h | 5 +
.../file_reader/new_plain_text_line_reader.cpp | 17 +-
.../file_reader/new_plain_text_line_reader.h | 6 +-
.../delimited_text => format}/hive_text_util.h | 0
.../{format_v2 => format}/jni/jni_data_bridge.cpp | 0
be/src/{format_v2 => format}/jni/jni_data_bridge.h | 0
be/src/format/json/new_json_reader.cpp | 3 +-
be/src/format/native/native_reader.cpp | 25 +-
be/src/format/native/native_reader.h | 6 +
be/src/format/orc/vorc_reader.cpp | 7 +-
be/src/format/orc/vorc_reader.h | 7 +-
be/src/format/parquet/vparquet_reader.cpp | 21 +-
.../{format_v2 => format/table}/deletion_vector.h | 12 +
be/src/format/table/deletion_vector_reader.cpp | 146 +-
be/src/format/table/deletion_vector_reader.h | 64 +-
.../table/iceberg_delete_file_reader_helper.cpp | 147 +-
.../table/iceberg_delete_file_reader_helper.h | 15 +-
.../iceberg_position_delete_sys_table_reader.cpp | 628 +++
.../iceberg_position_delete_sys_table_reader.h | 116 +
.../table/iceberg_scan_semantics.h} | 16 +-
be/src/format/table/paimon_jni_reader.cpp | 23 +
be/src/format/table/paimon_jni_reader.h | 2 +
be/src/format/table/paimon_reader.cpp | 110 +-
be/src/format/table/paimon_reader.h | 11 +
be/src/format/text/text_reader.cpp | 32 +-
be/src/format/text/text_reader.h | 3 +-
be/src/format/transformer/vorc_transformer.cpp | 11 +-
be/src/format_v2/AGENTS.md | 110 +
be/src/format_v2/column_data.h | 6 +
be/src/format_v2/column_mapper.cpp | 609 ++-
be/src/format_v2/column_mapper.h | 20 +-
be/src/format_v2/deletion_vector_reader.cpp | 192 -
be/src/format_v2/deletion_vector_reader.h | 111 -
be/src/format_v2/delimited_text/csv_reader.cpp | 223 +-
be/src/format_v2/delimited_text/csv_reader.h | 5 +-
.../delimited_text/delimited_text_reader.cpp | 21 +-
.../delimited_text/delimited_text_reader.h | 1 +
be/src/format_v2/delimited_text/text_reader.cpp | 2 +-
be/src/format_v2/expr/cast.cpp | 4 +-
.../format_v2/expr/equality_delete_predicate.cpp | 63 +-
be/src/format_v2/file_reader.cpp | 13 +-
be/src/format_v2/file_reader.h | 24 +-
be/src/format_v2/jni/iceberg_sys_table_reader.cpp | 43 +-
be/src/format_v2/jni/jdbc_reader.cpp | 42 +-
be/src/format_v2/jni/jdbc_reader.h | 2 +
be/src/format_v2/jni/jni_table_reader.cpp | 48 +-
be/src/format_v2/jni/jni_table_reader.h | 4 +-
.../format_v2/jni/trino_connector_jni_reader.cpp | 11 +-
be/src/format_v2/json/json_reader.cpp | 91 +-
be/src/format_v2/json/json_reader.h | 52 +-
be/src/format_v2/native/native_reader.cpp | 68 +-
be/src/format_v2/native/native_reader.h | 6 +
be/src/format_v2/orc/orc_file_input_stream.cpp | 37 +-
be/src/format_v2/orc/orc_reader.cpp | 44 +-
be/src/format_v2/orc/orc_reader.h | 1 +
be/src/format_v2/parquet/native_schema_desc.cpp | 874 +++++
be/src/format_v2/parquet/native_schema_desc.h | 183 +
be/src/format_v2/parquet/native_schema_node.cpp | 142 +
be/src/format_v2/parquet/native_schema_node.h | 93 +
be/src/format_v2/parquet/parquet_column_schema.cpp | 603 +--
be/src/format_v2/parquet/parquet_column_schema.h | 19 +-
be/src/format_v2/parquet/parquet_file_context.cpp | 964 +++--
be/src/format_v2/parquet/parquet_file_context.h | 142 +-
be/src/format_v2/parquet/parquet_profile.cpp | 124 +-
be/src/format_v2/parquet/parquet_profile.h | 75 +-
be/src/format_v2/parquet/parquet_reader.cpp | 299 +-
be/src/format_v2/parquet/parquet_reader.h | 3 +-
be/src/format_v2/parquet/parquet_scan.cpp | 1412 +++++--
be/src/format_v2/parquet/parquet_scan.h | 137 +-
be/src/format_v2/parquet/parquet_statistics.cpp | 1684 ++++----
be/src/format_v2/parquet/parquet_statistics.h | 105 +-
be/src/format_v2/parquet/parquet_type.cpp | 324 +-
be/src/format_v2/parquet/parquet_type.h | 21 +-
be/src/format_v2/parquet/reader/column_reader.cpp | 605 +--
be/src/format_v2/parquet/reader/column_reader.h | 209 +-
.../parquet/reader/count_column_reader.cpp | 225 ++
.../format_v2/parquet/reader/count_column_reader.h | 72 +
.../parquet/reader/list_column_reader.cpp | 230 --
.../format_v2/parquet/reader/list_column_reader.h | 57 -
.../format_v2/parquet/reader/map_column_reader.cpp | 285 --
.../format_v2/parquet/reader/map_column_reader.h | 61 -
.../reader/native/block_split_bloom_filter.cpp | 116 +
.../reader/native/block_split_bloom_filter.h | 54 +
.../parquet/reader/native/bool_plain_decoder.cpp | 99 +
.../parquet/reader/native/bool_plain_decoder.h | 107 +
.../parquet/reader/native/bool_rle_decoder.cpp | 94 +
.../parquet/reader/native/bool_rle_decoder.h | 61 +
.../reader/native/byte_array_dict_decoder.cpp | 67 +
.../reader/native/byte_array_dict_decoder.h | 45 +
.../reader/native/byte_array_plain_decoder.cpp | 131 +
.../reader/native/byte_array_plain_decoder.h | 73 +
.../reader/native/byte_stream_split_decoder.cpp | 82 +
.../reader/native/byte_stream_split_decoder.h | 60 +
.../parquet/reader/native/column_chunk_reader.cpp | 1951 +++++++++
.../parquet/reader/native/column_chunk_reader.h | 416 ++
.../parquet/reader/native/column_reader.cpp | 1902 +++++++++
.../parquet/reader/native/column_reader.h | 662 ++++
be/src/format_v2/parquet/reader/native/common.cpp | 196 +
be/src/format_v2/parquet/reader/native/common.h | 111 +
be/src/format_v2/parquet/reader/native/decoder.cpp | 156 +
be/src/format_v2/parquet/reader/native/decoder.h | 345 ++
.../reader/native/delta_bit_pack_decoder.cpp | 180 +
.../parquet/reader/native/delta_bit_pack_decoder.h | 818 ++++
.../reader/native/fix_length_dict_decoder.hpp | 64 +
.../reader/native/fix_length_plain_decoder.cpp | 93 +
.../reader/native/fix_length_plain_decoder.h | 51 +
.../parquet/reader/native/level_decoder.cpp | 271 ++
.../parquet/reader/native/level_decoder.h | 87 +
.../parquet/reader/native/level_reader.cpp | 222 ++
.../format_v2/parquet/reader/native/level_reader.h | 72 +
.../parquet/reader/native/page_reader.cpp | 332 ++
.../format_v2/parquet/reader/native/page_reader.h | 303 ++
.../parquet/reader/native_column_reader.cpp | 772 ++++
.../parquet/reader/native_column_reader.h | 152 +
.../parquet/reader/nested_column_materializer.cpp | 70 -
.../parquet/reader/nested_column_materializer.h | 45 -
.../parquet/reader/parquet_leaf_reader.cpp | 803 ----
.../format_v2/parquet/reader/parquet_leaf_reader.h | 173 -
.../parquet/reader/row_position_column_reader.cpp | 1 +
.../parquet/reader/scalar_column_reader.cpp | 584 ---
.../parquet/reader/scalar_column_reader.h | 110 -
.../parquet/reader/struct_column_reader.cpp | 287 --
.../parquet/reader/struct_column_reader.h | 65 -
be/src/format_v2/parquet/selection_vector.h | 58 +-
be/src/format_v2/table/hive_reader.cpp | 17 +-
be/src/format_v2/table/hudi_reader.cpp | 70 +-
be/src/format_v2/table/hudi_reader.h | 19 +
.../iceberg_position_delete_sys_table_reader.cpp | 639 +++
.../iceberg_position_delete_sys_table_reader.h | 87 +
be/src/format_v2/table/iceberg_reader.cpp | 106 +-
be/src/format_v2/table/iceberg_reader.h | 41 +-
be/src/format_v2/table/iceberg_schema_utils.h | 53 +
be/src/format_v2/table/paimon_reader.cpp | 74 +-
be/src/format_v2/table/paimon_reader.h | 21 +-
be/src/format_v2/table/remote_doris_reader.cpp | 236 +-
be/src/format_v2/table/remote_doris_reader.h | 9 +
be/src/format_v2/table/schema_history_util.cpp | 2 +
be/src/format_v2/table_reader.cpp | 379 +-
be/src/format_v2/table_reader.h | 433 +-
.../schema_routine_load_job_scanner.cpp | 4 +
be/src/io/cache/block_file_cache_factory.cpp | 137 +-
be/src/io/cache/block_file_cache_factory.h | 5 +
be/src/io/cache/block_file_cache_profile.cpp | 12 +-
be/src/io/cache/block_file_cache_profile.h | 6 +-
be/src/io/cache/cache_lru_dumper.cpp | 18 +-
be/src/io/cache/cache_lru_dumper.h | 4 +-
be/src/io/fs/azure_obj_storage_client.cpp | 5 +-
be/src/io/fs/buffered_reader.cpp | 11 +-
be/src/io/fs/buffered_reader.h | 8 +-
be/src/io/fs/hdfs_file_reader.cpp | 6 +-
be/src/io/fs/hdfs_file_reader.h | 1 +
be/src/io/fs/s3_file_reader.cpp | 6 +-
be/src/io/fs/s3_obj_storage_client.cpp | 20 +-
be/src/load/group_commit/group_commit_mgr.cpp | 56 +-
be/src/load/group_commit/group_commit_mgr.h | 5 +-
be/src/load/group_commit/wal/wal_manager.cpp | 13 +-
be/src/load/group_commit/wal/wal_manager.h | 1 +
be/src/load/group_commit/wal/wal_table.cpp | 14 +
be/src/load/group_commit/wal/wal_table.h | 4 +-
be/src/load/stream_load/stream_load_executor.cpp | 7 +-
be/src/runtime/exec_env_init.cpp | 28 +-
be/src/runtime/file_scan_profile.h | 55 +
be/src/runtime/runtime_state.cpp | 12 +
be/src/runtime/runtime_state.h | 12 +-
be/src/service/http/action/stream_load.cpp | 8 +
.../http/action/stream_load_forward_handler.cpp | 8 +-
be/src/service/http/http_request.cpp | 20 +-
.../segment/adaptive_block_size_predictor.cpp | 7 +-
.../segment/adaptive_block_size_predictor.h | 1 +
be/src/storage/segment/segment_writer.cpp | 12 -
be/src/util/block_compression.cpp | 12 +-
be/src/util/blocking_queue.hpp | 69 +-
be/src/util/cpu_info.cpp | 11 +
be/src/util/cpu_info.h | 4 +
be/src/util/jdbc_utils.cpp | 67 +
.../access_path_parser.h => util/jdbc_utils.h} | 33 +-
be/src/util/s3_util.cpp | 16 +-
be/src/util/s3_util.h | 1 +
be/src/util/timezone_utils.cpp | 9 +-
be/test/core/block/block_test.cpp | 31 +
be/test/core/column/column_dictionary_test.cpp | 12 +-
be/test/core/column/column_nullable_test.cpp | 3 +-
be/test/core/column/column_string_test.cpp | 4 +-
be/test/core/column/column_variant_test.cpp | 27 +
be/test/core/data_type/block_check_type.cpp | 20 +-
.../data_type_serde_arrow_validation_test.cpp | 275 ++
.../data_type_serde_decoded_values_test.cpp | 49 +-
.../data_type_serde_parquet_test.cpp | 891 +++++
be/test/exec/scan/access_path_parser_test.cpp | 100 +-
be/test/exec/scan/file_scanner_v2_test.cpp | 114 +
be/test/exec/scan/scanner_late_arrival_rf_test.cpp | 60 +-
be/test/exec/sink/viceberg_delete_sink_test.cpp | 14 +
.../iceberg/iceberg_partition_writer_test.cpp | 107 +
.../writer/iceberg/partition_transformers_test.cpp | 24 +
.../iceberg_delete_file_reader_helper_test.cpp | 552 ++-
...eberg_position_delete_sys_table_reader_test.cpp | 720 ++++
.../format/transformer/vorc_transformer_test.cpp | 107 +
be/test/format/wal/wal_manager_test.cpp | 32 +
be/test/format_v2/column_mapper_test.cpp | 627 ++-
.../format_v2/delimited_text/csv_reader_test.cpp | 16 +-
.../format_v2/delimited_text/text_reader_test.cpp | 44 +-
be/test/format_v2/jni/jdbc_reader_test.cpp | 49 +
be/test/format_v2/jni/jni_table_reader_test.cpp | 45 +-
be/test/format_v2/json/json_reader_test.cpp | 24 +-
be/test/format_v2/native/native_reader_test.cpp | 37 +-
.../format_v2/orc/orc_file_input_stream_test.cpp | 47 +-
be/test/format_v2/orc/orc_reader_test.cpp | 183 +-
be/test/format_v2/parquet/native_decoder_test.cpp | 4146 ++++++++++++++++++++
.../parquet/parquet_benchmark_scenarios_test.cpp | 148 +
.../parquet/parquet_column_reader_test.cpp | 3682 -----------------
.../format_v2/parquet/parquet_leaf_reader_test.cpp | 506 ---
.../parquet/parquet_page_cache_range_test.cpp | 102 +-
.../parquet/parquet_reader_control_test.cpp | 1132 +-----
be/test/format_v2/parquet/parquet_reader_test.cpp | 1238 ++++--
be/test/format_v2/parquet/parquet_scan_test.cpp | 1261 ++++--
be/test/format_v2/parquet/parquet_schema_test.cpp | 1106 +++---
.../parquet/parquet_serde_reader_test.cpp | 459 ---
.../format_v2/parquet/parquet_statistics_test.cpp | 1445 +++----
be/test/format_v2/parquet/parquet_type_test.cpp | 491 +--
be/test/format_v2/table/hive_reader_test.cpp | 2 +-
be/test/format_v2/table/hudi_reader_test.cpp | 314 ++
...eberg_position_delete_sys_table_reader_test.cpp | 63 +
be/test/format_v2/table/iceberg_reader_test.cpp | 863 +++-
be/test/format_v2/table/paimon_reader_test.cpp | 284 +-
.../format_v2/table/remote_doris_reader_test.cpp | 269 ++
be/test/format_v2/table_reader_test.cpp | 1146 +++++-
be/test/io/cache/block_file_cache_test.cpp | 67 +
be/test/io/cache/cache_lru_dumper_test.cpp | 42 +
.../segment/adaptive_block_size_predictor_test.cpp | 12 +
be/test/util/blocking_queue_test.cpp | 316 ++
cloud/src/common/config.h | 3 +
cloud/src/recycler/azure_obj_client.cpp | 9 +-
cloud/src/recycler/recycler.cpp | 17 +-
cloud/src/recycler/s3_accessor.cpp | 28 +-
cloud/src/recycler/s3_obj_client.cpp | 29 +-
cloud/test/recycler_test.cpp | 38 +
cloud/test/s3_rate_limiter_test.cpp | 81 +-
common/cpp/obj_retry_strategy.cpp | 17 +
common/cpp/obj_retry_strategy.h | 2 +
common/cpp/token_bucket_rate_limiter.cpp | 91 +-
common/cpp/token_bucket_rate_limiter.h | 38 +-
docker/runtime/doris-compose/cluster.py | 17 +-
docker/runtime/doris-compose/command.py | 15 +-
docker/thirdparties/custom_settings.env | 4 +
.../docker-compose/clickhouse/clickhouse.yaml.tpl | 5 +-
.../clickhouse/init/03-create-table.sql | 10 +-
.../thirdparties/docker-compose/db2/db2.yaml.tpl | 3 +-
docker/thirdparties/docker-compose/hive/README.md | 408 ++
.../thirdparties/docker-compose/hive/README_ZH.md | 408 ++
.../docker-compose/hive/hadoop-hive.env.tpl | 6 +-
.../docker-compose/hive/hive-2x.yaml.tpl | 36 +-
.../docker-compose/hive/hive-2x_settings.env | 4 +-
.../docker-compose/hive/hive-3x.yaml.tpl | 36 +-
.../docker-compose/hive/scripts/bin/hadoop | 75 +
.../docker-compose/hive/scripts/bin/hive | 54 +
.../hive/scripts/bootstrap/bootstrap-groups.sh | 167 +
.../bootstrap/hive2_only.preinstalled_hql.list | 4 +
.../hive/scripts/bootstrap/hive2_only.run_sh.list | 1 +
.../scripts/bootstrap/hive3_only.download_dir.list | 2 +
.../hive/scripts/bootstrap/hive3_only.run_sh.list | 2 +
.../create_paimon_tables.hql | 26 +-
.../create_hive_orc_tables.hql | 4 +-
.../create_tpch1_orc.hql | 34 +-
.../create_tpch1_parquet.hql | 34 +-
.../create_preinstalled_scripts/employees.csv | 5 +
.../scripts/create_preinstalled_scripts/run02.hql | 3 +-
.../scripts/create_preinstalled_scripts/run03.hql | 3 +-
.../scripts/create_preinstalled_scripts/run04.hql | 6 +-
.../scripts/create_preinstalled_scripts/run05.hql | 7 +-
.../scripts/create_preinstalled_scripts/run06.hql | 7 +-
.../scripts/create_preinstalled_scripts/run07.hql | 7 +-
.../scripts/create_preinstalled_scripts/run08.hql | 7 +-
.../scripts/create_preinstalled_scripts/run09.hql | 7 +-
.../scripts/create_preinstalled_scripts/run10.hql | 7 +-
.../scripts/create_preinstalled_scripts/run11.hql | 6 +-
.../scripts/create_preinstalled_scripts/run12.hql | 7 +-
.../scripts/create_preinstalled_scripts/run13.hql | 6 +-
.../scripts/create_preinstalled_scripts/run14.hql | 3 +-
.../scripts/create_preinstalled_scripts/run15.hql | 1 +
.../scripts/create_preinstalled_scripts/run16.hql | 3 +-
.../scripts/create_preinstalled_scripts/run17.hql | 3 +-
.../scripts/create_preinstalled_scripts/run18.hql | 3 +-
.../scripts/create_preinstalled_scripts/run19.hql | 20 +-
.../scripts/create_preinstalled_scripts/run25.hql | 96 -
.../scripts/create_preinstalled_scripts/run29.hql | 1 +
.../scripts/create_preinstalled_scripts/run30.hql | 3 +-
.../scripts/create_preinstalled_scripts/run31.hql | 3 +-
.../scripts/create_preinstalled_scripts/run32.hql | 3 +-
.../scripts/create_preinstalled_scripts/run33.hql | 6 +-
.../scripts/create_preinstalled_scripts/run34.hql | 7 +-
.../scripts/create_preinstalled_scripts/run35.hql | 3 +-
.../scripts/create_preinstalled_scripts/run36.hql | 3 +-
.../scripts/create_preinstalled_scripts/run37.hql | 6 +-
.../scripts/create_preinstalled_scripts/run38.hql | 7 +-
.../scripts/create_preinstalled_scripts/run39.hql | 6 +-
.../scripts/create_preinstalled_scripts/run40.hql | 7 +-
.../scripts/create_preinstalled_scripts/run41.hql | 6 +-
.../scripts/create_preinstalled_scripts/run42.hql | 7 +-
.../scripts/create_preinstalled_scripts/run43.hql | 6 +-
.../scripts/create_preinstalled_scripts/run44.hql | 6 +-
.../scripts/create_preinstalled_scripts/run45.hql | 6 +-
.../scripts/create_preinstalled_scripts/run46.hql | 6 +-
.../scripts/create_preinstalled_scripts/run47.hql | 7 +-
.../scripts/create_preinstalled_scripts/run48.hql | 7 +-
.../scripts/create_preinstalled_scripts/run49.hql | 7 +-
.../scripts/create_preinstalled_scripts/run50.hql | 6 +-
.../scripts/create_preinstalled_scripts/run51.hql | 7 +-
.../scripts/create_preinstalled_scripts/run52.hql | 7 +-
.../scripts/create_preinstalled_scripts/run53.hql | 6 +-
.../scripts/create_preinstalled_scripts/run54.hql | 6 +-
.../scripts/create_preinstalled_scripts/run55.hql | 6 +-
.../scripts/create_preinstalled_scripts/run56.hql | 6 +-
.../scripts/create_preinstalled_scripts/run57.hql | 6 +-
.../scripts/create_preinstalled_scripts/run58.hql | 6 +-
.../scripts/create_preinstalled_scripts/run59.hql | 6 +-
.../scripts/create_preinstalled_scripts/run60.hql | 6 +-
.../scripts/create_preinstalled_scripts/run61.hql | 7 +-
.../scripts/create_preinstalled_scripts/run62.hql | 7 +-
.../scripts/create_preinstalled_scripts/run63.hql | 58 +-
.../scripts/create_preinstalled_scripts/run64.hql | 9 +-
.../scripts/create_preinstalled_scripts/run65.hql | 9 +-
.../scripts/create_preinstalled_scripts/run66.hql | 4 +
.../scripts/create_preinstalled_scripts/run67.hql | 6 +-
.../scripts/create_preinstalled_scripts/run69.hql | 8 +-
.../scripts/create_preinstalled_scripts/run70.hql | 5 +-
.../scripts/create_preinstalled_scripts/run71.hql | 7 +-
.../scripts/create_preinstalled_scripts/run72.hql | 14 +-
.../scripts/create_preinstalled_scripts/run73.hql | 19 +-
.../scripts/create_preinstalled_scripts/run74.hql | 20 +-
.../scripts/create_preinstalled_scripts/run75.hql | 129 +-
.../scripts/create_preinstalled_scripts/run76.hql | 50 +-
.../scripts/create_preinstalled_scripts/run77.hql | 3 +-
.../scripts/create_preinstalled_scripts/run80.hql | 21 +-
.../scripts/create_preinstalled_scripts/run81.hql | 12 +-
.../scripts/create_preinstalled_scripts/run82.hql | 10 +-
.../scripts/create_preinstalled_scripts/run83.hql | 31 +-
.../scripts/create_preinstalled_scripts/run84.hql | 7 +-
.../scripts/create_preinstalled_scripts/run85.hql | 4 +-
.../scripts/create_view_scripts/create_view.hql | 8 +
.../data/default/account_fund/create_table.hql | 6 +-
.../scripts/data/default/hive01/create_table.hql | 6 +-
.../data/default/sale_table/create_table.hql | 6 +-
.../data/default/string_table/create_table.hql | 6 +-
.../scripts/data/default/student/create_table.hql | 6 +-
.../scripts/data/default/test1/create_table.hql | 6 +-
.../scripts/data/default/test2/create_table.hql | 6 +-
.../data/default/test_hive_doris/create_table.hql | 6 +-
.../data/multi_catalog/datev2_csv/create_table.hql | 7 +-
.../data/multi_catalog/datev2_orc/create_table.hql | 7 +-
.../multi_catalog/datev2_parquet/create_table.hql | 7 +-
.../hive_config_test/create_table.hql | 13 +-
.../hive_text_complex_type/create_table.hql | 6 +-
.../hive_text_complex_type2/create_table.hql | 6 +-
.../hive_text_complex_type3/create_table.hql | 6 +-
.../create_table.hql | 6 +-
.../create_table.hql | 6 +-
.../create_table.hql | 6 +-
.../hive_textfile_array_all_types/create_table.hql | 6 +-
.../hive_textfile_array_delimiter/create_table.hql | 6 +-
.../hive_textfile_nestedarray/create_table.hql | 6 +-
.../hive_upper_case_orc/create_table.hql | 7 +-
.../hive_upper_case_parquet/create_table.hql | 7 +-
.../multi_catalog/logs1_parquet/create_table.hql | 6 +-
.../multi_catalog/one_partition/create_table.hql | 5 +-
.../orc_nested_types/create_table.hql | 7 +-
.../orc_partitioned_columns/create_table.hql | 4 +-
.../orc_partitioned_one_column/create_table.hql | 4 +-
.../orc_predicate/orc_predicate_table.hql | 12 +-
.../par_fields_in_file_orc/create_table.hql | 4 +-
.../par_fields_in_file_parquet/create_table.hql | 4 +-
.../create_table.hql | 6 +-
.../create_table.hql | 6 +-
.../parquet_alter_column_to_char/create_table.hql | 6 +-
.../parquet_alter_column_to_date/create_table.hql | 6 +-
.../create_table.hql | 6 +-
.../create_table.hql | 6 +-
.../parquet_alter_column_to_float/create_table.hql | 6 +-
.../parquet_alter_column_to_int/create_table.hql | 6 +-
.../create_table.hql | 6 +-
.../create_table.hql | 6 +-
.../create_table.hql | 6 +-
.../create_table.hql | 6 +-
.../create_table.hql | 6 +-
.../parquet_bloom_filter/create_table.hql | 6 +-
.../parquet_lz4_compression/create_table.hql | 7 +-
.../parquet_lzo_compression/create_table.hql | 7 +-
.../parquet_nested_types/create_table.hql | 19 +-
.../parquet_partitioned_columns/create_table.hql | 4 +-
.../create_table.hql | 4 +-
.../parquet_predicate_table/create_table.hql | 6 +-
.../partition_location_1/create_table.hql | 6 +-
.../partition_location_2/create_table.hql | 8 +-
.../partition_manual_remove/create_table.hql | 4 +-
.../test_chinese_orc/create_table.hql | 6 +-
.../test_chinese_parquet/create_table.hql | 6 +-
.../test_chinese_text/create_table.hql | 6 +-
.../test_complex_types/create_table.hql | 24 +-
.../test_compress_partitioned/create_table.hql | 4 +-
.../test_csv_format_error/create_table.hql | 4 +-
.../test_date_string_partition/create_table.hql | 6 +-
.../test_hive_same_db_table_name/create_table.hql | 6 +-
.../create_table.hql | 4 +-
.../test_mixed_par_locations_orc/create_table.hql | 4 +-
.../create_table.hql | 4 +-
.../test_multi_langs_orc/create_table.hql | 6 +-
.../test_multi_langs_parquet/create_table.hql | 6 +-
.../test_multi_langs_text/create_table.hql | 6 +-
.../test_special_orc_formats/create_table.hql | 6 +-
.../create_table.hql | 6 +-
.../create_table.hql | 6 +-
.../create_table.hql | 6 +-
.../multi_catalog/test_wide_table/create_table.hql | 6 +-
.../text_partitioned_columns/create_table.hql | 4 +-
.../text_partitioned_one_column/create_table.hql | 4 +-
.../timestamp_with_time_zone/create_table.hql | 6 +-
.../multi_catalog/two_partition/create_table.hql | 5 +-
.../multi_catalog/type_change_orc/create_table.hql | 6 +-
.../type_change_origin/create_table.hql | 6 +-
.../type_change_parquet/create_table.hql | 6 +-
.../bigint_partition/create_table.hql | 4 +-
.../partition_type/char_partition/create_table.hql | 4 +-
.../partition_type/date_partition/create_table.hql | 4 +-
.../decimal_partition/create_table.hql | 4 +-
.../double_partition/create_table.hql | 4 +-
.../float_partition/create_table.hql | 4 +-
.../partition_type/int_partition/create_table.hql | 4 +-
.../smallint_partition/create_table.hql | 4 +-
.../string_partition/create_table.hql | 4 +-
.../tinyint_partition/create_table.hql | 4 +-
.../varchar_partition/create_table.hql | 4 +-
.../data/regression/crdmm_data/create_table.hql | 7 +-
.../multi_delimit_serde/create_table.hql | 11 +-
.../regression/serde_prop/some_serde_table.hql | 53 +-
.../data/statistics/empty_table/create_table.hql | 6 +-
.../data/statistics/statistics/create_table.hql | 8 +-
.../scripts/data/statistics/stats/create_table.hql | 6 +-
.../scripts/data/test/hive_test/create_table.hql | 6 +-
.../data/tpch_1000_parquet/part/create_table.hql | 7 +-
.../data/tvf/test_hdfs_tvf_compression/run.sh | 6 +-
.../docker-compose/hive/scripts/healthy_check.sh | 6 +-
.../docker-compose/hive/scripts/hive-common-lib.sh | 80 +
.../docker-compose/hive/scripts/hive-metastore.sh | 149 -
.../docker-compose/hive/scripts/hive-module-lib.sh | 325 ++
.../scripts/init-hive-baseline.sh} | 32 +-
.../hive/scripts/prepare-hive-data.sh | 157 +-
.../hive/scripts/refresh-hive-modules.sh | 59 +
.../scripts/reset-hive-state.sh} | 13 +-
.../hive/scripts/snapshot-hive-baseline.sh | 68 +
.../scripts/start-hive-metastore.sh} | 15 +-
.../{healthy_check.sh => start-hive-server.sh} | 12 +-
.../docker-compose/iceberg/entrypoint.sh.tpl | 6 +-
.../docker-compose/iceberg/iceberg.yaml.tpl | 6 +-
.../create_preinstalled_scripts/iceberg/run31.sql | 33 +
.../docker-compose/kerberos/.gitignore | 8 +
.../{conf/kerberos1/krb5.conf.tpl => Dockerfile} | 35 +-
.../kerberos/common/conf/doris-krb5.conf | 6 -
.../common/hadoop/apply-config-overrides.sh | 31 -
.../kerberos/common/hadoop/hadoop-run.sh | 44 -
.../auth-to-local.xml => conf/core-site.xml.tpl} | 29 +-
.../docker-compose/kerberos/conf/hdfs-site.xml.tpl | 113 +
.../docker-compose/kerberos/conf/hive-site.xml.tpl | 65 +
.../oceanbase.env => kerberos/conf/kdc.conf.tpl} | 14 +-
.../kerberos/conf/kerberos1/kdc.conf.tpl | 50 -
.../kerberos/conf/kerberos2/kdc.conf.tpl | 38 -
.../kerberos/conf/{kerberos2 => }/krb5.conf.tpl | 16 +-
.../docker-compose/kerberos/conf/my.cnf.tpl | 38 -
.../kerberos/entrypoint-hive-master.sh | 196 +-
.../docker-compose/kerberos/hadoop-hive.env.tpl | 121 +-
.../kerberos/health-checks/health.sh | 22 +-
.../docker-compose/kerberos/kerberos.yaml.tpl | 68 +-
.../docker-compose/kerberos/kerberos1_settings.env | 50 +-
.../docker-compose/kerberos/kerberos2_settings.env | 46 +-
.../kerberos/sql/create_kerberos_hive_table.sql | 17 -
.../kerberos/sql/create_paimon_hive_table.hql | 15 -
.../two-kerberos-hives/hive2-default-fs-site.xml | 25 -
.../docker-compose/oceanbase/oceanbase.env | 1 +
.../docker-compose/oceanbase/oceanbase.yaml.tpl | 6 +-
docker/thirdparties/docker-health.sh | 81 +
docker/thirdparties/run-thirdparties-docker.sh | 1374 +++++--
...irdparties-docker-hive-bootstrap-groups-test.sh | 64 +
docs/file-scanner-v2-code-review-guide.md | 150 +-
docs/file-scanner-v2-design.md | 17 +
docs/file-scanner-v2-parquet-scan-design.md | 445 ++-
.../org/apache/doris/jdbc/BaseJdbcExecutor.java | 18 +-
.../apache/doris/jdbc/BaseJdbcExecutorTest.java | 89 +
.../main/java/org/apache/doris/common/Config.java | 2 +-
.../java/org/apache/doris/catalog/SchemaTable.java | 1 +
.../transaction/CloudGlobalTransactionMgr.java | 6 +-
.../apache/doris/cloud/transaction/TxnUtil.java | 3 +
.../doris/common/profile/SummaryProfile.java | 96 +-
.../org/apache/doris/datasource/ExternalUtil.java | 45 +-
.../apache/doris/datasource/FileQueryScanNode.java | 63 +-
.../org/apache/doris/datasource/FileScanNode.java | 17 +
.../doris/datasource/hive/HMSExternalTable.java | 28 +-
.../doris/datasource/hive/source/HiveScanNode.java | 88 +-
.../apache/doris/datasource/hudi/HudiUtils.java | 77 +-
.../doris/datasource/hudi/source/HudiScanNode.java | 167 +-
.../iceberg/IcebergExternalMetaCache.java | 3 +-
.../datasource/iceberg/IcebergExternalTable.java | 13 -
.../datasource/iceberg/IcebergMetadataOps.java | 8 +-
.../iceberg/IcebergSnapshotCacheValue.java | 24 +
.../doris/datasource/iceberg/IcebergUtils.java | 156 +-
.../iceberg/helper/IcebergWriterHelper.java | 117 +-
.../iceberg/source/IcebergApiSource.java | 25 +-
.../iceberg/source/IcebergDeleteFileFilter.java | 32 +-
.../iceberg/source/IcebergHMSSource.java | 10 +-
.../datasource/iceberg/source/IcebergScanNode.java | 493 ++-
.../datasource/iceberg/source/IcebergSplit.java | 20 +
.../jdbc/client/JdbcClickHouseClient.java | 23 +-
.../apache/doris/datasource/paimon/PaimonUtil.java | 48 +-
.../datasource/paimon/source/PaimonScanNode.java | 54 +-
.../doris/datasource/systable/IcebergSysTable.java | 15 +-
.../doris/datasource/tvf/source/TVFScanNode.java | 5 +-
.../org/apache/doris/httpv2/rest/LoadAction.java | 7 +-
.../apache/doris/job/common/DataSourceType.java | 3 +-
.../streaming/DataSourceConfigValidator.java | 79 +-
.../insert/streaming/StreamingInsertJob.java | 36 +-
.../streaming/StreamingJdbcUrlNormalizer.java | 84 +
.../job/offset/jdbc/JdbcSourceOffsetProvider.java | 58 +-
.../offset/jdbc/JdbcTvfSourceOffsetProvider.java | 18 +-
.../apache/doris/job/util/StreamingJobUtils.java | 15 +-
.../org/apache/doris/load/StreamLoadHandler.java | 12 +-
.../routineload/RLTaskTxnCommitAttachment.java | 15 +
.../doris/load/routineload/RoutineLoadJob.java | 35 +-
.../glue/translator/PhysicalPlanTranslator.java | 9 +
.../glue/translator/PlanTranslatorContext.java | 10 +
.../rules/implementation/AggregateStrategies.java | 54 +-
.../plans/commands/ShowRoutineLoadCommand.java | 1 +
.../trees/plans/commands/info/CreateTableInfo.java | 36 +
.../plans/physical/PhysicalLazyMaterialize.java | 2 +-
.../physical/PhysicalStorageLayerAggregate.java | 27 +-
.../org/apache/doris/planner/IcebergMergeSink.java | 1 +
.../org/apache/doris/planner/IcebergTableSink.java | 1 +
.../java/org/apache/doris/planner/PlanNode.java | 8 +
.../apache/doris/service/FrontendServiceImpl.java | 439 ++-
.../arrowflight/DorisFlightSqlProducer.java | 16 +-
.../arrowflight/results/FlightSqlChannel.java | 6 +
.../doris/statistics/util/StatisticsUtil.java | 14 +-
.../CdcStreamTableValuedFunction.java | 10 +-
.../cloud/CacheHotspotManagerTableFilterTest.java | 10 +-
.../transaction/CloudGlobalTransactionMgrTest.java | 52 +
.../doris/common/profile/AutoProfileTest.java | 9 +-
.../doris/common/profile/SummaryProfileTest.java | 24 +
.../apache/doris/datasource/ExternalUtilTest.java | 67 +
.../doris/datasource/FileQueryScanNodeTest.java | 76 +-
.../iceberg/IcebergDDLAndDMLPlanTest.java | 76 +
.../datasource/iceberg/IcebergMetadataOpTest.java | 55 +
.../doris/datasource/iceberg/IcebergUtilsTest.java | 56 +
.../iceberg/helper/IcebergWriterHelperTest.java | 252 ++
.../source/IcebergDeleteFileFilterTest.java | 48 +
.../iceberg/source/IcebergScanNodeTest.java | 483 ++-
.../jdbc/client/JdbcClickHouseClientTest.java | 25 +
.../doris/datasource/paimon/PaimonUtilTest.java | 123 +
.../paimon/source/PaimonScanNodeTest.java | 58 +
.../systable/IcebergSysTableResolverTest.java | 15 +-
.../datasource/tvf/source/TVFScanNodeTest.java | 56 +
.../apache/doris/httpv2/rest/LoadActionTest.java | 31 +
.../streaming/DataSourceConfigValidatorTest.java | 188 +
.../streaming/StreamingJdbcUrlNormalizerTest.java | 88 +
.../jdbc/JdbcSourceOffsetProviderOffsetTest.java | 139 +
.../jdbc/JdbcTvfSourceOffsetProviderTest.java | 46 +
.../doris/job/util/StreamingJobUtilsTest.java | 13 +
.../doris/journal/bdbje/BDBEnvironmentTest.java | 68 +-
.../apache/doris/load/StreamLoadHandlerTest.java | 102 +
.../doris/load/routineload/RoutineLoadJobTest.java | 39 +
.../postprocess/TopnLazyMaterializeTest.java | 26 +
.../rewrite/PhysicalStorageLayerAggregateTest.java | 105 +-
.../plans/commands/ShowRoutineLoadCommandTest.java | 2 +
.../apache/doris/planner/IcebergMergeSinkTest.java | 71 +-
.../doris/service/FrontendServiceImplTest.java | 49 +
.../arrowflight/DorisFlightSqlProducerTest.java | 145 +
.../doris/statistics/util/StatisticsUtilTest.java | 72 +
.../CdcStreamTableValuedFunctionTest.java | 15 +
.../mysql/MySqlStreamingChangeEventSource.java | 92 +-
.../doris/cdcclient/source/factory/DataSource.java | 3 +-
.../source/factory/SourceReaderFactory.java | 2 +
.../source/reader/JdbcIncrementalSourceReader.java | 2 +-
.../source/reader/mysql/MySqlSourceReader.java | 19 +-
.../source/reader/mysql/MySqlYearConverter.java | 70 +
.../reader/oceanbase/OceanBaseSourceReader.java | 19 +-
.../mysql/MySqlStreamingChangeEventSourceTest.java | 48 +
.../cdcclient/itcase/CdcClientWriteHarness.java | 53 +-
.../itcase/OceanBaseSchemaChangeITCase.java | 121 +
.../itcase/OceanBaseStartupOffsetITCase.java | 148 +
.../doris/cdcclient/itcase/OceanBaseTestBase.java | 150 +
.../cdcclient/itcase/OceanBaseWriteDmlITCase.java | 112 +
.../source/factory/SourceReaderFactoryTest.java | 9 +
.../source/reader/mysql/MySqlSourceReaderTest.java | 133 +-
.../reader/mysql/MySqlYearConverterTest.java | 75 +
.../reader/postgres/PostgresSourceReaderTest.java | 74 +
gensrc/proto/cloud.proto | 2 +
gensrc/thrift/DataSinks.thrift | 4 +
gensrc/thrift/ExternalTableSchema.thrift | 5 +-
gensrc/thrift/FrontendService.thrift | 2 +
gensrc/thrift/PlanNodes.thrift | 26 +
regression-test/conf/regression-conf.groovy | 3 +-
.../multi_cluster/stream_load/stream_load.out | 5 +
.../hive/test_hive_orc_predicate.out | 6 -
.../hive/test_transactional_hive.out | 163 -
.../iceberg/test_iceberg_mixed_file_formats.out | 12 +
.../test_iceberg_position_deletes_sys_table.out} | 12 +-
.../jdbc/test_clickhouse_jdbc_v2.out | 9 +
.../tvf/file_scanner_v2_empty.csv | 0
.../tvf/file_scanner_v2_struct_0_bigint.parquet | Bin 0 -> 965 bytes
.../tvf/file_scanner_v2_struct_1_int.parquet | Bin 0 -> 923 bytes
.../tvf/file_scanner_v2_unsupported_time.parquet | Bin 0 -> 673 bytes
.../tvf/test_file_scanner_v2_review_fixes.out | 17 +
.../tvf/test_hdfs_parquet_group6.out | 16 +-
.../es/test_es_flatten_type.out | 0
.../es/test_es_keyword_array_type.out | 0
.../es/test_es_query.out | 0
.../es/test_es_query_nereids.out | 0
.../es/test_es_query_no_http_url.out | 0
.../hive/test_hive_translation_insert_only.out | 30 -
.../jdbc/test_db2_jdbc_catalog.out | 0
.../jdbc/test_oceanbase_jdbc_catalog.out | 0
.../jdbc/test_sqlserver_jdbc_catalog.out | 0
.../select/test_sqlserver_all_types_select.out | 0
.../trino_connector/jdbc/test_trino_sqlserver.out | 0
.../cdc/test_streaming_mysql_job_all_type.out | 9 +-
.../test_streaming_mysql_job_integer_boundary.out | 33 +-
...ming_mysql_job_snapshot_with_concurrent_dml.out | 23 +
.../cdc/test_streaming_oceanbase_job.out | 17 +
.../cdc/test_streaming_oceanbase_job_all_type.out | 8 +
.../cdc/test_streaming_oceanbase_job_offset.out | 11 +
.../test_streaming_oceanbase_job_restart_fe.out} | 16 +-
.../test_streaming_oceanbase_job_sc_restart_fe.out | 11 +
.../test_streaming_oceanbase_job_schema_change.out | 9 +
.../cdc/tvf/test_cdc_stream_tvf_mysql.out | 13 +-
...ing_job_cdc_stream_mysql_jdbc_type_defaults.out | 14 +
.../data/{mtmv_p0 => mtmv_p2}/test_es_mtmv.out | 0
.../nereids_syntax_p1/mv/aggregate/agg_sync_mv.out | 2 +-
.../test_topn_lazy_materialize_sparse_variant.out | 17 +
regression-test/framework/pom.xml | 2 +-
.../org/apache/doris/regression/suite/Suite.groovy | 34 +-
.../regression/suite/SuiteBoundaryWaitTest.groovy | 56 +
regression-test/java-udf-src/pom.xml | 7 +-
.../pipeline/common/get-hive-bootstrap-groups.sh | 26 +-
regression-test/pipeline/common/github-utils.sh | 31 +
regression-test/pipeline/common/stage-timer.sh | 129 +
.../pipeline/common/test_stage_timer.py | 149 +
.../pipeline/external/conf/regression-conf.groovy | 1 +
.../pipeline/external/external-stage-timer.sh | 119 +
.../multi_cluster/stream_load/stream_load.groovy | 103 +
.../suites/demo_p0/test_flight_record.groovy | 19 +-
.../suites/doc/external/jdbc/ibmdb2.md.groovy | 2 +-
.../suites/doc/external/jdbc/oceanbase.md.groovy | 4 +-
.../suites/doc/external/jdbc/sqlserver.md.groovy | 2 +-
.../export_p2/test_export_with_parallelism.groovy | 11 +-
.../hive/test_hive_orc_predicate.groovy | 53 +-
.../hive/test_hive_topn_lazy_mat.groovy | 9 +
.../hive/test_hive_topn_rf_null.groovy | 2 +-
.../hive/test_orc_lazy_mat_profile.groovy | 32 +-
.../hive/test_transactional_hive.groovy | 195 -
.../iceberg/test_iceberg_mixed_file_formats.groovy | 56 +
.../test_iceberg_position_deletes_sys_table.groovy | 659 ++++
.../iceberg/test_iceberg_sys_table.groovy | 27 +-
.../test_information_schema_timezone.groovy | 3 +
.../jdbc/test_clickhouse_jdbc_v2.groovy | 43 +
.../jdbc/test_jdbc_row_count.groovy | 54 -
.../test_iceberg_hadoop_catalog_kerberos.groovy | 6 +-
.../kerberos/test_non_catalog_kerberos.groovy | 23 +-
.../kerberos/test_single_hive_kerberos.groovy | 99 +-
.../kerberos/test_two_hive_kerberos.groovy | 34 +
.../refactor_storage_param/hdfs_all_test.groovy | 5 +-
.../tvf/test_file_scanner_v2_review_fixes.groovy | 113 +
.../external_table_p0/tvf/test_http_tvf.groovy | 8 +-
.../es/test_es_catalog_http_open_api.groovy | 2 +-
.../es/test_es_flatten_type.groovy | 2 +-
.../es/test_es_keyword_array_type.groovy | 2 +-
.../es/test_es_query.groovy | 2 +-
.../es/test_es_query_nereids.groovy | 2 +-
.../es/test_es_query_no_http_url.groovy | 2 +-
.../hive/test_hive_translation_insert_only.groovy | 98 -
.../hive/test_parquet_complex_cross_page.groovy | 55 -
.../jdbc/test_db2_jdbc_catalog.groovy | 2 +-
.../jdbc/test_oceanbase_jdbc_catalog.groovy | 6 +-
.../jdbc/test_sqlserver_jdbc_catalog.groovy | 2 +-
.../jdbc/test_sqlserver_jdbc_row_count.groovy} | 59 +-
.../select/test_sqlserver_all_types_select.groovy | 2 +-
.../paimon/test_paimon_hms_catalog.groovy | 7 +-
.../hive_on_hms_and_dlf.groovy | 14 +-
.../iceberg_on_hms_and_filesystem_and_dlf.groovy | 21 +-
.../jdbc/test_trino_sqlserver.groovy | 2 +-
.../test_group_commit_wal_num_backpressure.groovy | 99 +
.../test_mow_table_with_format_v2.groovy | 4 +-
.../suites/inverted_index_p2/test_show_data.groovy | 22 +-
.../cdc/test_streaming_mysql_job_all_type.groovy | 4 +-
..._streaming_mysql_job_charset_and_strings.groovy | 6 +-
.../test_streaming_mysql_job_create_alter.groovy | 37 +-
...est_streaming_mysql_job_integer_boundary.groovy | 41 +-
...g_mysql_job_snapshot_with_concurrent_dml.groovy | 95 +-
.../test_streaming_mysql_job_special_offset.groovy | 11 +-
.../cdc/test_streaming_oceanbase_job.groovy | 143 +
.../test_streaming_oceanbase_job_all_type.groovy | 152 +
.../cdc/test_streaming_oceanbase_job_offset.groovy | 203 +
.../test_streaming_oceanbase_job_restart_fe.groovy | 150 +
...st_streaming_oceanbase_job_sc_restart_fe.groovy | 156 +
...st_streaming_oceanbase_job_schema_change.groovy | 138 +
...snapshot_with_concurrent_dml_multi_table.groovy | 71 +-
.../cdc/tvf/test_cdc_stream_tvf_mysql.groovy | 11 +-
..._job_cdc_stream_mysql_jdbc_type_defaults.groovy | 126 +
...ob_cdc_stream_postgres_latest_alter_cred.groovy | 11 +-
.../test_routine_load_first_error_msg.groovy | 127 +
.../{mtmv_p0 => mtmv_p2}/test_es_mtmv.groovy | 5 +-
.../suites/query_p0/join/test_join5.groovy | 2 +
.../query_p0/system/test_query_sys_rowsets.groovy | 12 +-
.../system/test_query_sys_scan_rowsets.groovy | 7 +-
.../suites/query_profile/profile_size_limit.groovy | 45 +-
...est_topn_lazy_materialize_sparse_variant.groovy | 85 +
run-regression-test.sh | 91 +-
.../brpc-1.4.0-secondary-package-name.patch | 12 +-
790 files changed, 54914 insertions(+), 20216 deletions(-)
create mode 100644 be/benchmark/benchmark_arrow_validation.hpp
create mode 100644 be/benchmark/parquet/AGENTS.md
create mode 100644 be/benchmark/parquet/README.md
create mode 100644 be/benchmark/parquet/benchmark_parquet_decoder.hpp
create mode 100644 be/benchmark/parquet/benchmark_parquet_reader.hpp
create mode 100644 be/benchmark/parquet/parquet_benchmark_scenarios.h
create mode 100644 be/src/core/data_type_serde/arrow_validation.h
create mode 100644 be/src/core/data_type_serde/parquet_decode_source.h
create mode 100644 be/src/core/data_type_serde/parquet_timestamp.h
copy be/src/exprs/{vruntimefilter_wrapper.cpp => runtime_filter_expr.cpp} (77%)
copy be/src/exprs/{vruntimefilter_wrapper.h => runtime_filter_expr.h} (87%)
copy be/src/{format_v2/delimited_text => format}/hive_text_util.h (100%)
rename be/src/{format_v2 => format}/jni/jni_data_bridge.cpp (100%)
rename be/src/{format_v2 => format}/jni/jni_data_bridge.h (100%)
rename be/src/{format_v2 => format/table}/deletion_vector.h (68%)
create mode 100644
be/src/format/table/iceberg_position_delete_sys_table_reader.cpp
create mode 100644
be/src/format/table/iceberg_position_delete_sys_table_reader.h
copy be/src/{format_v2/delimited_text/hive_text_util.h =>
format/table/iceberg_scan_semantics.h} (61%)
delete mode 100644 be/src/format_v2/deletion_vector_reader.cpp
delete mode 100644 be/src/format_v2/deletion_vector_reader.h
create mode 100644 be/src/format_v2/parquet/native_schema_desc.cpp
create mode 100644 be/src/format_v2/parquet/native_schema_desc.h
create mode 100644 be/src/format_v2/parquet/native_schema_node.cpp
create mode 100644 be/src/format_v2/parquet/native_schema_node.h
create mode 100644 be/src/format_v2/parquet/reader/count_column_reader.cpp
create mode 100644 be/src/format_v2/parquet/reader/count_column_reader.h
delete mode 100644 be/src/format_v2/parquet/reader/list_column_reader.cpp
delete mode 100644 be/src/format_v2/parquet/reader/list_column_reader.h
delete mode 100644 be/src/format_v2/parquet/reader/map_column_reader.cpp
delete mode 100644 be/src/format_v2/parquet/reader/map_column_reader.h
create mode 100644
be/src/format_v2/parquet/reader/native/block_split_bloom_filter.cpp
create mode 100644
be/src/format_v2/parquet/reader/native/block_split_bloom_filter.h
create mode 100644
be/src/format_v2/parquet/reader/native/bool_plain_decoder.cpp
create mode 100644 be/src/format_v2/parquet/reader/native/bool_plain_decoder.h
create mode 100644 be/src/format_v2/parquet/reader/native/bool_rle_decoder.cpp
create mode 100644 be/src/format_v2/parquet/reader/native/bool_rle_decoder.h
create mode 100644
be/src/format_v2/parquet/reader/native/byte_array_dict_decoder.cpp
create mode 100644
be/src/format_v2/parquet/reader/native/byte_array_dict_decoder.h
create mode 100644
be/src/format_v2/parquet/reader/native/byte_array_plain_decoder.cpp
create mode 100644
be/src/format_v2/parquet/reader/native/byte_array_plain_decoder.h
create mode 100644
be/src/format_v2/parquet/reader/native/byte_stream_split_decoder.cpp
create mode 100644
be/src/format_v2/parquet/reader/native/byte_stream_split_decoder.h
create mode 100644
be/src/format_v2/parquet/reader/native/column_chunk_reader.cpp
create mode 100644 be/src/format_v2/parquet/reader/native/column_chunk_reader.h
create mode 100644 be/src/format_v2/parquet/reader/native/column_reader.cpp
create mode 100644 be/src/format_v2/parquet/reader/native/column_reader.h
create mode 100644 be/src/format_v2/parquet/reader/native/common.cpp
create mode 100644 be/src/format_v2/parquet/reader/native/common.h
create mode 100644 be/src/format_v2/parquet/reader/native/decoder.cpp
create mode 100644 be/src/format_v2/parquet/reader/native/decoder.h
create mode 100644
be/src/format_v2/parquet/reader/native/delta_bit_pack_decoder.cpp
create mode 100644
be/src/format_v2/parquet/reader/native/delta_bit_pack_decoder.h
create mode 100644
be/src/format_v2/parquet/reader/native/fix_length_dict_decoder.hpp
create mode 100644
be/src/format_v2/parquet/reader/native/fix_length_plain_decoder.cpp
create mode 100644
be/src/format_v2/parquet/reader/native/fix_length_plain_decoder.h
create mode 100644 be/src/format_v2/parquet/reader/native/level_decoder.cpp
create mode 100644 be/src/format_v2/parquet/reader/native/level_decoder.h
create mode 100644 be/src/format_v2/parquet/reader/native/level_reader.cpp
create mode 100644 be/src/format_v2/parquet/reader/native/level_reader.h
create mode 100644 be/src/format_v2/parquet/reader/native/page_reader.cpp
create mode 100644 be/src/format_v2/parquet/reader/native/page_reader.h
create mode 100644 be/src/format_v2/parquet/reader/native_column_reader.cpp
create mode 100644 be/src/format_v2/parquet/reader/native_column_reader.h
delete mode 100644
be/src/format_v2/parquet/reader/nested_column_materializer.cpp
delete mode 100644 be/src/format_v2/parquet/reader/nested_column_materializer.h
delete mode 100644 be/src/format_v2/parquet/reader/parquet_leaf_reader.cpp
delete mode 100644 be/src/format_v2/parquet/reader/parquet_leaf_reader.h
delete mode 100644 be/src/format_v2/parquet/reader/scalar_column_reader.cpp
delete mode 100644 be/src/format_v2/parquet/reader/scalar_column_reader.h
delete mode 100644 be/src/format_v2/parquet/reader/struct_column_reader.cpp
delete mode 100644 be/src/format_v2/parquet/reader/struct_column_reader.h
create mode 100644
be/src/format_v2/table/iceberg_position_delete_sys_table_reader.cpp
create mode 100644
be/src/format_v2/table/iceberg_position_delete_sys_table_reader.h
create mode 100644 be/src/format_v2/table/iceberg_schema_utils.h
create mode 100644 be/src/runtime/file_scan_profile.h
create mode 100644 be/src/util/jdbc_utils.cpp
copy be/src/{exec/scan/access_path_parser.h => util/jdbc_utils.h} (52%)
create mode 100644
be/test/core/data_type_serde/data_type_serde_arrow_validation_test.cpp
create mode 100644
be/test/core/data_type_serde/data_type_serde_parquet_test.cpp
create mode 100644
be/test/exec/sink/writer/iceberg/iceberg_partition_writer_test.cpp
create mode 100644
be/test/format/table/iceberg/iceberg_position_delete_sys_table_reader_test.cpp
create mode 100644 be/test/format/transformer/vorc_transformer_test.cpp
create mode 100644 be/test/format_v2/jni/jdbc_reader_test.cpp
create mode 100644 be/test/format_v2/parquet/native_decoder_test.cpp
create mode 100644
be/test/format_v2/parquet/parquet_benchmark_scenarios_test.cpp
delete mode 100644 be/test/format_v2/parquet/parquet_column_reader_test.cpp
delete mode 100644 be/test/format_v2/parquet/parquet_leaf_reader_test.cpp
delete mode 100644 be/test/format_v2/parquet/parquet_serde_reader_test.cpp
create mode 100644
be/test/format_v2/table/iceberg_position_delete_sys_table_reader_test.cpp
create mode 100644 docker/thirdparties/docker-compose/hive/README.md
create mode 100644 docker/thirdparties/docker-compose/hive/README_ZH.md
create mode 100755 docker/thirdparties/docker-compose/hive/scripts/bin/hadoop
create mode 100755 docker/thirdparties/docker-compose/hive/scripts/bin/hive
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/bootstrap/bootstrap-groups.sh
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/bootstrap/hive2_only.preinstalled_hql.list
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/bootstrap/hive2_only.run_sh.list
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/bootstrap/hive3_only.download_dir.list
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/bootstrap/hive3_only.run_sh.list
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/create_preinstalled_scripts/employees.csv
delete mode 100755
docker/thirdparties/docker-compose/hive/scripts/create_preinstalled_scripts/run25.hql
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/hive-common-lib.sh
delete mode 100755
docker/thirdparties/docker-compose/hive/scripts/hive-metastore.sh
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/hive-module-lib.sh
rename
docker/thirdparties/docker-compose/{kerberos/health-checks/supervisorctl-check.sh
=> hive/scripts/init-hive-baseline.sh} (61%)
mode change 100755 => 100644
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/refresh-hive-modules.sh
copy
docker/thirdparties/docker-compose/{kerberos/health-checks/hive-health-check-2.sh
=> hive/scripts/reset-hive-state.sh} (78%)
mode change 100755 => 100644
create mode 100755
docker/thirdparties/docker-compose/hive/scripts/snapshot-hive-baseline.sh
rename
docker/thirdparties/docker-compose/{kerberos/health-checks/hive-health-check.sh
=> hive/scripts/start-hive-metastore.sh} (78%)
mode change 100755 => 100644
copy docker/thirdparties/docker-compose/hive/scripts/{healthy_check.sh =>
start-hive-server.sh} (83%)
mode change 100755 => 100644
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/create_preinstalled_scripts/iceberg/run31.sql
create mode 100644 docker/thirdparties/docker-compose/kerberos/.gitignore
rename
docker/thirdparties/docker-compose/kerberos/{conf/kerberos1/krb5.conf.tpl =>
Dockerfile} (61%)
delete mode 100755
docker/thirdparties/docker-compose/kerberos/common/hadoop/apply-config-overrides.sh
delete mode 100755
docker/thirdparties/docker-compose/kerberos/common/hadoop/hadoop-run.sh
rename
docker/thirdparties/docker-compose/kerberos/{two-kerberos-hives/auth-to-local.xml
=> conf/core-site.xml.tpl} (58%)
mode change 100755 => 100644
create mode 100644
docker/thirdparties/docker-compose/kerberos/conf/hdfs-site.xml.tpl
create mode 100644
docker/thirdparties/docker-compose/kerberos/conf/hive-site.xml.tpl
copy docker/thirdparties/docker-compose/{oceanbase/oceanbase.env =>
kerberos/conf/kdc.conf.tpl} (74%)
delete mode 100644
docker/thirdparties/docker-compose/kerberos/conf/kerberos1/kdc.conf.tpl
delete mode 100644
docker/thirdparties/docker-compose/kerberos/conf/kerberos2/kdc.conf.tpl
rename docker/thirdparties/docker-compose/kerberos/conf/{kerberos2 =>
}/krb5.conf.tpl (81%)
delete mode 100644 docker/thirdparties/docker-compose/kerberos/conf/my.cnf.tpl
mode change 100755 => 100644
docker/thirdparties/docker-compose/kerberos/entrypoint-hive-master.sh
delete mode 100644
docker/thirdparties/docker-compose/kerberos/sql/create_kerberos_hive_table.sql
delete mode 100644
docker/thirdparties/docker-compose/kerberos/sql/create_paimon_hive_table.hql
delete mode 100755
docker/thirdparties/docker-compose/kerberos/two-kerberos-hives/hive2-default-fs-site.xml
create mode 100644 docker/thirdparties/docker-health.sh
create mode 100644
docker/thirdparties/test/run-thirdparties-docker-hive-bootstrap-groups-test.sh
create mode 100644
fe/be-java-extensions/jdbc-scanner/src/test/java/org/apache/doris/jdbc/BaseJdbcExecutorTest.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/job/extensions/insert/streaming/StreamingJdbcUrlNormalizer.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/iceberg/source/IcebergDeleteFileFilterTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/job/extensions/insert/streaming/StreamingJdbcUrlNormalizerTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/job/offset/jdbc/JdbcSourceOffsetProviderOffsetTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/job/offset/jdbc/JdbcTvfSourceOffsetProviderTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/service/arrowflight/DorisFlightSqlProducerTest.java
create mode 100644
fs_brokers/cdc_client/src/main/java/org/apache/doris/cdcclient/source/reader/mysql/MySqlYearConverter.java
rename be/src/format_v2/delimited_text/hive_text_util.h =>
fs_brokers/cdc_client/src/main/java/org/apache/doris/cdcclient/source/reader/oceanbase/OceanBaseSourceReader.java
(63%)
create mode 100644
fs_brokers/cdc_client/src/test/java/io/debezium/connector/mysql/MySqlStreamingChangeEventSourceTest.java
create mode 100644
fs_brokers/cdc_client/src/test/java/org/apache/doris/cdcclient/itcase/OceanBaseSchemaChangeITCase.java
create mode 100644
fs_brokers/cdc_client/src/test/java/org/apache/doris/cdcclient/itcase/OceanBaseStartupOffsetITCase.java
create mode 100644
fs_brokers/cdc_client/src/test/java/org/apache/doris/cdcclient/itcase/OceanBaseTestBase.java
create mode 100644
fs_brokers/cdc_client/src/test/java/org/apache/doris/cdcclient/itcase/OceanBaseWriteDmlITCase.java
create mode 100644
fs_brokers/cdc_client/src/test/java/org/apache/doris/cdcclient/source/reader/mysql/MySqlYearConverterTest.java
delete mode 100644
regression-test/data/external_table_p0/hive/test_transactional_hive.out
create mode 100644
regression-test/data/external_table_p0/iceberg/test_iceberg_mixed_file_formats.out
rename
regression-test/data/{external_table_p2/hive/test_parquet_complex_cross_page.out
=> external_table_p0/iceberg/test_iceberg_position_deletes_sys_table.out} (69%)
create mode 100644
regression-test/data/external_table_p0/jdbc/test_clickhouse_jdbc_v2.out
copy be/src/pch/pch.cc =>
regression-test/data/external_table_p0/tvf/file_scanner_v2_empty.csv (100%)
create mode 100644
regression-test/data/external_table_p0/tvf/file_scanner_v2_struct_0_bigint.parquet
create mode 100644
regression-test/data/external_table_p0/tvf/file_scanner_v2_struct_1_int.parquet
create mode 100644
regression-test/data/external_table_p0/tvf/file_scanner_v2_unsupported_time.parquet
create mode 100644
regression-test/data/external_table_p0/tvf/test_file_scanner_v2_review_fixes.out
rename regression-test/data/{external_table_p0 =>
external_table_p2}/es/test_es_flatten_type.out (100%)
rename regression-test/data/{external_table_p0 =>
external_table_p2}/es/test_es_keyword_array_type.out (100%)
rename regression-test/data/{external_table_p0 =>
external_table_p2}/es/test_es_query.out (100%)
rename regression-test/data/{external_table_p0 =>
external_table_p2}/es/test_es_query_nereids.out (100%)
rename regression-test/data/{external_table_p0 =>
external_table_p2}/es/test_es_query_no_http_url.out (100%)
delete mode 100644
regression-test/data/external_table_p2/hive/test_hive_translation_insert_only.out
rename regression-test/data/{external_table_p0 =>
external_table_p2}/jdbc/test_db2_jdbc_catalog.out (100%)
rename regression-test/data/{external_table_p0 =>
external_table_p2}/jdbc/test_oceanbase_jdbc_catalog.out (100%)
rename regression-test/data/{external_table_p0 =>
external_table_p2}/jdbc/test_sqlserver_jdbc_catalog.out (100%)
rename regression-test/data/{external_table_p0 =>
external_table_p2}/jdbc/type_test/select/test_sqlserver_all_types_select.out
(100%)
rename regression-test/data/{external_table_p0 =>
external_table_p2}/trino_connector/jdbc/test_trino_sqlserver.out (100%)
create mode 100644
regression-test/data/job_p0/streaming_job/cdc/test_streaming_oceanbase_job.out
create mode 100644
regression-test/data/job_p0/streaming_job/cdc/test_streaming_oceanbase_job_all_type.out
create mode 100644
regression-test/data/job_p0/streaming_job/cdc/test_streaming_oceanbase_job_offset.out
copy regression-test/data/{cloud_p0/multi_cluster/stream_load/stream_load.out
=> job_p0/streaming_job/cdc/test_streaming_oceanbase_job_restart_fe.out} (54%)
create mode 100644
regression-test/data/job_p0/streaming_job/cdc/test_streaming_oceanbase_job_sc_restart_fe.out
create mode 100644
regression-test/data/job_p0/streaming_job/cdc/test_streaming_oceanbase_job_schema_change.out
create mode 100644
regression-test/data/job_p0/streaming_job/cdc/tvf/test_streaming_job_cdc_stream_mysql_jdbc_type_defaults.out
rename regression-test/data/{mtmv_p0 => mtmv_p2}/test_es_mtmv.out (100%)
create mode 100644
regression-test/data/variant_p0/test_topn_lazy_materialize_sparse_variant.out
create mode 100644
regression-test/framework/src/test/groovy/org/apache/doris/regression/suite/SuiteBoundaryWaitTest.groovy
rename
docker/thirdparties/docker-compose/kerberos/health-checks/hive-health-check-2.sh
=> regression-test/pipeline/common/get-hive-bootstrap-groups.sh (73%)
create mode 100644 regression-test/pipeline/common/stage-timer.sh
create mode 100644 regression-test/pipeline/common/test_stage_timer.py
create mode 100644 regression-test/pipeline/external/external-stage-timer.sh
delete mode 100644
regression-test/suites/external_table_p0/hive/test_transactional_hive.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/test_iceberg_mixed_file_formats.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/test_iceberg_position_deletes_sys_table.groovy
create mode 100644
regression-test/suites/external_table_p0/jdbc/test_clickhouse_jdbc_v2.groovy
create mode 100644
regression-test/suites/external_table_p0/tvf/test_file_scanner_v2_review_fixes.groovy
rename regression-test/suites/{external_table_p0 =>
external_table_p2}/es/test_es_catalog_http_open_api.groovy (97%)
rename regression-test/suites/{external_table_p0 =>
external_table_p2}/es/test_es_flatten_type.groovy (96%)
rename regression-test/suites/{external_table_p0 =>
external_table_p2}/es/test_es_keyword_array_type.groovy (98%)
rename regression-test/suites/{external_table_p0 =>
external_table_p2}/es/test_es_query.groovy (99%)
rename regression-test/suites/{external_table_p0 =>
external_table_p2}/es/test_es_query_nereids.groovy (99%)
rename regression-test/suites/{external_table_p0 =>
external_table_p2}/es/test_es_query_no_http_url.groovy (98%)
delete mode 100644
regression-test/suites/external_table_p2/hive/test_hive_translation_insert_only.groovy
delete mode 100644
regression-test/suites/external_table_p2/hive/test_parquet_complex_cross_page.groovy
rename regression-test/suites/{external_table_p0 =>
external_table_p2}/jdbc/test_db2_jdbc_catalog.groovy (99%)
rename regression-test/suites/{external_table_p0 =>
external_table_p2}/jdbc/test_oceanbase_jdbc_catalog.groovy (91%)
rename regression-test/suites/{external_table_p0 =>
external_table_p2}/jdbc/test_sqlserver_jdbc_catalog.groovy (98%)
copy
regression-test/suites/{external_table_p0/jdbc/type_test/select/test_sqlserver_all_types_select.groovy
=> external_table_p2/jdbc/test_sqlserver_jdbc_row_count.groovy} (55%)
rename regression-test/suites/{external_table_p0 =>
external_table_p2}/jdbc/type_test/select/test_sqlserver_all_types_select.groovy
(96%)
rename regression-test/suites/{external_table_p0 =>
external_table_p2}/trino_connector/jdbc/test_trino_sqlserver.groovy (96%)
create mode 100644
regression-test/suites/insert_p0/group_commit/test_group_commit_wal_num_backpressure.groovy
create mode 100644
regression-test/suites/job_p0/streaming_job/cdc/test_streaming_oceanbase_job.groovy
create mode 100644
regression-test/suites/job_p0/streaming_job/cdc/test_streaming_oceanbase_job_all_type.groovy
create mode 100644
regression-test/suites/job_p0/streaming_job/cdc/test_streaming_oceanbase_job_offset.groovy
create mode 100644
regression-test/suites/job_p0/streaming_job/cdc/test_streaming_oceanbase_job_restart_fe.groovy
create mode 100644
regression-test/suites/job_p0/streaming_job/cdc/test_streaming_oceanbase_job_sc_restart_fe.groovy
create mode 100644
regression-test/suites/job_p0/streaming_job/cdc/test_streaming_oceanbase_job_schema_change.groovy
create mode 100644
regression-test/suites/job_p0/streaming_job/cdc/tvf/test_streaming_job_cdc_stream_mysql_jdbc_type_defaults.groovy
create mode 100644
regression-test/suites/load_p0/routine_load/test_routine_load_first_error_msg.groovy
rename regression-test/suites/{mtmv_p0 => mtmv_p2}/test_es_mtmv.groovy (95%)
create mode 100644
regression-test/suites/variant_p0/test_topn_lazy_materialize_sparse_variant.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
