This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch array-type in repository https://gitbox.apache.org/repos/asf/incubator-doris.git.
omit 04ad3d2 [feature-wip][array-type] Support ArrayLiteral in SQL. (#8089) omit ac6048a [feature-wip](array-type) Create table with nested array type. (#8003) add 246ac4e [fix] fix a bug of encryption function with iv may return wrong result (#8277) add 114eb19 [fix](ut) query stmt test error (#8303) add 09bfb8b [fix] (rpc-udf) Fixed the problem that the query could not be interrupted (#8248) add 18098c5 [fix](fe-ut) Fix FE unit test (#8293) add 8be71b6 [refactor] remove pusher.cpp and related mock test code (#8288) add f622ce0 [refactor] remove types_test (#8289) add f5ab055 [chore] remove some ut temp files and add some file to .gitignore (#8309) add c56a372 [improvement][fix](grouping-set)(tablet-repair) optimize compaction too slow replica process, (#8123) add e7c4175 [fix] fix hash table insert() may be failed but not handle this error (#8207) add 80e8815 [improvement](restore) allow query on part of partitions when others are in RESTORE (#8245) add 538df28 [improvement](routine-load) Support routine load task succeed with empty data consumed (#8256) add 0ee53be [fix][improvement](runtime-filter) fix string type length limit error && add runtime filter decimal support (#8282) add 46ca23f [Feature] Support Changing the bucketing mode of the table from Hash Distribution to Random Distribution (#8259) add 0383001 [Enhancement] Support Skipping compaction lower replica where select queryable replica for better scan performance (#8146) add 450273c [typo]update spark build doc (#8333) add 777c9a4 [typo](comment) Translate the code comments of gensrc (#8308) add 61455ec [docs] fix invalid links in docker-dev document (#8313) add 11c9c4f [improvement][website] The expansion of sidebar is off by default (#8314) add 9cf2798 [typo] fix error for PushTask (#8316) add 9961b2c [refactor] Remove mysql-connector and replace org.json with com.googlecode.json-simple (#8319) add 9becb5a [typo] translate the comments of schema_change.h (#8321) add f52d479 [fix](ut) fix be ut fragment_mgr_test compile failed (#8344) add f57f02b [improvement] Support show tablets stmt (#7970) add 22a0011 [fix](planner) Convert format in RewriteFromUnixTimeRule (#8235) add c18717d [fix](vectorized) Fix core dump of mutable block different of block (#8280) add 910a140 [fix][vectorized] coredump about const compare in exchange node (#8302) add baa3b14 [fix] Use fmt::to_string replace memory buffer::data() (#8311) add be4dd0c [fix][vectorized] Fix error cast to boolean (#8345) add ea4ad1a [doc] Add sync job fe configuration item description (#8349) add 2519f8b format fe config title , add link for tablet_rebalancer_type (#8346) add 1879623 [docs]update http port doc to be more intuitive (#8343) add 3b159a9 support doriswriter build in macos (#8330) add 477b87c [feature](vec) Support update stmt in vec query engine (#8296) new 3e2d90d [feature-wip](array-type) Create table with nested array type. (#8003) new 28ea295 [feature-wip][array-type] Support ArrayLiteral in SQL. (#8089) This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (04ad3d2) \ N -- N -- N refs/heads/array-type (28ea295) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .gitignore | 11 +- be/CMakeLists.txt | 2 +- be/src/agent/pusher.cpp | 215 ------- be/src/common/config.h | 3 - be/src/exec/base_scanner.cpp | 4 +- be/src/exec/broker_scanner.cpp | 6 +- be/src/exec/except_node.cpp | 12 +- be/src/exec/hash_join_node.cpp | 8 +- be/src/exec/hash_table.h | 32 +- be/src/exec/hash_table.hpp | 4 +- be/src/exec/intersect_node.cpp | 12 +- be/src/exec/json_scanner.cpp | 22 +- be/src/exec/odbc_connector.cpp | 22 +- be/src/exec/set_operation_node.cpp | 12 +- be/src/exec/set_operation_node.h | 25 +- be/src/exec/tablet_sink.cpp | 6 +- be/src/exprs/encryption_functions.cpp | 93 ++- be/src/exprs/minmax_predicate.h | 4 +- be/src/exprs/rpc_fn_call.cpp | 44 +- be/src/exprs/rpc_fn_call.h | 7 +- be/src/exprs/runtime_filter.cpp | 200 +++--- be/src/olap/olap_define.h | 2 +- be/src/olap/schema_change.h | 11 +- be/src/olap/tablet_manager.cpp | 65 +- be/src/olap/tablet_manager.h | 14 +- be/src/olap/tablet_meta_manager.cpp | 21 +- be/src/olap/task/engine_batch_load_task.h | 3 +- be/src/runtime/fragment_mgr.cpp | 44 +- be/src/runtime/fragment_mgr.h | 3 +- be/src/runtime/plan_fragment_executor.cpp | 61 +- be/src/runtime/plan_fragment_executor.h | 7 +- .../runtime/routine_load/data_consumer_group.cpp | 17 +- be/src/runtime/runtime_state.cpp | 4 +- be/src/service/internal_service.cpp | 12 +- be/src/udf/udf.cpp | 3 + be/src/udf/udf.h | 3 + be/src/util/encryption_util.cpp | 37 +- be/src/util/encryption_util.h | 4 +- be/src/vec/core/block.cpp | 18 +- be/src/vec/core/block.h | 7 +- be/src/vec/exec/join/vhash_join_node.cpp | 39 +- be/src/vec/exec/vset_operation_node.cpp | 6 +- be/src/vec/functions/function_case.h | 5 +- be/src/vec/functions/function_cast.h | 12 + be/src/vec/io/io_helper.h | 17 + be/src/vec/runtime/vdata_stream_recvr.cpp | 6 +- be/src/vec/sink/vmysql_table_writer.cpp | 8 +- be/src/vec/sink/vtablet_sink.cpp | 193 +++--- be/src/vec/utils/template_helpers.hpp | 8 +- be/test/agent/mock_pusher.h | 32 - be/test/exec/es_predicate_test.cpp | 1 - .../rowset/segment_v2/binary_dict_page_test.cpp | 2 +- be/test/runtime/fragment_mgr_test.cpp | 3 +- be/test/util/CMakeLists.txt | 1 - be/test/util/encryption_util_test.cpp | 91 ++- be/test/util/types_test.cpp | 58 -- docker/Dockerfile | 10 +- docs/.vuepress/sidebar/en.js | 46 ++ docs/.vuepress/sidebar/zh-CN.js | 46 ++ docs/en/administrator-guide/config/fe_config.md | 60 ++ docs/en/developer-guide/docker-dev.md | 6 +- docs/en/extending-doris/spark-doris-connector.md | 1 + .../udf/remote-user-defined-function.md | 3 + docs/en/installing/install-deploy.md | 36 +- .../date-time-functions/date_format.md | 8 + .../date-time-functions/from_unixtime.md | 11 +- .../sql-statements/Data Definition/ALTER TABLE.md | 4 +- .../sql-statements/Data Definition/CREATE TABLE.md | 2 + .../Data Manipulation/SHOW TABLET.md | 13 +- .../Data Manipulation/SHOW TABLETS.md | 56 ++ docs/zh-CN/administrator-guide/config/fe_config.md | 696 +++++++++++---------- .../operation/tablet-repair-and-balance.md | 2 +- docs/zh-CN/developer-guide/docker-dev.md | 6 +- .../zh-CN/extending-doris/spark-doris-connector.md | 1 + .../udf/native-user-defined-function.md | 4 +- .../udf/remote-user-defined-function.md | 6 +- docs/zh-CN/installing/install-deploy.md | 24 +- .../date-time-functions/date_format.md | 8 + .../date-time-functions/from_unixtime.md | 11 +- .../sql-statements/Data Definition/ALTER TABLE.md | 4 +- .../sql-statements/Data Definition/CREATE TABLE.md | 2 +- .../Data Manipulation/SHOW TABLET.md | 33 +- .../{SHOW TABLET.md => SHOW TABLETS.md} | 46 +- extension/DataX/init-env.sh | 34 +- .../org/apache/doris/common/FeMetaVersion.java | 206 ------ fe/fe-core/pom.xml | 10 +- fe/fe-core/src/main/cup/sql_parser.cup | 4 +- .../src/main/java/org/apache/doris/PaloFe.java | 4 +- .../java/org/apache/doris/alter/AlterJobV2.java | 35 -- .../java/org/apache/doris/alter/RollupJobV2.java | 51 -- .../org/apache/doris/alter/SchemaChangeJobV2.java | 154 ----- .../java/org/apache/doris/analysis/Analyzer.java | 14 +- .../org/apache/doris/analysis/GroupingInfo.java | 18 +- .../analysis/ModifyTablePropertiesClause.java | 5 +- .../apache/doris/analysis/SetOperationStmt.java | 5 +- .../org/apache/doris/analysis/VirtualSlotRef.java | 7 + .../java/org/apache/doris/backup/Repository.java | 5 +- .../java/org/apache/doris/backup/RestoreJob.java | 34 + .../java/org/apache/doris/catalog/Catalog.java | 50 +- .../apache/doris/catalog/HashDistributionInfo.java | 4 + .../java/org/apache/doris/catalog/OlapTable.java | 14 +- .../java/org/apache/doris/catalog/Partition.java | 13 +- .../doris/catalog/RandomDistributionInfo.java | 14 - .../java/org/apache/doris/catalog/Replica.java | 30 +- .../java/org/apache/doris/catalog/ScalarType.java | 10 +- .../main/java/org/apache/doris/catalog/Tablet.java | 28 +- .../org/apache/doris/catalog/TabletStatMgr.java | 39 +- .../org/apache/doris/clone/TabletSchedCtx.java | 25 +- .../org/apache/doris/clone/TabletScheduler.java | 48 +- .../main/java/org/apache/doris/common/Config.java | 9 +- .../doris/deploy/impl/AmbariDeployManager.java | 19 +- .../external/elasticsearch/EsShardPartitions.java | 33 +- .../external/elasticsearch/EsShardRouting.java | 14 +- .../doris/external/elasticsearch/EsUtil.java | 10 +- .../doris/external/elasticsearch/MappingPhase.java | 50 +- .../doris/http/rest/StorageTypeCheckAction.java | 2 +- .../doris/http/rest/TableQueryPlanAction.java | 13 +- .../doris/httpv2/interceptor/AuthInterceptor.java | 8 - .../doris/httpv2/rest/TableQueryPlanAction.java | 19 +- .../org/apache/doris/journal/bdbje/BDBTool.java | 10 +- .../apache/doris/load/update/UpdatePlanner.java | 4 + .../doris/load/update/UpdateStmtExecutor.java | 2 + .../java/org/apache/doris/persist/EditLog.java | 2 +- .../apache/doris/persist/GlobalVarPersistInfo.java | 2 +- .../org/apache/doris/planner/HashJoinNode.java | 2 +- .../org/apache/doris/planner/OlapScanNode.java | 14 +- .../java/org/apache/doris/planner/PlanNode.java | 2 +- .../java/org/apache/doris/qe/ConnectProcessor.java | 4 +- .../main/java/org/apache/doris/qe/Coordinator.java | 21 +- .../java/org/apache/doris/qe/SessionVariable.java | 20 +- .../main/java/org/apache/doris/qe/VariableMgr.java | 15 +- .../doris/rewrite/RewriteFromUnixTimeRule.java | 69 +- .../org/apache/doris/rpc/BackendServiceProxy.java | 2 +- .../main/java/org/apache/doris/task/PushTask.java | 2 +- fe/fe-core/src/main/jflex/sql_scanner.flex | 1 + .../apache/doris/alter/SchemaChangeJobV2Test.java | 20 +- .../org/apache/doris/analysis/QueryStmtTest.java | 9 +- .../org/apache/doris/backup/BackupJobTest.java | 13 +- .../org/apache/doris/catalog/CatalogTestUtil.java | 11 +- .../org/apache/doris/catalog/DiskInfoTest.java | 1 + .../java/org/apache/doris/catalog/FakeEditLog.java | 6 + .../java/org/apache/doris/catalog/ReplicaTest.java | 13 +- .../doris/clone/TabletReplicaTooSlowTest.java | 21 +- .../doris/external/elasticsearch/EsUtilTest.java | 23 +- .../doris/http/TableQueryPlanActionTest.java | 59 +- .../apache/doris/http/TableRowCountActionTest.java | 14 +- .../apache/doris/http/TableSchemaActionTest.java | 17 +- .../java/org/apache/doris/load/DppConfigTest.java | 9 +- .../apache/doris/load/loadv2/SparkLoadJobTest.java | 2 - .../persist/AlterRoutineLoadOperationLogTest.java | 1 + .../org/apache/doris/planner/QueryPlanTest.java | 70 ++- .../transaction/GlobalTransactionMgrTest.java | 16 +- fe/pom.xml | 13 +- gensrc/proto/column_data_file.proto | 4 +- gensrc/proto/internal_service.proto | 8 - gensrc/proto/olap_file.proto | 14 +- gensrc/proto/types.proto | 8 + gensrc/thrift/BackendService.thrift | 2 + gensrc/thrift/PaloExternalDataSourceService.thrift | 2 +- samples/doris-demo/README.md | 12 + samples/doris-demo/pom.xml | 1 - samples/doris-demo/remote-udf-cpp-demo/Makefile | 74 +++ .../doris-demo/remote-udf-cpp-demo/README.md | 22 +- .../cpp_function_service_demo.cpp | 131 ++++ .../proto/function_service.proto | 1 + .../remote-udf-cpp-demo/proto/types.proto | 1 + .../remote-udf-java-demo}/README.md | 12 +- .../{udf-demo => remote-udf-java-demo}/pom.xml | 78 ++- .../org/apache/doris/udf/FunctionServiceDemo.java | 89 +++ .../org/apache/doris/udf/FunctionServiceImpl.java} | 90 ++- .../src/main/proto/function_service.proto | 1 + .../src/main/proto/types.proto | 1 + .../remote-udf-python-demo}/README.md | 16 +- .../remote-udf-python-demo/function_server_demo.py | 79 +++ .../proto/function_service.proto | 1 + .../remote-udf-python-demo/proto/types.proto | 1 + .../java/org/apache/doris/udf/Application.java | 36 -- .../udf-demo/src/main/proto/function_service.proto | 63 -- .../doris-demo/udf-demo/src/main/proto/types.proto | 217 ------- 179 files changed, 2606 insertions(+), 2593 deletions(-) delete mode 100644 be/src/agent/pusher.cpp delete mode 100644 be/test/agent/mock_pusher.h delete mode 100644 be/test/util/types_test.cpp create mode 100644 docs/en/sql-reference/sql-statements/Data Manipulation/SHOW TABLETS.md copy docs/zh-CN/sql-reference/sql-statements/Data Manipulation/{SHOW TABLET.md => SHOW TABLETS.md} (60%) create mode 100644 samples/doris-demo/remote-udf-cpp-demo/Makefile copy docs/en/sql-reference-v2/sql-statements/Account-Management-Statements/ALTER-USER.md => samples/doris-demo/remote-udf-cpp-demo/README.md (82%) create mode 100644 samples/doris-demo/remote-udf-cpp-demo/cpp_function_service_demo.cpp create mode 120000 samples/doris-demo/remote-udf-cpp-demo/proto/function_service.proto create mode 120000 samples/doris-demo/remote-udf-cpp-demo/proto/types.proto copy samples/{connect/nodejs => doris-demo/remote-udf-java-demo}/README.md (79%) rename samples/doris-demo/{udf-demo => remote-udf-java-demo}/pom.xml (62%) create mode 100644 samples/doris-demo/remote-udf-java-demo/src/main/java/org/apache/doris/udf/FunctionServiceDemo.java rename samples/doris-demo/{udf-demo/src/main/java/org/apache/doris/udf/FunctionGrpc.java => remote-udf-java-demo/src/main/java/org/apache/doris/udf/FunctionServiceImpl.java} (54%) create mode 120000 samples/doris-demo/remote-udf-java-demo/src/main/proto/function_service.proto create mode 120000 samples/doris-demo/remote-udf-java-demo/src/main/proto/types.proto copy samples/{connect/cpp => doris-demo/remote-udf-python-demo}/README.md (68%) create mode 100644 samples/doris-demo/remote-udf-python-demo/function_server_demo.py create mode 120000 samples/doris-demo/remote-udf-python-demo/proto/function_service.proto create mode 120000 samples/doris-demo/remote-udf-python-demo/proto/types.proto delete mode 100644 samples/doris-demo/udf-demo/src/main/java/org/apache/doris/udf/Application.java delete mode 100644 samples/doris-demo/udf-demo/src/main/proto/function_service.proto delete mode 100644 samples/doris-demo/udf-demo/src/main/proto/types.proto --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org