# Statistics
A total of 18 authors submitted 37 commits this week. Thanks to the contributions of the following authors: Mingyu Chen, ZhangYu0123, wyb, EmmyMiao87, xy720, caiconghui, Zhengguo Yang, HappenLee, HangyuanLiu, yiguolei, xueyan.li, weizuo93, satanson, gengjun-git, Youngwb, Yingchun Lai, Stalary, Lijia Liu This week, the 5042 lines added and 42453 lines deleted, involving a total of 3952 files. # New Features (Merged) https://github.com/apache/incubator-doris/pull/4425 Finish the Batch delete function, improve and optimize the related compaction process # Bug fix https://github.com/apache/incubator-doris/pull/4424 Prioritize the join hint specified by the user https://github.com/apache/incubator-doris/pull/4279 Fix the problem that the result is incorrect when the Inline view is included in the Left join operation. https://github.com/apache/incubator-doris/pull/4362 select database() no longer returns the cluster qualified name, and fix the problem that select user() does not display the user ip https://github.com/apache/incubator-doris/pull/4393 Fix the problem that the number of replication displayed by `show create table` is incorrect for tables that use dynamic partitioning https://github.com/apache/incubator-doris/pull/4436 Fix the problem of inconsistent precision of decimal, char and varchar columns in the base table and the materialized view https://github.com/apache/incubator-doris/pull/4448 (1) Fix the wild pointer problem in PlanFragmentExecutor (2) Fix the problem of null pointer when loading in json format https://github.com/apache/incubator-doris/pull/4401 Fixed the problem that some remaining tablet directories on BE were not cleared https://github.com/apache/incubator-doris/pull/4464 Fix some bugs with Spark Load https://github.com/apache/incubator-doris/pull/4471 Fix the problem that the balance of the colocation table cannot be completed https://github.com/apache/incubator-doris/pull/4458 Fix MemIndex::load_segment possible memory copy abnormal problem # Enhancement https://github.com/apache/incubator-doris/pull/4404 Added documentation for IN Predicate support in delete statement https://github.com/apache/incubator-doris/pull/4201 Support automatic mapping of count(distinct if(bool, bitmap, null)) to bitmap_union_count function https://github.com/apache/incubator-doris/pull/4359 Support set sql_mode = concat(@@sql_mode, "STRICT_TRANS_TABLES") statement https://github.com/apache/incubator-doris/pull/4373 Optimize BE's strategy for selecting disks when creating tablets, and use the "two random choices" algorithm to ensure that replica distribution are more even https://github.com/apache/incubator-doris/pull/4432 When creating a materialized view, the bitmap_union aggregation method only supports integer columns, and hll_union does not support decimal columns https://github.com/apache/incubator-doris/pull/4446 In the describe table statement, display the definition expression of the aggregate column of the materialized view https://github.com/apache/incubator-doris/pull/4348 Add two segment-related metrics to the OlapScanNode of the query profile to display the total number of segments and the number of filtered segments https://github.com/apache/incubator-doris/pull/4364 1. Support convert() function 2. Support cast (expr as signed/unsigned int) syntax to be compatible with MySQL ecology 3. Add more columns to the information_schema.columns table to be compatible with the MySQL https://github.com/apache/incubator-doris/pull/4383 In the Spark Load function, the yarn command line is used instead of the yarn-client API to kill the job or get the job status https://github.com/apache/incubator-doris/pull/4388 Return an error code in the schema change result to more clearly inform the user of the specific error https://github.com/apache/incubator-doris/pull/4435 Add batch delete function description document https://github.com/apache/incubator-doris/pull/4454 Persistence of stale rowset meta-information to ensure that this information will not be lost after BE restarts https://github.com/apache/incubator-doris/pull/4463 Added Spark Load syntax manual https://github.com/apache/incubator-doris/pull/4466 Add the display of cumulative compaction strategy name and rowset data size in BE's /api/compaction/show API https://github.com/apache/incubator-doris/pull/4470 Redirect the Spark Launcher log in Spark Load to a separate log file for easy viewing # Other https://github.com/apache/incubator-doris/pull/438 Modify the default storage format to SegmentV2. The storage format of subsequent newly created tables will default to SegmentV2 https://github.com/apache/incubator-doris/pull/4371 Fixed some issues related to License: 1. The dependencies of the two third-party libraries, MySQL client and LZO, will no longer be enabled in the default compilation options. If users need MySQL external table function, they need to enable it by themselves 2. Removed the js and css code in the code library and introduced it in the form of a third-party library dependency Updated the Docker development environment image build-env-1.2 Updated the compilation method of the UnixODBC tripartite library, so that the BE process no longer depends on the system libltdl.so dynamic library at runtime # List of main features under development https://github.com/apache/incubator-doris/issues/2581 Support SQL result set Cache https://github.com/apache/incubator-doris/issues/4376 Support to access external tables through ODBC protocol. https://github.com/apache/incubator-doris/issues/4308 Support the separation of the front-end UI and back-end structure of the FE module, providing a more powerful UI interface https://github.com/apache/incubator-doris/issues/3926 Support query spill to disk https://github.com/apache/incubator-doris/issues/3930 Supports sorting according to the specified Sequence column when loading data to the Unique Key model. https://github.com/apache/incubator-doris/issues/4283 Support Result Cache function -- 此致！Best Regards 陈明雨 Mingyu Chen Email: chenmin...@apache.org
