This is an automated email from the ASF dual-hosted git repository. jiafengzheng pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push: new 01b46abfc5b [docs]1.1.2 Release Note (#95) 01b46abfc5b is described below commit 01b46abfc5b9b8fd0f215d3abb07d29399fb7f39 Author: Luzhijing <82810928+luzhij...@users.noreply.github.com> AuthorDate: Tue Sep 13 17:53:58 2022 +0800 [docs]1.1.2 Release Note (#95) --- docs/releasenotes/release-1.1.2.md | 84 ++++++++++++++++++++ .../current/releasenotes/release-1.1.2.md | 91 ++++++++++++++++++++++ sidebars.json | 3 +- 3 files changed, 177 insertions(+), 1 deletion(-) diff --git a/docs/releasenotes/release-1.1.2.md b/docs/releasenotes/release-1.1.2.md new file mode 100644 index 00000000000..223b65fda06 --- /dev/null +++ b/docs/releasenotes/release-1.1.2.md @@ -0,0 +1,84 @@ +--- +{ + "title": "Release 1.1.2", + "language": "en" +} +--- + +<!-- +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. +--> + + +In this release, Doris Team has fixed more than 170 issues or performance improvement since 1.1.1. This release is a bugfix release on 1.1 and all users are encouraged to upgrade to this release. + +# Features + +### New MemTracker + +Introduced new MemTracker for both vectorized engine and non-vectorized engine which is more accurate. + +### Add API for showing current queries and kill query + +### Support read/write emoji of UTF16 via ODBC Table + +# Improvements + +### Data Lake related improvements + +- Improved HDFS ORC File scan performance about 300%. [#11501](https://github.com/apache/doris/pull/11501) + +- Support HDFS HA mode when query Iceberg table. + +- Support query Hive data created by [Apache Tez](https://tez.apache.org/) + +- Add Ali OSS as Hive external support. + +### Add support for string and text type in Spark Load + + +### Add reuse block in non-vectorized engine and have 50% performance improvement in some cases. [#11392](https://github.com/apache/doris/pull/11392) + +### Improve like or regex performance + +### Disable tcmalloc's aggressive_memory_decommit + +It will have 40% performance gains in load or query. + +Currently it is a config, you can change it by set config `tc_enable_aggressive_memory_decommit`. + +# Bug Fix + +### Some issues about FE that will cause FE failure or data corrupt. + +- Add reserved disk config to avoid too many reserved BDB-JE files.**(Serious)** In an HA environment, BDB JE will retains as many reserved files. The BDB-je log doesn't delete until approaching a disk limit. + +- Fix fatal bug in BDB-JE which will cause FE replica could not start correctly or data corrupted.** (Serious)** + +### Fe will hang on waitFor_rpc during query and BE will hang in high concurrent scenarios. + +[#12459](https://github.com/apache/doris/pull/12459) [#12458](https://github.com/apache/doris/pull/12458) [#12392](https://github.com/apache/doris/pull/12392) + +### A fatal issue in vectorized storage engine which will cause wrong result. **(Serious)** + +[#11754](https://github.com/apache/doris/pull/11754) [#11694](https://github.com/apache/doris/pull/11694) + +### Lots of planner related issues that will cause BE core or in abnormal state. + +[#12080](https://github.com/apache/doris/pull/12080) [#12075](https://github.com/apache/doris/pull/12075) [#12040](https://github.com/apache/doris/pull/12040) [#12003](https://github.com/apache/doris/pull/12003) [#12007](https://github.com/apache/doris/pull/12007) [#11971](https://github.com/apache/doris/pull/11971) [#11933](https://github.com/apache/doris/pull/11933) [#11861](https://github.com/apache/doris/pull/11861) [#11859](https://github.com/apache/doris/pull/11859) [#11855](https: [...] + diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/releasenotes/release-1.1.2.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/releasenotes/release-1.1.2.md new file mode 100644 index 00000000000..c0c5e582ab1 --- /dev/null +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/releasenotes/release-1.1.2.md @@ -0,0 +1,91 @@ +--- +{ + "title": "Release 1.1.2", + "language": "zh-CN" +} +--- + +<!-- +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. +--> + + +在 Apache Doris 1.1.2 版本中,我们引入了新的 Memtracker、极大程度上避免 OOM 类问题的发生,提升了向量化执行引擎在多数查询场景的性能表现,修复了诸多导致 BE 和 FE 发生异常的问题,优化了在湖仓联邦查询场景的部分体验问题并提升访问外部数据的性能。 + +相较于 1.1.1 版本,在 1.1.2 版本中有超过 170 个 Issue 和性能优化项被合入,系统稳定性和性能都得到进一步加强。与此同时,1.1.2 版本还将作为 Apache Doris 首个 LTS (Long-term Support)长周期支持版本,后续长期维护和支持,推荐所有用户下载和升级。 + +# 新增功能 + +### MemTracker + +MemTracker 是一个用于分析内存使用情况的统计工具,在 1.1.1 版本中我们引入了简易版 Memtracker 用以控制 BE 侧内存。在 1.1.2 版本中,我们引入了新的 MemTracker,在向量化执行引擎和非向量化执行引擎中都更为准确。 + +### 增加展示和取消正在执行 Query 的 API + +`GET /rest/v2/manager/query/current_queries` + +`GET /rest/v2/manager/query/kill/{query_id}` + +具体使用参考文档 [Query Profile Action](https://doris.apache.org/zh-CN/docs/dev/admin-manual/http-actions/fe/manager/query-profile-action?_highlight=current&_highlight=query#request) + +### 支持读写 Emoji 表情通过 ODBC 外表 + + +# 优化改进 + +### 数据湖相关改进 + +- 扫描 HDFS ORC 文件时性能提升约 300%。[#11501](https://github.com/apache/doris/pull/11501) + +- 查询 Iceberg 表支持 HDFS 的 HA 模式。 + +- 支持查询由 [Apache Tez](https://tez.apache.org/) 创建的 Hive 数据 + +- 添加阿里云 OSS 作为 Hive 外部支持 + +### 在 Spark Load 中增加对 String 字符串类型和 Text 文本类型的支持 + + +### 在非向量化引擎支持复用 Block,在某些场景中有 50%性能提升。[#11392](https://github.com/apache/doris/pull/11392) + +### 提升 Like 和正则表达式的性能 + +### 禁用 TCMalloc 的 aggressive_memory_decommit。 + +在查询或导入时将会有 40% 性能提升,也可以在配置文件中通过 `tc_enable_aggressive_memory_decommit`来修改 + +# Bug Fix + +### 修复部分可能导致 FE 失败或者数据损坏的问题 + +- 在 HA 环境中,BDBJE 将保留尽可能多的文件,通过增加配置 `bdbje_reserved_disk_bytes `以避免产生太多的 BDBJE 文件,BDBJE 日志只有在接近磁盘限制时才会删除。 + +- 修复了 BDBJE 中的重要错误,该错误将导致 FE 副本无法正确启动或数据损坏。 + +### 修复 FE 在查询过程中会在 waitFor_rpc 上 Hang 住以及 BE 在高并发情况下会 Hang 住的问题。 + +[#12459](https://github.com/apache/doris/pull/12459) [#12458](https://github.com/apache/doris/pull/12458) [#12392](https://github.com/apache/doris/pull/12392) + +### 修复向量化执行引擎查询时得到错误结果的问题。 + +[#11754](https://github.com/apache/doris/pull/11754) [#11694](https://github.com/apache/doris/pull/11694) + +### 修复许多 Planner 导致 BE Core 或者处于不正常状态的问题。 + +[#12080](https://github.com/apache/doris/pull/12080) [#12075](https://github.com/apache/doris/pull/12075) [#12040](https://github.com/apache/doris/pull/12040) [#12003](https://github.com/apache/doris/pull/12003) [#12007](https://github.com/apache/doris/pull/12007) [#11971](https://github.com/apache/doris/pull/11971) [#11933](https://github.com/apache/doris/pull/11933) [#11861](https://github.com/apache/doris/pull/11861) [#11859](https://github.com/apache/doris/pull/11859) [#11855](https: [...] + diff --git a/sidebars.json b/sidebars.json index ba2763e9d10..17f21c13c7b 100644 --- a/sidebars.json +++ b/sidebars.json @@ -916,7 +916,8 @@ "label": "Release notes", "items": [ "releasenotes/release-1.1.0", - "releasenotes/release-1.1.1" + "releasenotes/release-1.1.1", + "releasenotes/release-1.1.2" ] } ] --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org