[GitHub] [doris] compasses commented on a diff in pull request #11579: [Feature](NGram BloomFilter Index) add new ngram bloom filter index to speed up like query
compasses commented on code in PR #11579:
URL: https://github.com/apache/doris/pull/11579#discussion_r945118473
##
be/src/olap/rowset/segment_v2/column_writer.cpp:
##
@@ -296,8 +296,13 @@ Status ScalarColumnWriter::init() {
RETURN_IF_ERROR(
BitmapIndexWriter::create(get_field()->type_info(),
&_bitmap_index_builder));
}
+
if (_opts.need_bloom_filter) {
-RETURN_IF_ERROR(BloomFilterIndexWriter::create(
+if (_opts.is_ngram_bf_index)
+RETURN_IF_ERROR(BloomFilterIndexWriter::create(
Review Comment:
yes, make sense.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] compasses commented on a diff in pull request #11579: [Feature](NGram BloomFilter Index) add new ngram bloom filter index to speed up like query
compasses commented on code in PR #11579:
URL: https://github.com/apache/doris/pull/11579#discussion_r945118529
##
docs/zh-CN/docs/data-table/index/ngram-bloomfilter-index.md:
##
@@ -0,0 +1,79 @@
+---
+{
+"title": "NGram BloomFilter索引",
+"language": "zh-CN"
+}
+---
+
+
+
+# Doris NGram BloomFilter索引及使用使用场景
+
+为了提升like的查询性能，增加了NGram BloomFilter索引，其实现主要参照了ClickHouse的ngrambf。
+
+## NGram BloomFilter创建
+
+表创建时指定：
+
+```sql
+CREATE TABLE `table3` (
+ `siteid` int(11) NULL DEFAULT "10" COMMENT "",
+ `citycode` smallint(6) NULL COMMENT "",
+ `username` varchar(32) NULL DEFAULT "" COMMENT "",
+ INDEX idx_ngrambf (`username`) USING NGRAM_BF (3,256) COMMENT 'username
ngram_bf index'
+) ENGINE=OLAP
+AGGREGATE KEY(`siteid`, `citycode`, `username`) COMMENT "OLAP"
+DISTRIBUTED BY HASH(`siteid`) BUCKETS 10
+PROPERTIES (
+"replication_num" = "1"
+);
+
+-- 其中(3,256)，分别表示ngram的个数和bloomfilter的字节数。
Review Comment:
ok, will add some suggest.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] compasses commented on a diff in pull request #11579: [Feature](NGram BloomFilter Index) add new ngram bloom filter index to speed up like query
compasses commented on code in PR #11579:
URL: https://github.com/apache/doris/pull/11579#discussion_r945119661
##
docs/zh-CN/docs/data-table/index/ngram-bloomfilter-index.md:
##
@@ -0,0 +1,79 @@
+---
+{
+"title": "NGram BloomFilter索引",
+"language": "zh-CN"
+}
+---
+
+
+
+# Doris NGram BloomFilter索引及使用使用场景
+
+为了提升like的查询性能，增加了NGram BloomFilter索引，其实现主要参照了ClickHouse的ngrambf。
+
+## NGram BloomFilter创建
+
+表创建时指定：
+
+```sql
+CREATE TABLE `table3` (
+ `siteid` int(11) NULL DEFAULT "10" COMMENT "",
+ `citycode` smallint(6) NULL COMMENT "",
+ `username` varchar(32) NULL DEFAULT "" COMMENT "",
+ INDEX idx_ngrambf (`username`) USING NGRAM_BF (3,256) COMMENT 'username
ngram_bf index'
+) ENGINE=OLAP
+AGGREGATE KEY(`siteid`, `citycode`, `username`) COMMENT "OLAP"
+DISTRIBUTED BY HASH(`siteid`) BUCKETS 10
+PROPERTIES (
+"replication_num" = "1"
+);
+
+-- 其中(3,256)，分别表示ngram的个数和bloomfilter的字节数。
+```
+
+## 查看NGram BloomFilter索引
+
+查看我们在表上建立的NGram BloomFilter索引是使用:
+
+```sql
+show index from example_db.table3;
+```
+
+## 删除NGram BloomFilter索引
+
+
+```sql
+alter table example_db.table3 drop index idx_ngrambf;
+```
+
+## 修改NGram BloomFilter索引
+
+为已有列新增NGram BloomFilter索引：
+
+```sql
+alter table example_db.table3 add index idx_ngrambf(username) using
NGRAM_BF(3, 256) comment 'username ngram_bf index'
+```
+
+## **Doris NGram BloomFilter使用注意事项**
+
+1. NGram BloomFilter只支持字符串列
+2. NGram BloomFilter索引和BloomFilter索引为互斥关系，即同一个列只能设置两者中的一个
Review Comment:
Functionally, that's work if add whole value as a token. But I just doubt
it can make things more confusing, since NGram index, has gram size, how about
the whole value length less than the gram size during query? Which will make
the original logic complex, and probable has some impact for the NGram index.
So I concern about this kind of extension. I think it's better to let our user
clear about the NGram index just for like query.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] xiaokang opened a new pull request, #11757: [fix](query) fix orderby keys limit return less or no result
xiaokang opened a new pull request, #11757: URL: https://github.com/apache/doris/pull/11757 fix orderby keys limit return less or no result when a WHERE predicte filter most rows # Proposed changes Issue Number: close #xxx ## Problem summary Describe your changes. The bug is caused by use _num_rows_read for limit check. _num_rows_read is count of rows read from storage, but may be filtered by filter_block for WHERE predicate. Add a _num_rows_return, which is rows after filter_block for WHERE predicate, for count for really returned rows. ## Checklist(Required) 1. Does it affect the original behavior: - [ ] Yes - [x] No - [ ] I don't know 2. Has unit tests been added: - [ ] Yes - [x] No - [ ] No Need 3. Has document been added or modified: - [ ] Yes - [ ] No - [x] No Need 4. Does it need to update dependencies: - [ ] Yes - [x] No 5. Are there any changes that cannot be rolled back: - [ ] Yes (If Yes, please explain WHY) - [x] No ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #11746: [Fix](audit)eliminate duplicate query id in fe.audit.log
github-actions[bot] commented on PR #11746: URL: https://github.com/apache/doris/pull/11746#issuecomment-1214149827 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #11746: [Fix](audit)eliminate duplicate query id in fe.audit.log
github-actions[bot] commented on PR #11746: URL: https://github.com/apache/doris/pull/11746#issuecomment-1214149831 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #11749: [doc](typo)Add doc sidebars
github-actions[bot] commented on PR #11749: URL: https://github.com/apache/doris/pull/11749#issuecomment-1214151095 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #11749: [doc](typo)Add doc sidebars
github-actions[bot] commented on PR #11749: URL: https://github.com/apache/doris/pull/11749#issuecomment-1214151106 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris-website] hf200012 merged pull request #41: remove the exact same website link
hf200012 merged PR #41: URL: https://github.com/apache/doris-website/pull/41 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris-website] branch master updated: remove the exact same website link (#41)
This is an automated email from the ASF dual-hosted git repository. jiafengzheng pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris-website.git The following commit(s) were added to refs/heads/master by this push: new 359addc6cee remove the exact same website link (#41) 359addc6cee is described below commit 359addc6cee9b429aed12e89257daeddbf179a92 Author: timey AuthorDate: Sat Aug 13 20:44:17 2022 +0800 remove the exact same website link (#41) --- README.md | 2 -- 1 file changed, 2 deletions(-) diff --git a/README.md b/README.md index 5429a3713a2..d55a18291cb 100644 --- a/README.md +++ b/README.md @@ -36,8 +36,6 @@ There are 2 Github Actions: ## View the website To view the website, navigate to -[https://doris.apache.org](https://doris.apache.org) -or [https://doris.apache.org](https://doris.apache.org) ## Run & Build Website - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris-website] branch master updated: fix-doc (#40)
This is an automated email from the ASF dual-hosted git repository. jiafengzheng pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris-website.git The following commit(s) were added to refs/heads/master by this push: new 0187b269b35 fix-doc (#40) 0187b269b35 is described below commit 0187b269b359ab5692450ae55b672e6467722b00 Author: Liqf <109049295+lemonlit...@users.noreply.github.com> AuthorDate: Sat Aug 13 20:44:48 2022 +0800 fix-doc (#40) --- docs/admin-manual/cluster-management/upgrade.md | 8 docs/install/install-deploy.md| 6 +++--- .../sql-functions/window-functions/WINDOW-FUNCTION-COUNT.md | 2 +- .../sql-reference/Data-Definition-Statements/Drop/DROP-INDEX.md | 2 +- .../current/admin-manual/cluster-management/upgrade.md| 4 ++-- .../sql-functions/window-functions/WINDOW-FUNCTION-COUNT.md | 2 +- .../sql-reference/Data-Definition-Statements/Drop/DROP-INDEX.md | 2 +- 7 files changed, 13 insertions(+), 13 deletions(-) diff --git a/docs/admin-manual/cluster-management/upgrade.md b/docs/admin-manual/cluster-management/upgrade.md index 34eaada8bba..450867bcca9 100644 --- a/docs/admin-manual/cluster-management/upgrade.md +++ b/docs/admin-manual/cluster-management/upgrade.md @@ -68,10 +68,10 @@ Doris can upgrade smoothly by rolling upgrades. The following steps are recommen 1. Deploy a test FE process (It is recommended to use your own local development machine, or BE node. If it is on the Follower or Observer node, you need to stop the started process, but it is not recommended to test on the Follower or Observer node) using the new version alone. 2. Modify the FE configuration file fe.conf for testing and set all ports to **different from online**. 3. Add configuration in fe.conf: cluster_id=123456 -4. Add the configuration in fe.conf: metadatafailure_recovery=true -5. Copy the metadata directory palo-meta of the online environment Master FE to the test environment -6. Modify the cluster_id in the palo-meta/image/VERSION file copied into the test environment to 123456 (that is, the same as in Step 3) -7. "27979;" "35797;" "3681616;" sh bin /start fe.sh "21551;" FE +4. Add configuration in fe.conf: metadata_failure_recovery=true +5. Copy the metadata directory doris-meta of the online environment master Fe to the test environment +6.The cluster_ID where copy to the doris-meta/image/VERSION file in the test environment is modified to 123456 (that is, the same as in Step 3) +7. In the test environment,running sh sh bin/start_fe.sh,start FE. 8. Observe whether the start-up is successful through FE log fe.log. 9. If the startup is successful, run sh bin/stop_fe.sh to stop the FE process of the test environment. 10. **The purpose of the above 2-6 steps is to prevent the FE of the test environment from being misconnected to the online environment after it starts.** diff --git a/docs/install/install-deploy.md b/docs/install/install-deploy.md index fa6bf2dad9a..73b4b553f8d 100644 --- a/docs/install/install-deploy.md +++ b/docs/install/install-deploy.md @@ -77,14 +77,14 @@ Here we recommend using the ext4 file system. When installing the operating syst | Module | CPU | Memory | Disk | Network | Instance Number| |---|---|---|---|---|---| | Frontend | 8 core + | 8GB + | SSD or SATA, 10GB + * | Gigabit Network Card | 1| -| Backend | 8-core + | 16GB + | SSD or SATA, 50GB + * | Gigabit Network Card | 1-3*| +| Backend | 8 core + | 16GB + | SSD or SATA, 50GB + * | Gigabit Network Card | 1-3*| Production environment | Module | CPU | Memory | Disk | Network | Number of Instances (Minimum Requirements)| |---|---|---|---|---|---| | Frontend | 16 core + | 64GB + | SSD or RAID card, 100GB + * | 10,000 Mbp network card | 1-5*| -| Backend | 16 core + | 64GB + | SSD or SATA, 100G + * | 10-100 Mbp network card*| +| Backend | 16 core + | 64GB + | SSD or SATA, 100G + * | 10-100 Mbp network card | 10-100 * | > Note 1: > @@ -158,7 +158,7 @@ BROKER does not currently have, nor does it need, priority\_networks. Broker's s By default, doris is case-sensitive. If there is a need for case-insensitive table names, you need to set it before cluster initialization. The table name case sensitivity cannot be changed after cluster initialization is completed. -See the section on `lower_case_table_names` variables in [Variables](../advanced/variables.html#variable-setting-and-viewing) for details. +See the section on `lower_case_table_names` variables in [Variables](../advanced/variables.md) for details. ## Cluster deployment diff --git a/docs/sql-manual/sql-functions/window-functions/WINDOW-FUNCTION-COUNT.md b/docs/sql-manual/sql-functions/window-functions/WINDOW-FUNCTION-COUNT.md index 21d7cb25f82..b0a0a14d89e 100644 --- a/docs/sql-manual/sql-functions/window-functions/WINDOW-FUNCTION-COUNT.md +++ b/docs/sql-manual/sql-functions/window-fun
[doris-website] branch master updated: title fix
This is an automated email from the ASF dual-hosted git repository.
jiafengzheng pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push:
new 2867d0ac041 title fix
2867d0ac041 is described below
commit 2867d0ac041fdbe1908c2e878b304ba04eff30d7
Author: jiafeng.zhang
AuthorDate: Sat Aug 13 20:43:07 2022 +0800
title fix
---
docs/data-table/data-model.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/data-table/data-model.md b/docs/data-table/data-model.md
index 7cd9802b25e..e355cdb4882 100644
--- a/docs/data-table/data-model.md
+++ b/docs/data-table/data-model.md
@@ -1,6 +1,6 @@
---
{
-"title": "Data Model, ROLLUP and Prefix Index",
+"title": "Data Model",
"language": "en"
}
---
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris-website] hf200012 merged pull request #40: [doc]fix-doc
hf200012 merged PR #40: URL: https://github.com/apache/doris-website/pull/40 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hf200012 merged pull request #11749: [doc](typo)Add doc sidebars
hf200012 merged PR #11749: URL: https://github.com/apache/doris/pull/11749 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated: [doc](typo)Add doc sidebars (#11749)
This is an automated email from the ASF dual-hosted git repository.
jiafengzheng pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new db83f37256 [doc](typo)Add doc sidebars (#11749)
db83f37256 is described below
commit db83f37256683b3ad077294aa7aedf7e73c5437f
Author: jiafeng.zhang
AuthorDate: Sat Aug 13 20:46:52 2022 +0800
[doc](typo)Add doc sidebars (#11749)
add doc sidebars
---
docs/dev.json | 282 ++
.../design/Flink-doris-connector-Design.md | 259 --
.../design/spark_load.md} | 6 +-
docs/en/docs/advanced/alter-table/replace-table.md | 72 ++
.../join-optimization/doris-join-optimization.md | 107 ++-
docs/en/docs/data-table/data-model.md | 2 +-
docs/en/docs/ecosystem/cloudcanal.md | 4 +-
.../ecosystem/doris-manager/cluster-managenent.md | 26 +-
docs/en/docs/ecosystem/flink-doris-connector.md| 30 +-
docs/sidebars.json | 972 +
docs/sidebarsCommunity.json| 68 ++
.../design/flink_doris_connector_design.md | 272 --
.../docs/advanced/alter-table/replace-table.md | 71 ++
docs/zh-CN/docs/summary/system-architecture.md | 29 -
14 files changed, 1542 insertions(+), 658 deletions(-)
diff --git a/docs/dev.json b/docs/dev.json
new file mode 100644
index 00..730292f519
--- /dev/null
+++ b/docs/dev.json
@@ -0,0 +1,282 @@
+{
+ "version.label": {
+"message": "1.1",
+"description": "The label for version current"
+ },
+ "sidebar.docs.category.Getting Started": {
+"message": "快速开始",
+"description": "The label for category Getting Started in sidebar docs"
+ },
+ "sidebar.docs.category.Doris Introduction": {
+"message": "Doris 介绍",
+"description": "The label for category Doris Architecture in sidebar docs"
+ },
+ "sidebar.docs.category.Install And Deploy": {
+"message": "安装部署",
+"description": "The label for category Install And Deploy in sidebar docs"
+ },
+ "sidebar.docs.category.Compile": {
+"message": "源码编译",
+"description": "The label for category Compile in sidebar docs"
+ },
+ "sidebar.docs.category.Table Design": {
+"message": "数据表设计",
+"description": "The label for category Table Design in sidebar docs"
+ },
+ "sidebar.docs.category.Index": {
+"message": "索引",
+"description": "The label for category Index in sidebar docs"
+ },
+ "sidebar.docs.category.Data Operation": {
+"message": "数据操作",
+"description": "The label for category Data Operation in sidebar docs"
+ },
+ "sidebar.docs.category.Import": {
+"message": "数据导入",
+"description": "The label for category Import in sidebar docs"
+ },
+ "sidebar.docs.category.Import Scenes": {
+"message": "按场景导入",
+"description": "The label for category Import Scenes in sidebar docs"
+ },
+ "sidebar.docs.category.Import Way": {
+"message": "按方式导入",
+"description": "The label for category Import Way in sidebar docs"
+ },
+ "sidebar.docs.category.Export": {
+"message": "导出",
+"description": "The label for category Export in sidebar docs"
+ },
+ "sidebar.docs.category.Update and Delete": {
+"message": "数据更新及删除",
+"description": "The label for category Update and Delete in sidebar docs"
+ },
+ "sidebar.docs.category.Advanced Usage": {
+"message": "进阶使用",
+"description": "The label for category Advanced Usage in sidebar docs"
+ },
+ "sidebar.docs.category.Alter Table": {
+"message": "表结构变更",
+"description": "The label for category Alter Table in sidebar docs"
+ },
+ "sidebar.docs.category.Doris Partition": {
+"message": "Doris 表分区",
+"description": "The label for category Doris Partition in sidebar docs"
+ },
+ "sidebar.docs.category.Join Optimization": {
+"message": "Join 优化",
+"description": "The label for category Join Optimization in sidebar docs"
+ },
+ "sidebar.docs.category.Date Cache": {
+"message": "数据缓存",
+"description": "The label for category Date Cache in sidebar docs"
+ },
+ "sidebar.docs.category.Best Practice": {
+"message": "最佳实践",
+"description": "The label for category Best Practice in sidebar docs"
+ },
+ "sidebar.docs.category.Ecosystem": {
+"message": "生态扩展",
+"description": "The label for category Ecosystem in sidebar docs"
+ },
+ "sidebar.docs.category.Expansion table": {
+"message": "扩展表",
+"description": "The label for category Expansion table in sidebar docs"
+ },
+ "sidebar.docs.category.Doris Manager": {
+"message": "Doris Manager",
+"description": "The label for category Doris Manager in sidebar docs"
+ },
+ "sidebar.docs.category.SeaTunnel": {
+"message": "SeaTunnel",
+"description": "The label for category SeaTunnel in sidebar docs"
+ },
+ "sidebar.docs.
[doris-website] branch master updated: Add daily build doris master docs
This is an automated email from the ASF dual-hosted git repository.
jiafengzheng pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push:
new 4c3048bca40 Add daily build doris master docs
4c3048bca40 is described below
commit 4c3048bca401998fb2bc71f327783490fe419236
Author: jiafeng.zhang
AuthorDate: Sat Aug 13 21:08:00 2022 +0800
Add daily build doris master docs
Add daily build doris master docs
---
.github/workflows/cron-deploy-website.yml | 65 ++-
docusaurus.config.js | 3 ++
sidebarsCommunity.json| 3 +-
versions.json | 1 +
4 files changed, 44 insertions(+), 28 deletions(-)
diff --git a/.github/workflows/cron-deploy-website.yml
b/.github/workflows/cron-deploy-website.yml
index 68f9626f8b9..50fccd280ce 100644
--- a/.github/workflows/cron-deploy-website.yml
+++ b/.github/workflows/cron-deploy-website.yml
@@ -18,41 +18,52 @@ jobs:
- name: Build
run: |
-git clone https://github.com/apache/doris.git doris
-export BRANCH=master
-cp -R blogs/zh-CN/ doris/docs/zh-CN/blogs/
-cp -R blogs/en/ doris/docs/en/blogs/
-cp -R blogs/images/blogs/ doris/docs/.vuepress/public/images/
-cp -R versions.json doris/docs/.vuepress/public/
-cp -R sidebar/zh-CN/* doris/docs/.vuepress/sidebar/zh-CN/
-cp -R sidebar/en/* doris/docs/.vuepress/sidebar/en/
-cd doris/
-git fetch
-cd docs/
-find ./ -name "*.md" -exec sed -i -e 's/!\[\(.*\)\][(]\(.*\)[)]//g' {} \;
-sed -i 's/en\///g' .vuepress/config.js
-sed -i 's/en\///g' .vuepress/theme/index.js
-sed -i "s/BUILDING_BRANCH\.length > 0/BUILDING_BRANCH\.length > 0 \&\&
BUILDING_BRANCH !== 'master'/g" .vuepress/config.js
-sed -i 's/en\///g' en/README.md
-mv en/* ./
-mv .vuepress/sidebar/en/* .vuepress/sidebar/
-npm install -g increase-memory-limit
-increase-memory-limit
-export NODE_OPTIONS="--max-old-space-size=9144" && npm install && npm
run build
-touch .vuepress/dist/.dummy
-ls .vuepress/dist/
-export DORIS_COMMIT=`git rev-parse HEAD`
+git clone https://github.com/apache/doris.git
+cp -R doris/docs/sidebarsCommunity.json .
+mkdir versioned_docs/version-dev/
+cp -R doris/docs/en/docs/* versioned_docs/version-dev/
+cp -R doris/docs/sidebars.json
versioned_sidebars/version-dev-sidebars.json
+mkdir i18n/zh-CN/docusaurus-plugin-content-docs/dev
+cp -R doris/docs/zh-CN/docs/*
i18n/zh-CN/docusaurus-plugin-content-docs/dev/
+cp -R doris/docs/dev.json i18n/zh-CN/docusaurus-plugin-content-docs/
+cp -R doris/docs/en/community .
+cp -R doris/docs/zh-CN/community/*
i18n/zh-CN/docusaurus-plugin-content-docs-community/current/
-- name: Deploy Master
+cp -R doris/docs/images/* static/images/
+npm install -g yarn
+yarn cache clean
+yarn && yarn build
+touch build/.dummy
+ls build
+export DORIS_COMMIT=`git rev-parse HEAD`
+- name: Deploy website
+ if: ${{ github.event.inputs.branch == 'master' }}
run: |
+git config --global http.postBuffer 524288000
git fetch
git checkout -b asf-site remotes/origin/asf-site
/bin/bash remove-non-reserved-dir.sh
-cp -r doris/docs/.vuepress/dist/* ./
-rm -rf doris/
+cp -r build/* ./
+rm -rf build/
+rm -rf .docusaurus
+rm -rf node_modules
+rm -rf doris
+rm -rf versioned_docs/version-dev/
+rm -rf i18n/zh-CN/docusaurus-plugin-content-docs/dev/
git config user.name "github-actions[bot]"
git config user.email "github-actions[bot]@users.noreply.github.com"
git add .
git commit -m "Automated deployment with doris master"
git push --verbose "https://${{ secrets.GITHUB_TOKEN
}}@github.com/apache/doris-website.git" asf-site:asf-site
+- name: Deploy Branch
+ if: ${{ github.event.inputs.branch != 'master' }}
+ uses: peaceiris/actions-gh-pages@v3
+ with:
+github_token: ${{ secrets.GITHUB_TOKEN }}
+publish_branch: asf-site
+publish_dir: ./build
+destination_dir: ${{ github.event.inputs.branch }}
+user_name: 'github-actions[bot]'
+user_email: 'github-actions[bot]@users.noreply.github.com'
+commit_message: 'Automated deployment with doris branch ${{
github.event.inputs.branch }}@${{ env.DORIS_COMMIT }}'
diff --git a/docusaurus.config.js b/docusaurus.config.js
index 1d171156c6f..68ddb5e763b 100644
--- a/docusaurus.config.js
+++ b/docusaurus.config.js
@@ -117,6 +117,9 @@ const config = {
label: '1.1',
path:
[GitHub] [doris] hf200012 opened a new pull request, #11758: [typo](fix)Fix community documentation link errors
hf200012 opened a new pull request, #11758: URL: https://github.com/apache/doris/pull/11758 # Proposed changes Issue Number: close #xxx ## Problem summary Describe your changes. ## Checklist(Required) 1. Does it affect the original behavior: - [ ] Yes - [x] No - [ ] I don't know 2. Has unit tests been added: - [ ] Yes - [x] No - [ ] No Need 3. Has document been added or modified: - [ ] Yes - [x] No - [ ] No Need 4. Does it need to update dependencies: - [ ] Yes - [x] No 5. Are there any changes that cannot be rolled back: - [ ] Yes (If Yes, please explain WHY) - [x] No ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #11756: [doc](fix)fix-doc
github-actions[bot] commented on PR #11756: URL: https://github.com/apache/doris/pull/11756#issuecomment-1214159184 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #11758: [typo](fix)Fix community documentation link errors
github-actions[bot] commented on PR #11758: URL: https://github.com/apache/doris/pull/11758#issuecomment-1214159416 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #11758: [typo](fix)Fix community documentation link errors
github-actions[bot] commented on PR #11758: URL: https://github.com/apache/doris/pull/11758#issuecomment-1214159421 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hf200012 merged pull request #11758: [typo](fix)Fix community documentation link errors
hf200012 merged PR #11758: URL: https://github.com/apache/doris/pull/11758 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris-website] branch master updated: Add master version documentation
This is an automated email from the ASF dual-hosted git repository. jiafengzheng pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris-website.git The following commit(s) were added to refs/heads/master by this push: new 1c3618a4454 Add master version documentation 1c3618a4454 is described below commit 1c3618a4454efbf39d85fdc135a0d5afc4e1eec7 Author: jiafeng.zhang AuthorDate: Sat Aug 13 21:24:12 2022 +0800 Add master version documentation Add master version documentation --- .github/workflows/manual-deploy-website.yml | 15 +++ 1 file changed, 15 insertions(+) diff --git a/.github/workflows/manual-deploy-website.yml b/.github/workflows/manual-deploy-website.yml index fc358d10bce..08cb5b79187 100644 --- a/.github/workflows/manual-deploy-website.yml +++ b/.github/workflows/manual-deploy-website.yml @@ -22,6 +22,18 @@ jobs: - name: Build run: | +git clone https://github.com/apache/doris.git +cp -R doris/docs/sidebarsCommunity.json . +mkdir versioned_docs/version-dev/ +cp -R doris/docs/en/docs/* versioned_docs/version-dev/ +cp -R doris/docs/sidebars.json versioned_sidebars/version-dev-sidebars.json +mkdir i18n/zh-CN/docusaurus-plugin-content-docs/dev +cp -R doris/docs/zh-CN/docs/* i18n/zh-CN/docusaurus-plugin-content-docs/dev/ +cp -R doris/docs/dev.json i18n/zh-CN/docusaurus-plugin-content-docs/ +cp -R doris/docs/en/community . +cp -R doris/docs/zh-CN/community/* i18n/zh-CN/docusaurus-plugin-content-docs-community/current/ + +cp -R doris/docs/images/* static/images/ npm install -g yarn yarn cache clean yarn && yarn build @@ -39,6 +51,9 @@ jobs: rm -rf build/ rm -rf .docusaurus rm -rf node_modules +rm -rf doris +rm -rf versioned_docs/version-dev/ +rm -rf i18n/zh-CN/docusaurus-plugin-content-docs/dev/ git config user.name "github-actions[bot]" git config user.email "github-actions[bot]@users.noreply.github.com" git add . - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated: [typo](fix)Fix community documentation link errors (#11758)
This is an automated email from the ASF dual-hosted git repository. jiafengzheng pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris.git The following commit(s) were added to refs/heads/master by this push: new 031fba4259 [typo](fix)Fix community documentation link errors (#11758) 031fba4259 is described below commit 031fba4259ec22f4c042b3510c41adc06cae6925 Author: jiafeng.zhang AuthorDate: Sat Aug 13 21:24:54 2022 +0800 [typo](fix)Fix community documentation link errors (#11758) Fix community documentation link errors --- docs/en/community/design/grouping_sets_design.md | 2 +- .../en/community/developer-guide/benchmark-tool.md | 2 +- .../developer-guide/cpp-diagnostic-code.md | 2 +- .../community/developer-guide/cpp-format-code.md | 2 +- docs/en/community/developer-guide/docker-dev.md| 10 +- docs/en/community/developer-guide/fe-idea-dev.md | 181 +++- docs/en/community/developer-guide/fe-vscode-dev.md | 4 +- .../developer-guide/regression-testing.md | 30 ++ docs/en/community/feedback.md | 2 +- .../community/how-to-contribute/contribute-doc.md | 313 + .../how-to-contribute/contributor-guide.md | 2 +- .../how-to-contribute/how-to-contribute.md | 32 +-- .../en/community/how-to-contribute/pull-request.md | 12 +- .../release-and-verify/release-doris-connectors.md | 2 +- .../release-and-verify/release-doris-core.md | 2 +- .../release-and-verify/release-doris-manager.md| 2 +- docs/en/community/subscribe-mail-list.md | 2 +- docs/en/community/team.md | 2 +- .../zh-CN/community/design/grouping_sets_design.md | 2 +- .../community/developer-guide/be-vscode-dev.md | 43 ++- .../community/developer-guide/benchmark-tool.md| 2 +- .../developer-guide/cpp-diagnostic-code.md | 2 +- .../community/developer-guide/cpp-format-code.md | 4 +- docs/zh-CN/community/developer-guide/docker-dev.md | 10 +- .../zh-CN/community/developer-guide/fe-idea-dev.md | 197 +++-- .../community/developer-guide/fe-vscode-dev.md | 4 +- .../developer-guide/regression-testing.md | 16 +- .../community/how-to-contribute/contribute-doc.md | 312 .../how-to-contribute/contributor-guide.md | 2 +- .../how-to-contribute/how-to-be-a-committer.md | 2 +- .../how-to-contribute/how-to-contribute.md | 26 +- .../community/how-to-contribute/pull-request.md| 4 +- .../release-and-verify/release-doris-core.md | 2 +- docs/zh-CN/community/team.md | 2 +- 34 files changed, 986 insertions(+), 248 deletions(-) diff --git a/docs/en/community/design/grouping_sets_design.md b/docs/en/community/design/grouping_sets_design.md index 483f1ee856..16acc33997 100644 --- a/docs/en/community/design/grouping_sets_design.md +++ b/docs/en/community/design/grouping_sets_design.md @@ -138,7 +138,7 @@ Indicates whether a specified column expression in a `GROUP BY` list is aggregat `GROUPING_ID` describes which of a list of expressions are grouped in a row produced by a `GROUP BY` query. The `GROUPING_ID` function simply returns the decimal equivalent of the binary value formed as a result of the concatenation of the values returned by the `GROUPING` functions. -Each `GROUPING_ID` argument must be an element of the `GROUP BY` list. `GROUPING_ID ()` returns an **integer** bitmap whose lowest N bits may be lit. A lit **bit** indicates the corresponding argument is not a grouping column for the given output row. The lowest-order **bit** corresponds to argument N, and the N-1th lowest-order **bit** corresponds to argument 1. If the column is a grouping column the bit is 1 else is 0. +Each `GROUPING_ID` argument must be an element of the `GROUP BY` list. `GROUPING_ID ()` returns an **integer** bitmap whose lowest N bits may be lit. A lit **bit** indicates the corresponding argument is not a grouping column for the given output row. The lowest-order **bit** corresponds to argument N, and the N-1th lowest-order **bit** corresponds to argument 1. If the column is a grouping column the bit is 0 else is 1. For example: diff --git a/docs/en/community/developer-guide/benchmark-tool.md b/docs/en/community/developer-guide/benchmark-tool.md index 21cacc9656..a6ed29e12a 100644 --- a/docs/en/community/developer-guide/benchmark-tool.md +++ b/docs/en/community/developer-guide/benchmark-tool.md @@ -33,7 +33,7 @@ It can be used to test the performance of some parts of the BE storage layer (fo ## Compilation -1. To ensure that the environment has been able to successfully compile the Doris ontology, you can refer to [Installation and deployment](../../docs/install/source-install/compilation.md)。 +1. To ensure that the environment has been able to successfully compile the Doris ontology, you c
[GitHub] [doris] JNSimba opened a new pull request, #11759: [doc](data-model) update english title
JNSimba opened a new pull request, #11759: URL: https://github.com/apache/doris/pull/11759 # Proposed changes Issue Number: close #xxx ## Problem summary update english title ## Checklist(Required) 1. Does it affect the original behavior: - [ ] Yes - [ ] No - [ ] I don't know 2. Has unit tests been added: - [ ] Yes - [ ] No - [ ] No Need 3. Has document been added or modified: - [ ] Yes - [ ] No - [ ] No Need 4. Does it need to update dependencies: - [ ] Yes - [ ] No 5. Are there any changes that cannot be rolled back: - [ ] Yes (If Yes, please explain WHY) - [ ] No ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris-website] branch master updated: data model title fix
This is an automated email from the ASF dual-hosted git repository. jiafengzheng pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris-website.git The following commit(s) were added to refs/heads/master by this push: new 22e28e7621a data model title fix 22e28e7621a is described below commit 22e28e7621a3d96e13ebfa21893fb67f16066a91 Author: jiafeng.zhang AuthorDate: Sat Aug 13 21:38:38 2022 +0800 data model title fix --- docs/data-table/data-model.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/data-table/data-model.md b/docs/data-table/data-model.md index e355cdb4882..3df284c933b 100644 --- a/docs/data-table/data-model.md +++ b/docs/data-table/data-model.md @@ -24,7 +24,7 @@ specific language governing permissions and limitations under the License. --> -# Data Model, ROLLUP and Prefix Index +# Data Model This document describes Doris's data model, ROLLUP and prefix index concepts at the logical level to help users better use Doris to cope with different business scenarios. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris-website] branch master updated: fix
This is an automated email from the ASF dual-hosted git repository. jiafengzheng pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris-website.git The following commit(s) were added to refs/heads/master by this push: new ac8c0f70571 fix ac8c0f70571 is described below commit ac8c0f705710c6d30946ab32e422438f0d48c46a Author: jiafeng.zhang AuthorDate: Sat Aug 13 21:54:50 2022 +0800 fix --- .github/workflows/cron-deploy-website.yml | 6 +++--- .github/workflows/manual-deploy-website.yml | 6 +++--- 2 files changed, 6 insertions(+), 6 deletions(-) diff --git a/.github/workflows/cron-deploy-website.yml b/.github/workflows/cron-deploy-website.yml index 50fccd280ce..f177aa2daee 100644 --- a/.github/workflows/cron-deploy-website.yml +++ b/.github/workflows/cron-deploy-website.yml @@ -23,9 +23,9 @@ jobs: mkdir versioned_docs/version-dev/ cp -R doris/docs/en/docs/* versioned_docs/version-dev/ cp -R doris/docs/sidebars.json versioned_sidebars/version-dev-sidebars.json -mkdir i18n/zh-CN/docusaurus-plugin-content-docs/dev -cp -R doris/docs/zh-CN/docs/* i18n/zh-CN/docusaurus-plugin-content-docs/dev/ -cp -R doris/docs/dev.json i18n/zh-CN/docusaurus-plugin-content-docs/ +mkdir i18n/zh-CN/docusaurus-plugin-content-docs/version-dev +cp -R doris/docs/zh-CN/docs/* i18n/zh-CN/docusaurus-plugin-content-docs/version-dev/ +cp -R doris/docs/dev.json i18n/zh-CN/docusaurus-plugin-content-docs/version-dev.json cp -R doris/docs/en/community . cp -R doris/docs/zh-CN/community/* i18n/zh-CN/docusaurus-plugin-content-docs-community/current/ diff --git a/.github/workflows/manual-deploy-website.yml b/.github/workflows/manual-deploy-website.yml index 08cb5b79187..f14208e71fe 100644 --- a/.github/workflows/manual-deploy-website.yml +++ b/.github/workflows/manual-deploy-website.yml @@ -27,9 +27,9 @@ jobs: mkdir versioned_docs/version-dev/ cp -R doris/docs/en/docs/* versioned_docs/version-dev/ cp -R doris/docs/sidebars.json versioned_sidebars/version-dev-sidebars.json -mkdir i18n/zh-CN/docusaurus-plugin-content-docs/dev -cp -R doris/docs/zh-CN/docs/* i18n/zh-CN/docusaurus-plugin-content-docs/dev/ -cp -R doris/docs/dev.json i18n/zh-CN/docusaurus-plugin-content-docs/ +mkdir i18n/zh-CN/docusaurus-plugin-content-docs/devversion-dev +cp -R doris/docs/zh-CN/docs/* i18n/zh-CN/docusaurus-plugin-content-docs/version-dev/ +cp -R doris/docs/dev.json i18n/zh-CN/docusaurus-plugin-content-docs/version-dev.json cp -R doris/docs/en/community . cp -R doris/docs/zh-CN/community/* i18n/zh-CN/docusaurus-plugin-content-docs-community/current/ - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris-website] branch master updated: fix
This is an automated email from the ASF dual-hosted git repository. jiafengzheng pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris-website.git The following commit(s) were added to refs/heads/master by this push: new d3bf514 fix d3bf514 is described below commit d3bf514afc4ad17d9eabf5c5b30fbe247fcd Author: jiafeng.zhang AuthorDate: Sat Aug 13 21:57:07 2022 +0800 fix --- .github/workflows/manual-deploy-website.yml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/.github/workflows/manual-deploy-website.yml b/.github/workflows/manual-deploy-website.yml index f14208e71fe..82010dab0ac 100644 --- a/.github/workflows/manual-deploy-website.yml +++ b/.github/workflows/manual-deploy-website.yml @@ -27,7 +27,7 @@ jobs: mkdir versioned_docs/version-dev/ cp -R doris/docs/en/docs/* versioned_docs/version-dev/ cp -R doris/docs/sidebars.json versioned_sidebars/version-dev-sidebars.json -mkdir i18n/zh-CN/docusaurus-plugin-content-docs/devversion-dev +mkdir i18n/zh-CN/docusaurus-plugin-content-docs/version-dev cp -R doris/docs/zh-CN/docs/* i18n/zh-CN/docusaurus-plugin-content-docs/version-dev/ cp -R doris/docs/dev.json i18n/zh-CN/docusaurus-plugin-content-docs/version-dev.json cp -R doris/docs/en/community . - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] chenlinzhong opened a new pull request, #11760: [remote-udaf](sample) impl some udaf python demo
chenlinzhong opened a new pull request, #11760:
URL: https://github.com/apache/doris/pull/11760
# Proposed changes
Issue Number: close #xxx
## Problem summary
```
//create one table such as table2
CREATE TABLE `table2` (
`event_day` date NULL,
`siteid` int(11) NULL DEFAULT "10",
`citycode` smallint(6) NULL,
`visitinfo` varchar(1024) NULL DEFAULT "",
`pv` varchar(1024) REPLACE NULL DEFAULT "0"
) ENGINE=OLAP
AGGREGATE KEY(`event_day`, `siteid`, `citycode`, `visitinfo`)
COMMENT 'OLAP'
DISTRIBUTED BY HASH(`siteid`) BUCKETS 10
PROPERTIES (
"replication_allocation" = "tag.location.default: 1",
"in_memory" = "false",
"storage_format" = "V2"
)
//import some data
MySQL [test_db]> select * from table2;
+++--++--+
| event_day | siteid | citycode | visitinfo | pv
|
+++--++--+
| 2017-07-03 | 8 | 12 | {"ip":"192.168.0.5","source":"pc"} | 81
|
| 2017-07-03 | 37 | 12 | {"ip":"192.168.0.3","source":"pc"} | 81
|
| 2017-07-03 | 67 | 16 | {"ip":"192.168.0.2","source":"pc"} | 79
|
| 2017-07-03 |101 | 11 | {"ip":"192.168.0.5","source":"pc"} | 65
|
| 2017-07-03 | 32 | 15 | {"ip":"192.168.0.1","source":"pc"} | 188
|
| 2017-07-03 |103 | 12 | {"ip":"192.168.0.5","source":"pc"} | 123
|
| 2017-07-03 |104 | 16 | {"ip":"192.168.0.5","source":"pc"} | 79
|
| 2017-07-03 | 3 | 12 | {"ip":"192.168.0.3","source":"pc"} | 123
|
| 2017-07-03 | 3 | 15 | {"ip":"192.168.0.2","source":"pc"} | 188
|
| 2017-07-03 | 13 | 11 | {"ip":"192.168.0.1","source":"pc"} | 65
|
| 2017-07-03 | 53 | 12 | {"ip":"192.168.0.2","source":"pc"} | 123
|
| 2017-07-03 | 1 | 11 | {"ip":"192.168.0.1","source":"pc"} | 65
|
| 2017-07-03 | 7 | 16 | {"ip":"192.168.0.4","source":"pc"} | 79
|
| 2017-07-03 |102 | 15 | {"ip":"192.168.0.5","source":"pc"} | 188
|
| 2017-07-03 |105 | 12 | {"ip":"192.168.0.5","source":"pc"} | 81
|
+++--++--+
```
### 1. find top 3 ip
```
MySQL [test_db]> CREATE AGGREGATE FUNCTION
rpc_count_visit_info(varchar(1024)) RETURNS varchar(1024) PROPERTIES (
"TYPE"="RPC",
"OBJECT_FILE"="127.0.0.1:9000",
"update_fn"="rpc_count_visit_info_update",
"merge_fn"="rpc_count_visit_info_merge",
"finalize_fn"="rpc_count_visit_info_finalize"
);
MySQL [test_db]> select rpc_count_visit_info(visitinfo) from table2;
++
| rpc_count_visit_info(`visitinfo`) |
++
| 192.168.0.5:6 192.168.0.2:3 192.168.0.1:3 |
++
1 row in set (0.036 sec)
MySQL [test_db]> select citycode, rpc_count_visit_info(visitinfo) from
table2 group by citycode;
+--++
| citycode | rpc_count_visit_info(`visitinfo`) |
+--++
| 15 | 192.168.0.2:1 192.168.0.1:1 192.168.0.5:1 |
| 11 | 192.168.0.1:2 192.168.0.5:1|
| 12 | 192.168.0.5:3 192.168.0.3:2 192.168.0.2:1 |
| 16 | 192.168.0.2:1 192.168.0.4:1 192.168.0.5:1 |
+--++
4 rows in set (0.050 sec)
```
### 2. sum pv
```
CREATE AGGREGATE FUNCTION rpc_sum(bigint) RETURNS bigint PROPERTIES (
"TYPE"="RPC",
"OBJECT_FILE"="127.0.0.1:9700",
"update_fn"="rpc_sum_update",
"merge_fn"="rpc_sum_merge",
"finalize_fn"="rpc_sum_finalize"
);
MySQL [test_db]> select citycode, rpc_sum(pv) from table2 group by citycode;
+--+---+
| citycode | rpc_sum(`pv`) |
+--+---+
| 15 | 564 |
| 11 | 195 |
| 12 | 612 |
| 16 | 237 |
+--+---+
4 rows in set (0.067 sec)
MySQL [test_db]> select rpc_sum(pv) from table2;
+---+
| rpc_sum(`pv`) |
+---+
| 1608 |
+---+
1 row in set (0.030 sec)
```
### 3. avg pv
```
CREATE AGGREGATE FUNCTION rpc_avg(int) RETURNS double PROPERTIES (
"TYPE"="RPC",
"OBJECT_FILE"="127.0.0.1:9000",
"update_fn"="rpc_avg_update",
"merge_fn"="rpc_avg_merge",
"finalize_fn"="rpc_avg_finalize"
);
MySQL [test_db]> select citycode, rpc_avg(pv) from table2 group by citycode;
+--+---+
| cit
[GitHub] [doris] github-actions[bot] commented on pull request #11759: [doc](data-model) update english title
github-actions[bot] commented on PR #11759: URL: https://github.com/apache/doris/pull/11759#issuecomment-1214165014 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #11741: [docs](fix)[fix some error path]
github-actions[bot] commented on PR #11741: URL: https://github.com/apache/doris/pull/11741#issuecomment-1214166040 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #11014: A small tip during installation and deployment
github-actions[bot] commented on PR #11014: URL: https://github.com/apache/doris/pull/11014#issuecomment-1214166457 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] chenlinzhong opened a new pull request, #11761: [remote-udaf](sample) add some c++ demo
chenlinzhong opened a new pull request, #11761:
URL: https://github.com/apache/doris/pull/11761
# Proposed changes
Issue Number: close #xxx
## Problem summary
```
//create one table such as table2
CREATE TABLE `table2` (
`event_day` date NULL,
`siteid` int(11) NULL DEFAULT "10",
`citycode` smallint(6) NULL,
`visitinfo` varchar(1024) NULL DEFAULT "",
`pv` varchar(1024) REPLACE NULL DEFAULT "0"
) ENGINE=OLAP
AGGREGATE KEY(`event_day`, `siteid`, `citycode`, `visitinfo`)
COMMENT 'OLAP'
DISTRIBUTED BY HASH(`siteid`) BUCKETS 10
PROPERTIES (
"replication_allocation" = "tag.location.default: 1",
"in_memory" = "false",
"storage_format" = "V2"
)
//import some data
MySQL [test_db]> select * from table2;
+++--++--+
| event_day | siteid | citycode | visitinfo | pv
|
+++--++--+
| 2017-07-03 | 8 | 12 | {"ip":"192.168.0.5","source":"pc"} | 81
|
| 2017-07-03 | 37 | 12 | {"ip":"192.168.0.3","source":"pc"} | 81
|
| 2017-07-03 | 67 | 16 | {"ip":"192.168.0.2","source":"pc"} | 79
|
| 2017-07-03 |101 | 11 | {"ip":"192.168.0.5","source":"pc"} | 65
|
| 2017-07-03 | 32 | 15 | {"ip":"192.168.0.1","source":"pc"} | 188
|
| 2017-07-03 |103 | 12 | {"ip":"192.168.0.5","source":"pc"} | 123
|
| 2017-07-03 |104 | 16 | {"ip":"192.168.0.5","source":"pc"} | 79
|
| 2017-07-03 | 3 | 12 | {"ip":"192.168.0.3","source":"pc"} | 123
|
| 2017-07-03 | 3 | 15 | {"ip":"192.168.0.2","source":"pc"} | 188
|
| 2017-07-03 | 13 | 11 | {"ip":"192.168.0.1","source":"pc"} | 65
|
| 2017-07-03 | 53 | 12 | {"ip":"192.168.0.2","source":"pc"} | 123
|
| 2017-07-03 | 1 | 11 | {"ip":"192.168.0.1","source":"pc"} | 65
|
| 2017-07-03 | 7 | 16 | {"ip":"192.168.0.4","source":"pc"} | 79
|
| 2017-07-03 |102 | 15 | {"ip":"192.168.0.5","source":"pc"} | 188
|
| 2017-07-03 |105 | 12 | {"ip":"192.168.0.5","source":"pc"} | 81
|
+++--++--+
```
### 1. find most visit top 3 ip
not implement this demo in c++, if you are interested in this demo you can
reference python/java implement
```
MySQL [test_db]> CREATE AGGREGATE FUNCTION
rpc_count_visit_info(varchar(1024)) RETURNS varchar(1024) PROPERTIES (
"TYPE"="RPC",
"OBJECT_FILE"="127.0.0.1:9000",
"update_fn"="rpc_count_visit_info_update",
"merge_fn"="rpc_count_visit_info_merge",
"finalize_fn"="rpc_count_visit_info_finalize"
);
MySQL [test_db]> select rpc_count_visit_info(visitinfo) from table2;
++
| rpc_count_visit_info(`visitinfo`) |
++
| 192.168.0.5:6 192.168.0.2:3 192.168.0.1:3 |
++
1 row in set (0.036 sec)
MySQL [test_db]> select citycode, rpc_count_visit_info(visitinfo) from
table2 group by citycode;
+--++
| citycode | rpc_count_visit_info(`visitinfo`) |
+--++
| 15 | 192.168.0.2:1 192.168.0.1:1 192.168.0.5:1 |
| 11 | 192.168.0.1:2 192.168.0.5:1|
| 12 | 192.168.0.5:3 192.168.0.3:2 192.168.0.2:1 |
| 16 | 192.168.0.2:1 192.168.0.4:1 192.168.0.5:1 |
+--++
4 rows in set (0.050 sec)
```
### 2. sum pv
```
CREATE AGGREGATE FUNCTION rpc_sum(bigint) RETURNS bigint PROPERTIES (
"TYPE"="RPC",
"OBJECT_FILE"="127.0.0.1:9700",
"update_fn"="rpc_sum_update",
"merge_fn"="rpc_sum_merge",
"finalize_fn"="rpc_sum_finalize"
);
MySQL [test_db]> select citycode, rpc_sum(pv) from table2 group by citycode;
+--+---+
| citycode | rpc_sum(`pv`) |
+--+---+
| 15 | 564 |
| 11 | 195 |
| 12 | 612 |
| 16 | 237 |
+--+---+
4 rows in set (0.067 sec)
MySQL [test_db]> select rpc_sum(pv) from table2;
+---+
| rpc_sum(`pv`) |
+---+
| 1608 |
+---+
1 row in set (0.030 sec)
```
### 3. avg pv
```
CREATE AGGREGATE FUNCTION rpc_avg(int) RETURNS double PROPERTIES (
"TYPE"="RPC",
"OBJECT_FILE"="127.0.0.1:9000",
"update_fn"="rpc_avg_update",
"merge_fn"="rpc_avg_merge",
"finalize_fn"="rpc_avg_finalize"
);
[doris-website] branch master updated: fix
This is an automated email from the ASF dual-hosted git repository. jiafengzheng pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris-website.git The following commit(s) were added to refs/heads/master by this push: new 1f55ce50f7f fix 1f55ce50f7f is described below commit 1f55ce50f7f0eabe5b9a5f4ce418a23e716677b3 Author: jiafeng.zhang AuthorDate: Sat Aug 13 22:39:28 2022 +0800 fix --- .github/workflows/cron-deploy-website.yml | 2 +- .github/workflows/manual-deploy-website.yml | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/.github/workflows/cron-deploy-website.yml b/.github/workflows/cron-deploy-website.yml index f177aa2daee..7ab2e572a78 100644 --- a/.github/workflows/cron-deploy-website.yml +++ b/.github/workflows/cron-deploy-website.yml @@ -29,7 +29,7 @@ jobs: cp -R doris/docs/en/community . cp -R doris/docs/zh-CN/community/* i18n/zh-CN/docusaurus-plugin-content-docs-community/current/ -cp -R doris/docs/images/* static/images/ +cp -R doris/docs/images static/ npm install -g yarn yarn cache clean yarn && yarn build diff --git a/.github/workflows/manual-deploy-website.yml b/.github/workflows/manual-deploy-website.yml index 82010dab0ac..e94b49dbe5c 100644 --- a/.github/workflows/manual-deploy-website.yml +++ b/.github/workflows/manual-deploy-website.yml @@ -33,7 +33,7 @@ jobs: cp -R doris/docs/en/community . cp -R doris/docs/zh-CN/community/* i18n/zh-CN/docusaurus-plugin-content-docs-community/current/ -cp -R doris/docs/images/* static/images/ +cp -R doris/docs/images static/ npm install -g yarn yarn cache clean yarn && yarn build - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hf200012 opened a new pull request, #11762: [typo](doc)Solve the problem that the official website of the document fails to compile and publish
hf200012 opened a new pull request, #11762: URL: https://github.com/apache/doris/pull/11762 # Proposed changes Issue Number: close #xxx ## Problem summary Describe your changes. ## Checklist(Required) 1. Does it affect the original behavior: - [ ] Yes - [ ] No - [ ] I don't know 2. Has unit tests been added: - [ ] Yes - [ ] No - [ ] No Need 3. Has document been added or modified: - [ ] Yes - [ ] No - [ ] No Need 4. Does it need to update dependencies: - [ ] Yes - [ ] No 5. Are there any changes that cannot be rolled back: - [ ] Yes (If Yes, please explain WHY) - [ ] No ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #11762: [typo](doc)Solve the problem that the official website of the document fails to compile and publish
github-actions[bot] commented on PR #11762: URL: https://github.com/apache/doris/pull/11762#issuecomment-1214179133 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #11762: [typo](doc)Solve the problem that the official website of the document fails to compile and publish
github-actions[bot] commented on PR #11762: URL: https://github.com/apache/doris/pull/11762#issuecomment-1214179123 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hf200012 merged pull request #11762: [typo](doc)Solve the problem that the official website of the document fails to compile and publish
hf200012 merged PR #11762: URL: https://github.com/apache/doris/pull/11762 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated: [typo](doc)Solve the problem that the official website of the document fails to compile and publish (#11762)
This is an automated email from the ASF dual-hosted git repository.
jiafengzheng pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 43ff796419 [typo](doc)Solve the problem that the official website of
the document fails to compile and publish (#11762)
43ff796419 is described below
commit 43ff796419df5f196b3335f5389ae6d2aacf67c6
Author: jiafeng.zhang
AuthorDate: Sat Aug 13 23:47:17 2022 +0800
[typo](doc)Solve the problem that the official website of the document
fails to compile and publish (#11762)
Solve the problem that the official website of the document fails to
compile and publish
---
docs/zh-CN/docs/ecosystem/cloudcanal.md| 16 ++---
.../ecosystem/doris-manager/cluster-managenent.md | 10 ++--
docs/zh-CN/docs/ecosystem/flink-doris-connector.md | 68 +-
3 files changed, 41 insertions(+), 53 deletions(-)
diff --git a/docs/zh-CN/docs/ecosystem/cloudcanal.md
b/docs/zh-CN/docs/ecosystem/cloudcanal.md
index d58e96b740..a1e7b23228 100644
--- a/docs/zh-CN/docs/ecosystem/cloudcanal.md
+++ b/docs/zh-CN/docs/ecosystem/cloudcanal.md
@@ -29,7 +29,7 @@ under the License.
## 介绍
CloudCanal 社区版是一款由 [ClouGence 公司](https://www.clougence.com)
发行的集结构迁移、数据全量迁移/校验/订正、增量实时同步为一体的免费数据迁移同步平台。产品包含完整的产品化能力，助力企业打破数据孤岛、完成数据互融互通，从而更好的使用数据。
-
+
## 下载安装
@@ -65,7 +65,7 @@ CloudCanal 提供了完整的产品化能力，用户在可视化界面完成数
- 数据源管理-> 新增数据源
- 选择自建数据库中 Doris
-
+
> Tips:
>
@@ -81,31 +81,31 @@ CloudCanal 提供了完整的产品化能力，用户在可视化界面完成数
- 选择 **源** 和 **目标** 数据库
- 点击 下一步
-
+
- 选择 **增量同步**，并且启用 **全量数据初始化**
- 不勾选 DDL 同步(暂不支持)
- 点击下一步
-
+
- 选择订阅的表，**结构迁移自动创建的表为主键模型的表，因此暂不支持无主键表**
- 点击下一步
-
+
- 配置列映射
- 点击下一步
-
+
- 创建任务
-
+
- 查看任务状态。任务创建后，会自动完成结构迁移、全量、增量阶段。
-
+
## 参考资料
diff --git a/docs/zh-CN/docs/ecosystem/doris-manager/cluster-managenent.md
b/docs/zh-CN/docs/ecosystem/doris-manager/cluster-managenent.md
index 01d24675cb..bface60439 100644
--- a/docs/zh-CN/docs/ecosystem/doris-manager/cluster-managenent.md
+++ b/docs/zh-CN/docs/ecosystem/doris-manager/cluster-managenent.md
@@ -40,7 +40,7 @@ under the License.
进入首页，点击导航栏中的“集群”，进入集群功能。
-
+
运维监控面板提供集群的各类性能监控指标，供用户洞察集群状态。用户可以在右上角通过按钮控制集群的启动和停止操作。
@@ -53,17 +53,17 @@ under the License.
展示集群中FE节点、BE节点和Broker相关信息。
提供包括节点ID、节点类型、主机IP以及节点状态字段。
-
+
## 参数配置
参数配置提供参数名称、参数类型、参数值类型、热生效和操作字段。
-
+
- **操作**：点击“编辑”按钮，可编辑修改对应配置值，可以选择对应的生效方式；点击“查看当前值”按钮，可查看主机IP对应当前值
-
+
-
+
diff --git a/docs/zh-CN/docs/ecosystem/flink-doris-connector.md
b/docs/zh-CN/docs/ecosystem/flink-doris-connector.md
index 55ba3bc4cf..77a1301ec8 100644
--- a/docs/zh-CN/docs/ecosystem/flink-doris-connector.md
+++ b/docs/zh-CN/docs/ecosystem/flink-doris-connector.md
@@ -117,7 +117,10 @@ sh build.sh --flink 1.14.3 --scala 2.12
**备注**
-1. Doris FE 要在配置fe.conf中启用 http v2, 0.15版本之后默认开启
+1. Doris FE 要在配置中配置启用 http v2
+
+ conf/fe.conf
+
```
enable_http_server_v2 = true
```
@@ -153,17 +156,6 @@ enable_http_server_v2 = true
provided
-
-
- org.slf4j
- slf4j-api
- ${slf4j.version}
-
-
- org.slf4j
- slf4j-log4j12
- ${slf4j.version}
-
org.apache.doris
@@ -347,30 +339,28 @@ source.sinkTo(builder.build());
### 通用配置项
-| Key | Default Value | Required | Comment
[GitHub] [doris] hf200012 opened a new pull request, #11764: 【typo](doc) Fix sidebar version
hf200012 opened a new pull request, #11764: URL: https://github.com/apache/doris/pull/11764 # Proposed changes Issue Number: close #xxx ## Problem summary Describe your changes. ## Checklist(Required) 1. Does it affect the original behavior: - [ ] Yes - [ ] No - [ ] I don't know 2. Has unit tests been added: - [ ] Yes - [ ] No - [ ] No Need 3. Has document been added or modified: - [ ] Yes - [ ] No - [ ] No Need 4. Does it need to update dependencies: - [ ] Yes - [ ] No 5. Are there any changes that cannot be rolled back: - [ ] Yes (If Yes, please explain WHY) - [ ] No ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #11764: [typo](doc) Fix sidebar version
github-actions[bot] commented on PR #11764: URL: https://github.com/apache/doris/pull/11764#issuecomment-1214213281 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #11764: [typo](doc) Fix sidebar version
github-actions[bot] commented on PR #11764: URL: https://github.com/apache/doris/pull/11764#issuecomment-1214213284 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hf200012 merged pull request #11764: [typo](doc) Fix sidebar version
hf200012 merged PR #11764: URL: https://github.com/apache/doris/pull/11764 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated: [typo](doc) Fix sidebar version (#11764)
This is an automated email from the ASF dual-hosted git repository.
jiafengzheng pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 0333261a75 [typo](doc) Fix sidebar version (#11764)
0333261a75 is described below
commit 0333261a7571abe5fbbde770ec5b5dee01294e2b
Author: jiafeng.zhang
AuthorDate: Sun Aug 14 07:41:16 2022 +0800
[typo](doc) Fix sidebar version (#11764)
fix sidebar version
---
docs/dev.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/dev.json b/docs/dev.json
index 730292f519..fda8436369 100644
--- a/docs/dev.json
+++ b/docs/dev.json
@@ -1,6 +1,6 @@
{
"version.label": {
-"message": "1.1",
+"message": "dev",
"description": "The label for version current"
},
"sidebar.docs.category.Getting Started": {
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hf200012 merged pull request #11759: [doc](data-model) update english title
hf200012 merged PR #11759: URL: https://github.com/apache/doris/pull/11759 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated: update english doc (#11759)
This is an automated email from the ASF dual-hosted git repository. jiafengzheng pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris.git The following commit(s) were added to refs/heads/master by this push: new 6d56755336 update english doc (#11759) 6d56755336 is described below commit 6d56755336f0edc13976b6531ad3fc155a1c6fe3 Author: wudi <676366...@qq.com> AuthorDate: Sun Aug 14 07:42:50 2022 +0800 update english doc (#11759) update english doc --- docs/en/docs/data-table/data-model.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/en/docs/data-table/data-model.md b/docs/en/docs/data-table/data-model.md index 8d80110323..49299404ca 100644 --- a/docs/en/docs/data-table/data-model.md +++ b/docs/en/docs/data-table/data-model.md @@ -24,9 +24,9 @@ specific language governing permissions and limitations under the License. --> -# Data Model, ROLLUP and Prefix Index +# Data Model -This document describes Doris's data model, ROLLUP and prefix index concepts at the logical level to help users better use Doris to cope with different business scenarios. +This document describes Doris's data model at the logical level to help users better use Doris to cope with different business scenarios. ## Basic concepts - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] morningman commented on a diff in pull request #11625: [Enhancement](load) add hidden_columns in stream load param
morningman commented on code in PR #11625:
URL: https://github.com/apache/doris/pull/11625#discussion_r945214836
##
fe/fe-core/src/main/java/org/apache/doris/task/StreamLoadTask.java:
##
@@ -320,6 +328,9 @@ private void
setOptionalFromTSLPutRequest(TStreamLoadPutRequest request) throws
if (request.isSetLoadToSingleTablet()) {
loadToSingleTablet = request.isLoadToSingleTablet();
}
+if (request.isSetHiddenColumns()) {
+hiddenColumns =
Arrays.asList(request.getHiddenColumns().split(","));
Review Comment:
Need to trim the space, eg:
`"delete, sequence" => "delete,sequence"`
##
docs/en/docs/sql-manual/sql-reference/Data-Manipulation-Statements/Load/STREAM-LOAD.md:
##
@@ -136,6 +136,14 @@ Parameter introduction:
21. send_batch_parallelism: Integer, used to set the parallelism of sending
batch data. If the value of parallelism exceeds
`max_send_batch_parallelism_per_job` in the BE configuration, the BE as a
coordination point will use the value of `max_send_batch_parallelism_per_job`.
+22. hidden_columns: Specify hidden column when no `columns` in Headers，multi
hidden column shoud be
+separated by commas。
+
+ ```
+ hidden_columns: __DORIS_DELETE_SIGN__
Review Comment:
Please also give the example for `__DORIS_SEQUENCE_COL__`.
Or use may not known the name of this hidden column.
And the following header will result in different:
```
hidden_columns: __DORIS_DELETE_SIGN__,__DORIS_SEQUENCE_COL__
hidden_columns: __DORIS_SEQUENCE_COL__,__DORIS_DELETE_SIGN__
```
My suggestion is:
1. User can specify the hidden columns in different order.
2. The system will reorder the hidden columns specified by user, put
`__DORIS_DELETE_SIGN__` at first and `__DORIS_SEQUENCE_COL__` at last.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yaoyi opened a new issue, #11765: 请问in查询是不是不支持多个字段?
yaoyi opened a new issue, #11765: URL: https://github.com/apache/doris/issues/11765 ### Discussed in https://github.com/apache/doris/discussions/11763 Originally posted by **yaoyi** August 13, 2022 比如 ```sql SELECT id FROM t1 WHERE (c1, c2) IN ((1, 2)); ``` 报错: Encountered: COMMA Expected: || -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #11494: [feature](schema change) Light schema change support rollup/mv
github-actions[bot] commented on PR #11494: URL: https://github.com/apache/doris/pull/11494#issuecomment-1214265111 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #11494: [feature](schema change) Light schema change support rollup/mv
github-actions[bot] commented on PR #11494: URL: https://github.com/apache/doris/pull/11494#issuecomment-1214265109 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris-website] branch asf-site updated: Automated deployment with doris branch @ 1f55ce50f7f0eabe5b9a5f4ce418a23e716677b3
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 3fb852e3274 Automated deployment with doris branch @
1f55ce50f7f0eabe5b9a5f4ce418a23e716677b3
3fb852e3274 is described below
commit 3fb852e32743d0cd34f3c5849e55bcb0ca779af8
Author: github-actions[bot]
AuthorDate: Sun Aug 14 02:01:28 2022 +
Automated deployment with doris branch @
1f55ce50f7f0eabe5b9a5f4ce418a23e716677b3
---
.asf.yaml | 2 --
.dummy| 0
docs/0.15/search-index.json | 2 +-
docs/1.0/search-index.json| 2 +-
docs/dev/search-index.json| 2 +-
remove-non-reserved-dir.sh| 39 ---
search-index.json | 2 +-
versions.json | 38 --
zh-CN/docs/0.15/search-index.json | 2 +-
zh-CN/docs/1.0/search-index.json | 2 +-
zh-CN/docs/dev/search-index.json | 2 +-
zh-CN/search-index.json | 2 +-
12 files changed, 8 insertions(+), 87 deletions(-)
diff --git a/.asf.yaml b/.asf.yaml
deleted file mode 100644
index 123ff86d51c..000
--- a/.asf.yaml
+++ /dev/null
@@ -1,2 +0,0 @@
-publish:
- whoami: asf-site
diff --git a/.dummy b/.dummy
new file mode 100644
index 000..e69de29bb2d
diff --git a/docs/0.15/search-index.json b/docs/0.15/search-index.json
index bf43ff2fb6d..bfb6e1bcf92 100644
--- a/docs/0.15/search-index.json
+++ b/docs/0.15/search-index.json
@@ -1 +1 @@
-[{"documents":[{"i":19882,"t":"Bitmap
Index","u":"/docs/0.15/administrator-guide/alter-table/alter-table-bitmap-index","b":["Docs","Administrator
Guide","Schema Change"]},{"i":19898,"t":"Replace
Table","u":"/docs/0.15/administrator-guide/alter-table/alter-table-replace-table","b":["Docs","Administrator
Guide","Schema
Change"]},{"i":19908,"t":"Rollup","u":"/docs/0.15/administrator-guide/alter-table/alter-table-rollup","b":["Docs","Administrator
Guide","Schema Change"]},{"i":19929,"t":"Tem [...]
\ No newline at end of file
+[{"documents":[{"i":19882,"t":"Bitmap
Index","u":"/docs/0.15/administrator-guide/alter-table/alter-table-bitmap-index","b":["Docs","Administrator
Guide","Schema Change"]},{"i":19898,"t":"Replace
Table","u":"/docs/0.15/administrator-guide/alter-table/alter-table-replace-table","b":["Docs","Administrator
Guide","Schema
Change"]},{"i":19908,"t":"Rollup","u":"/docs/0.15/administrator-guide/alter-table/alter-table-rollup","b":["Docs","Administrator
Guide","Schema Change"]},{"i":19929,"t":"Sch [...]
\ No newline at end of file
diff --git a/docs/1.0/search-index.json b/docs/1.0/search-index.json
index 1973804c440..2f2f21577ac 100644
--- a/docs/1.0/search-index.json
+++ b/docs/1.0/search-index.json
@@ -1 +1 @@
-[{"documents":[{"i":13529,"t":"Bitmap
Index","u":"/docs/1.0/administrator-guide/alter-table/alter-table-bitmap-index","b":["Docs","Administrator
Guide","Schema Change"]},{"i":13545,"t":"Replace
Table","u":"/docs/1.0/administrator-guide/alter-table/alter-table-replace-table","b":["Docs","Administrator
Guide","Schema
Change"]},{"i":13555,"t":"Rollup","u":"/docs/1.0/administrator-guide/alter-table/alter-table-rollup","b":["Docs","Administrator
Guide","Schema Change"]},{"i":13576,"t":"Schema [...]
\ No newline at end of file
+[{"documents":[{"i":13529,"t":"Bitmap
Index","u":"/docs/1.0/administrator-guide/alter-table/alter-table-bitmap-index","b":["Docs","Administrator
Guide","Schema Change"]},{"i":13545,"t":"Replace
Table","u":"/docs/1.0/administrator-guide/alter-table/alter-table-replace-table","b":["Docs","Administrator
Guide","Schema
Change"]},{"i":13555,"t":"Rollup","u":"/docs/1.0/administrator-guide/alter-table/alter-table-rollup","b":["Docs","Administrator
Guide","Schema Change"]},{"i":13576,"t":"Schema [...]
\ No newline at end of file
diff --git a/docs/dev/search-index.json b/docs/dev/search-index.json
index 46c33ae395f..8a4c90c3148 100644
--- a/docs/dev/search-index.json
+++ b/docs/dev/search-index.json
@@ -1 +1 @@
-[{"documents":[{"i":6677,"t":"Elastic
scaling","u":"/docs/dev/admin-manual/cluster-management/elastic-expansion","b":["Docs","Admin
Manual","cluster management"]},{"i":6693,"t":"load
balancing","u":"/docs/dev/admin-manual/cluster-management/load-balancing","b":["Docs","Admin
Manual","cluster management"]},{"i":6720,"t":"Cluster
upgrade","u":"/docs/dev/admin-manual/cluster-management/upgrade","b":["Docs","Admin
Manual","cluster management"]},{"i":6734,"t":"FE Configuration","u":"/docs/dev
[...]
\ No newline at end of file
+[{"documents":[{"i":6677,"t":"Elastic
scaling","u":"/docs/dev/admin-manual/cluster-management/elastic-expansion","b":["Docs","Admin
Manual","cluster management"]},{"i":6693,"t":"load
balancing","u":"/docs/dev/admin-manual/cluster-management/load-balancing","b":["Docs","Ad
[GitHub] [doris] yiguolei commented on a diff in pull request #11754: [fix](delete) fix query result error after delete
yiguolei commented on code in PR #11754:
URL: https://github.com/apache/doris/pull/11754#discussion_r945221172
##
be/src/olap/rowset/segment_v2/segment_iterator.cpp:
##
@@ -1199,6 +1199,34 @@ Status SegmentIterator::next_batch(vectorized::Block*
block) {
return Status::OK();
}
+void SegmentIterator::_convert_dict_code_for_predicate_if_necessary() {
+for (auto predicate : _short_cir_eval_predicate) {
+_convert_dict_code_for_predicate_if_necessary_impl(predicate);
+}
+
+for (auto predicate : _pre_eval_block_predicate) {
+_convert_dict_code_for_predicate_if_necessary_impl(predicate);
+}
+
+std::set predicate_set {};
+_opts.delete_condition_predicates->get_all_column_predicate(predicate_set);
+for (const auto column_predicate : predicate_set) {
Review Comment:
Could you please also check if dev-1.1.2 also have this problem?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch dev-1.1.2 updated: [Bug](date function) Return null if date format is invalid (#11720)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch dev-1.1.2
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/dev-1.1.2 by this push:
new c60ae0f501 [Bug](date function) Return null if date format is invalid
(#11720)
c60ae0f501 is described below
commit c60ae0f5018843ff6112ff3c054ecc9a71fa31d0
Author: Gabriel
AuthorDate: Fri Aug 12 14:07:55 2022 +0800
[Bug](date function) Return null if date format is invalid (#11720)
---
be/src/vec/runtime/vdatetime_value.cpp | 5 -
1 file changed, 4 insertions(+), 1 deletion(-)
diff --git a/be/src/vec/runtime/vdatetime_value.cpp
b/be/src/vec/runtime/vdatetime_value.cpp
index fc2a93e6b6..60df6e4205 100644
--- a/be/src/vec/runtime/vdatetime_value.cpp
+++ b/be/src/vec/runtime/vdatetime_value.cpp
@@ -984,7 +984,10 @@ static bool str_to_int64(const char* ptr, const char**
endptr, int64_t* ret) {
n_end = end;
}
uint64_t value_1 = 0;
-while (ptr < n_end && isdigit(*ptr)) {
+while (ptr < n_end) {
+if (!isdigit(*ptr)) {
+return false;
+}
value_1 *= 10;
value_1 += *ptr++ - '0';
}
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch dev-1.1.2 updated: 1.1.2-rc03
This is an automated email from the ASF dual-hosted git repository. yiguolei pushed a commit to branch dev-1.1.2 in repository https://gitbox.apache.org/repos/asf/doris.git The following commit(s) were added to refs/heads/dev-1.1.2 by this push: new 96d86cbbbd 1.1.2-rc03 96d86cbbbd is described below commit 96d86cbbbdc7c6d3c24b319510483e11aa26bea4 Author: yiguolei AuthorDate: Sun Aug 14 11:05:18 2022 +0800 1.1.2-rc03 --- gensrc/script/gen_build_version.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/gensrc/script/gen_build_version.sh b/gensrc/script/gen_build_version.sh index bfec98dd38..52e1c3c1b9 100755 --- a/gensrc/script/gen_build_version.sh +++ b/gensrc/script/gen_build_version.sh @@ -25,7 +25,7 @@ # contains the build version based on the git hash or svn revision. ## -build_version="1.1.2-rc02" +build_version="1.1.2-rc03" unset LANG unset LC_CTYPE - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris-website] branch master updated: version sort
This is an automated email from the ASF dual-hosted git repository.
jiafengzheng pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push:
new 5d97fb3708d version sort
5d97fb3708d is described below
commit 5d97fb3708d9d4c69ed1fd61be282d0eeb3d9b42
Author: jiafeng.zhang
AuthorDate: Sun Aug 14 11:33:32 2022 +0800
version sort
version sort
---
docusaurus.config.js | 8
versions.json| 4 ++--
2 files changed, 6 insertions(+), 6 deletions(-)
diff --git a/docusaurus.config.js b/docusaurus.config.js
index 68ddb5e763b..69c4ba648d6 100644
--- a/docusaurus.config.js
+++ b/docusaurus.config.js
@@ -117,15 +117,15 @@ const config = {
label: '1.1',
path: '',
},
-'dev': {
-banner: 'none',
-},
'1.0': {
banner: 'none',
},
-0.15: {
+'0.15': {
banner: 'none',
},
+'dev': {
+banner: 'none',
+}
},
sidebarPath: require.resolve('./sidebars.json'),
onlyIncludeVersions:
diff --git a/versions.json b/versions.json
index 9a14c24a722..323db28b754 100644
--- a/versions.json
+++ b/versions.json
@@ -1,5 +1,5 @@
[
- "dev",
"1.0",
- "0.15"
+ "0.15",
+ "dev"
]
\ No newline at end of file
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] wangbo commented on a diff in pull request #11754: [fix](delete) fix query result error after delete
wangbo commented on code in PR #11754:
URL: https://github.com/apache/doris/pull/11754#discussion_r945225567
##
be/src/olap/rowset/segment_v2/segment_iterator.cpp:
##
@@ -1199,6 +1199,34 @@ Status SegmentIterator::next_batch(vectorized::Block*
block) {
return Status::OK();
}
+void SegmentIterator::_convert_dict_code_for_predicate_if_necessary() {
+for (auto predicate : _short_cir_eval_predicate) {
+_convert_dict_code_for_predicate_if_necessary_impl(predicate);
+}
+
+for (auto predicate : _pre_eval_block_predicate) {
+_convert_dict_code_for_predicate_if_necessary_impl(predicate);
+}
+
+std::set predicate_set {};
+_opts.delete_condition_predicates->get_all_column_predicate(predicate_set);
Review Comment:
How about keep predicate_set as field of SegmentIterator so we don't need
get them for every batch?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] wangbo commented on a diff in pull request #11754: [fix](delete) fix query result error after delete
wangbo commented on code in PR #11754:
URL: https://github.com/apache/doris/pull/11754#discussion_r945225567
##
be/src/olap/rowset/segment_v2/segment_iterator.cpp:
##
@@ -1199,6 +1199,34 @@ Status SegmentIterator::next_batch(vectorized::Block*
block) {
return Status::OK();
}
+void SegmentIterator::_convert_dict_code_for_predicate_if_necessary() {
+for (auto predicate : _short_cir_eval_predicate) {
+_convert_dict_code_for_predicate_if_necessary_impl(predicate);
+}
+
+for (auto predicate : _pre_eval_block_predicate) {
+_convert_dict_code_for_predicate_if_necessary_impl(predicate);
+}
+
+std::set predicate_set {};
+_opts.delete_condition_predicates->get_all_column_predicate(predicate_set);
Review Comment:
How about keep predicate_set as field of SegmentIterator so we don't need
get them for every batch?
We can get the info that which Predicate is range and its id including
delete pred or non-predicate in ```_vec_init_lazy_materialization```, then in
```_convert_dict_code_for_predicate_if_necessary``` we just get id and exec
```convert_dict_codes_if_necessary```.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #11745: [FIX](function)fix max_by function bug
github-actions[bot] commented on PR #11745: URL: https://github.com/apache/doris/pull/11745#issuecomment-1214290937 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
