[GitHub] [incubator-doris] weizhengte commented on a diff in pull request #8859: [feature-wip](statistics) step2: schedule the statistics job and generate executable tasks

2022-04-21 Thread GitBox
weizhengte commented on code in PR #8859: URL: https://github.com/apache/incubator-doris/pull/8859#discussion_r854838261 ## fe/fe-core/src/main/java/org/apache/doris/statistics/StatisticsJob.java: ## @@ -18,62 +18,200 @@ package org.apache.doris.statistics; import org.apache

[GitHub] [incubator-doris] weizhengte commented on a diff in pull request #8859: [feature-wip](statistics) step2: schedule the statistics job and generate executable tasks

2022-04-21 Thread GitBox
weizhengte commented on code in PR #8859: URL: https://github.com/apache/incubator-doris/pull/8859#discussion_r854889779 ## fe/fe-core/src/main/java/org/apache/doris/statistics/StatisticsJob.java: ## @@ -18,62 +18,200 @@ package org.apache.doris.statistics; import org.apache

[GitHub] [incubator-doris] dataalive commented on issue #9149: [Bug] access tablet -214, missed version for version —— 1.0.0-rc3

2022-04-21 Thread GitBox
dataalive commented on issue #9149: URL: https://github.com/apache/incubator-doris/issues/9149#issuecomment-1104859653 refer to [https://doris.apache.org/faq/error.html#e9-214-error](url) to see if it helps? -- This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [incubator-doris] zhengshiJ commented on a diff in pull request #8947: [feature](statistics) Statistics derivation.Step 1:ScanNode implement…

2022-04-21 Thread GitBox
zhengshiJ commented on code in PR #8947: URL: https://github.com/apache/incubator-doris/pull/8947#discussion_r854962765 ## fe/fe-core/src/main/java/org/apache/doris/statistics/BaseStatsDerive.java: ## @@ -0,0 +1,122 @@ +// Licensed to the Apache Software Foundation (ASF) under o

[GitHub] [incubator-doris] zhengshiJ commented on a diff in pull request #8947: [feature](statistics) Statistics derivation.Step 1:ScanNode implement…

2022-04-21 Thread GitBox
zhengshiJ commented on code in PR #8947: URL: https://github.com/apache/incubator-doris/pull/8947#discussion_r854963106 ## fe/fe-core/src/main/java/org/apache/doris/statistics/StatsRecursiveDerive.java: ## @@ -0,0 +1,52 @@ +// Licensed to the Apache Software Foundation (ASF) und

[GitHub] [incubator-doris] zhengshiJ commented on a diff in pull request #8947: [feature](statistics) Statistics derivation.Step 1:ScanNode implement…

2022-04-21 Thread GitBox
zhengshiJ commented on code in PR #8947: URL: https://github.com/apache/incubator-doris/pull/8947#discussion_r854963307 ## fe/fe-core/src/main/java/org/apache/doris/statistics/BaseStatsDerive.java: ## @@ -0,0 +1,122 @@ +// Licensed to the Apache Software Foundation (ASF) under o

[GitHub] [incubator-doris] yiguolei merged pull request #8510: [UDF] support RPC udaf part 1: support create RPC udaf in fe

2022-04-21 Thread GitBox
yiguolei merged PR #8510: URL: https://github.com/apache/incubator-doris/pull/8510 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@d

[incubator-doris] branch master updated: [UDF] support RPC udaf part 1: support create RPC udaf in fe (#8510)

2022-04-21 Thread yiguolei
This is an automated email from the ASF dual-hosted git repository. yiguolei pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new ae680b4248 [UDF] support RPC udaf par

[GitHub] [incubator-doris] EmmyMiao87 commented on a diff in pull request #8860: [feature-wip](statistics) step3: schedule the statistics tasks and update relevant info

2022-04-21 Thread GitBox
EmmyMiao87 commented on code in PR #8860: URL: https://github.com/apache/incubator-doris/pull/8860#discussion_r854748367 ## fe/fe-core/src/main/java/org/apache/doris/statistics/StatisticsJob.java: ## @@ -18,62 +18,200 @@ package org.apache.doris.statistics; import org.apache

[incubator-doris] branch revert-8857-fix-out-join created (now c4a48bc4ad)

2022-04-21 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch revert-8857-fix-out-join in repository https://gitbox.apache.org/repos/asf/incubator-doris.git at c4a48bc4ad Revert "[Fix bug] fix non-equal out join is not supported (#8857)" This br

[incubator-doris] 01/01: Revert "[Fix bug] fix non-equal out join is not supported (#8857)"

2022-04-21 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch revert-8857-fix-out-join in repository https://gitbox.apache.org/repos/asf/incubator-doris.git commit c4a48bc4adfe4bd38398bba4cb7d43feb5005df4 Author: Mingyu Chen AuthorDate: Thu Apr 21 17:50

[GitHub] [incubator-doris] morningman opened a new pull request, #9150: Revert "[BUG] fix non-equal out join is not supported"

2022-04-21 Thread GitBox
morningman opened a new pull request, #9150: URL: https://github.com/apache/incubator-doris/pull/9150 Reverts apache/incubator-doris#8857 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[GitHub] [incubator-doris] Jibing-Li opened a new pull request, #9151: Support hive with HA HDFS. Pass ha configuration through hive create table properties.

2022-04-21 Thread GitBox
Jibing-Li opened a new pull request, #9151: URL: https://github.com/apache/incubator-doris/pull/9151 Support hive with HA HDFS. Pass ha configuration through hive create table properties. # Proposed changes Issue Number: close #xxx https://github.com/apache/incubator-doris/i

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9150: Revert "[BUG] fix non-equal out join is not supported"

2022-04-21 Thread GitBox
github-actions[bot] commented on PR #9150: URL: https://github.com/apache/incubator-doris/pull/9150#issuecomment-1104991381 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9150: Revert "[BUG] fix non-equal out join is not supported"

2022-04-21 Thread GitBox
github-actions[bot] commented on PR #9150: URL: https://github.com/apache/incubator-doris/pull/9150#issuecomment-1104991433 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[GitHub] [incubator-doris] EmmyMiao87 commented on a diff in pull request #8861: [feature-wip](statistics) step4: collect statistics by implementing statistics tasks

2022-04-21 Thread GitBox
EmmyMiao87 commented on code in PR #8861: URL: https://github.com/apache/incubator-doris/pull/8861#discussion_r855015238 ## fe/fe-core/src/main/java/org/apache/doris/statistics/MetaStatisticsTask.java: ## @@ -17,21 +17,84 @@ package org.apache.doris.statistics; +import org.

[GitHub] [incubator-doris] morningman merged pull request #9150: Revert "[BUG] fix non-equal out join is not supported"

2022-04-21 Thread GitBox
morningman merged PR #9150: URL: https://github.com/apache/incubator-doris/pull/9150 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[incubator-doris] branch master updated: [revert] "[Fix bug] fix non-equal out join is not supported (#8857)" (#9150)

2022-04-21 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 81ff49f8e3 [revert] "[Fix bug] fix

[GitHub] [incubator-doris] morningman opened a new pull request, #9152: [fix](fe-ut) Fix FE unit test

2022-04-21 Thread GitBox
morningman opened a new pull request, #9152: URL: https://github.com/apache/incubator-doris/pull/9152 # Proposed changes Issue Number: close #xxx ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the original beha

[GitHub] [incubator-doris] morningman commented on a diff in pull request #8982: [feature] (image tool) support image load tool

2022-04-21 Thread GitBox
morningman commented on code in PR #8982: URL: https://github.com/apache/incubator-doris/pull/8982#discussion_r855042244 ## fe/fe-core/src/main/java/org/apache/doris/PaloFe.java: ## @@ -303,6 +316,23 @@ private static void checkCommandLineOptions(CommandLineOptions cmdLineOpts)

svn commit: r53989 - /release/incubator/doris/KEYS

2022-04-21 Thread jiafengzheng
Author: jiafengzheng Date: Thu Apr 21 10:43:59 2022 New Revision: 53989 Log: Update KEYS Modified: release/incubator/doris/KEYS Modified: release/incubator/doris/KEYS == --- release/incubator/doris/KEYS (original) ++

[GitHub] [incubator-doris] Henry2SS commented on a diff in pull request #8982: [feature] (image tool) support image load tool

2022-04-21 Thread GitBox
Henry2SS commented on code in PR #8982: URL: https://github.com/apache/incubator-doris/pull/8982#discussion_r855045366 ## fe/fe-core/src/main/java/org/apache/doris/PaloFe.java: ## @@ -303,6 +316,23 @@ private static void checkCommandLineOptions(CommandLineOptions cmdLineOpts) {

[GitHub] [incubator-doris] FreeOnePlus opened a new pull request, #9153: [Refactor][doc]Unify the switch values of unconventional compilation parameters in the official documentation of the old versio

2022-04-21 Thread GitBox
FreeOnePlus opened a new pull request, #9153: URL: https://github.com/apache/incubator-doris/pull/9153 1. Unify the switch values of unconventional compilation parameters in the official documentation of the old version # Proposed changes Issue Number: close #xxx ## Problem

[GitHub] [incubator-doris] EmmyMiao87 commented on a diff in pull request #9152: [fix](fe-ut) Fix FE unit test

2022-04-21 Thread GitBox
EmmyMiao87 commented on code in PR #9152: URL: https://github.com/apache/incubator-doris/pull/9152#discussion_r855062635 ## fe/fe-core/src/test/java/org/apache/doris/analysis/ExplainTest.java: ## @@ -75,13 +72,6 @@ public void after() throws Exception { Assert.assertEqu

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8982: [feature] (image tool) support image load tool

2022-04-21 Thread GitBox
github-actions[bot] commented on PR #8982: URL: https://github.com/apache/incubator-doris/pull/8982#issuecomment-1105071773 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8982: [feature] (image tool) support image load tool

2022-04-21 Thread GitBox
github-actions[bot] commented on PR #8982: URL: https://github.com/apache/incubator-doris/pull/8982#issuecomment-1105071737 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [incubator-doris] dataroaring opened a new pull request, #9154: adjust read unit of http to optimize stream load

2022-04-21 Thread GitBox
dataroaring opened a new pull request, #9154: URL: https://github.com/apache/incubator-doris/pull/9154 # Proposed changes Issue Number: close #xxx ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the original beh

[GitHub] [incubator-doris] cambyzju commented on a diff in pull request #9147: [Feature] [Lateral-View] support outer combinator of table function

2022-04-21 Thread GitBox
cambyzju commented on code in PR #9147: URL: https://github.com/apache/incubator-doris/pull/9147#discussion_r855082368 ## be/src/exprs/table_function/table_function.h: ## @@ -99,6 +99,14 @@ class TableFunction { } bool is_outer() const { return _is_outer; } +void

[GitHub] [incubator-doris] cambyzju commented on a diff in pull request #9147: [Feature] [Lateral-View] support outer combinator of table function

2022-04-21 Thread GitBox
cambyzju commented on code in PR #9147: URL: https://github.com/apache/incubator-doris/pull/9147#discussion_r855087622 ## be/src/vec/functions/simple_function_factory.h: ## @@ -109,6 +109,13 @@ class SimpleFunctionFactory { register_function(Function::name, &Functio

[GitHub] [incubator-doris] cambyzju commented on a diff in pull request #9147: [Feature] [Lateral-View] support outer combinator of table function

2022-04-21 Thread GitBox
cambyzju commented on code in PR #9147: URL: https://github.com/apache/incubator-doris/pull/9147#discussion_r855090552 ## be/src/exprs/table_function/table_function_factory.cpp: ## @@ -92,14 +85,32 @@ const std::unordered_map, std::function()}, -{{"explode", tru

[GitHub] [incubator-doris] cambyzju commented on a diff in pull request #9147: [Feature] [Lateral-View] support outer combinator of table function

2022-04-21 Thread GitBox
cambyzju commented on code in PR #9147: URL: https://github.com/apache/incubator-doris/pull/9147#discussion_r855094379 ## be/src/exprs/table_function/table_function_factory.cpp: ## @@ -92,14 +85,32 @@ const std::unordered_map, std::function()}, -{{"explode", tru

[GitHub] [incubator-doris] BiteTheDDDDt commented on a diff in pull request #9147: [Feature] [Lateral-View] support outer combinator of table function

2022-04-21 Thread GitBox
BiteThet commented on code in PR #9147: URL: https://github.com/apache/incubator-doris/pull/9147#discussion_r855103814 ## be/src/exprs/table_function/table_function_factory.cpp: ## @@ -92,14 +85,32 @@ const std::unordered_map, std::function()}, -{{"explode",

[GitHub] [incubator-doris] Henry2SS commented on pull request #8919: [Feature] (sql digest) support sql digest

2022-04-21 Thread GitBox
Henry2SS commented on PR #8919: URL: https://github.com/apache/incubator-doris/pull/8919#issuecomment-1105108075 > Also need to update audit loader plugin: > > ``` > fe_plugins/auditloader/src/main/java/org/apache/doris/plugin/audit/AuditLoaderPlugin.java > fe_plugins/auditload

[GitHub] [incubator-doris] EmmyMiao87 commented on a diff in pull request #8861: [feature-wip](statistics) step4: collect statistics by implementing statistics tasks

2022-04-21 Thread GitBox
EmmyMiao87 commented on code in PR #8861: URL: https://github.com/apache/incubator-doris/pull/8861#discussion_r855015238 ## fe/fe-core/src/main/java/org/apache/doris/statistics/MetaStatisticsTask.java: ## @@ -17,21 +17,84 @@ package org.apache.doris.statistics; +import org.

[GitHub] [incubator-doris] zbtzbtzbt commented on a diff in pull request #9123: [enhancement](load) optimize load string data and dict page write

2022-04-21 Thread GitBox
zbtzbtzbt commented on code in PR #9123: URL: https://github.com/apache/incubator-doris/pull/9123#discussion_r855124864 ## be/src/olap/rowset/segment_v2/binary_plain_page.h: ## @@ -127,11 +125,16 @@ class BinaryPlainPageBuilder : public PageBuilder { return Status::OK()

[GitHub] [incubator-doris] BiteTheDDDDt commented on pull request #9147: [Feature] [Lateral-View] support outer combinator of table function

2022-04-21 Thread GitBox
BiteThet commented on PR #9147: URL: https://github.com/apache/incubator-doris/pull/9147#issuecomment-1105161800 @cambyzju fixed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [incubator-doris] zbtzbtzbt commented on a diff in pull request #9123: [enhancement](load) optimize load string data and dict page write

2022-04-21 Thread GitBox
zbtzbtzbt commented on code in PR #9123: URL: https://github.com/apache/incubator-doris/pull/9123#discussion_r855141656 ## be/src/olap/rowset/segment_v2/binary_plain_page.h: ## @@ -47,14 +47,13 @@ namespace segment_v2 { class BinaryPlainPageBuilder : public PageBuilder { publi

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9128: [enhancement](*): ignore with build_*

2022-04-21 Thread GitBox
github-actions[bot] commented on PR #9128: URL: https://github.com/apache/incubator-doris/pull/9128#issuecomment-1105165773 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9128: [enhancement](*): ignore with build_*

2022-04-21 Thread GitBox
github-actions[bot] commented on PR #9128: URL: https://github.com/apache/incubator-doris/pull/9128#issuecomment-1105165798 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[GitHub] [incubator-doris] weizhengte commented on a diff in pull request #8858: [feature-wip](statistics) step1: create the statistics job

2022-04-21 Thread GitBox
weizhengte commented on code in PR #8858: URL: https://github.com/apache/incubator-doris/pull/8858#discussion_r855175933 ## fe/fe-core/src/main/java/org/apache/doris/common/Config.java: ## @@ -1632,10 +1632,10 @@ public class Config extends ConfigBase { @ConfField(mutable =

[GitHub] [incubator-doris] qzsee opened a new pull request, #9156: [FOLLOWUP] fix non-equal out join is not supported

2022-04-21 Thread GitBox
qzsee opened a new pull request, #9156: URL: https://github.com/apache/incubator-doris/pull/9156 # Proposed changes see #9150 ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the original behavior: (Yes/No/I Don

[GitHub] [incubator-doris] HappenLee opened a new pull request, #9157: [Refactor] Refactor the code of vec stream load

2022-04-21 Thread GitBox
HappenLee opened a new pull request, #9157: URL: https://github.com/apache/incubator-doris/pull/9157 # Proposed changes Issue Number: close #xxx ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the original behav

[GitHub] [incubator-doris] morningman commented on a diff in pull request #9152: [fix](fe-ut) Fix FE unit test

2022-04-21 Thread GitBox
morningman commented on code in PR #9152: URL: https://github.com/apache/incubator-doris/pull/9152#discussion_r855326146 ## fe/fe-core/src/test/java/org/apache/doris/analysis/ExplainTest.java: ## @@ -75,13 +72,6 @@ public void after() throws Exception { Assert.assertEqu

[GitHub] [incubator-doris] morningman opened a new pull request, #9158: Hdd to ssd

2022-04-21 Thread GitBox
morningman opened a new pull request, #9158: URL: https://github.com/apache/incubator-doris/pull/9158 # Proposed changes Issue Number: close #xxx ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the original beha

[GitHub] [incubator-doris] morningman opened a new issue, #9159: [Bug] partition's storage medium change from HDD back to SSD after FE restart

2022-04-21 Thread GitBox
morningman opened a new issue, #9159: URL: https://github.com/apache/incubator-doris/issues/9159 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version 1.0

[GitHub] [incubator-doris] HappenLee commented on a diff in pull request #9147: [Feature] [Lateral-View] support outer combinator of table function

2022-04-21 Thread GitBox
HappenLee commented on code in PR #9147: URL: https://github.com/apache/incubator-doris/pull/9147#discussion_r855383532 ## be/src/exprs/table_function/table_function.h: ## @@ -30,9 +30,7 @@ namespace doris { // Currently, the memory allocated from table function is from malloc

[GitHub] [incubator-doris] HappenLee commented on a diff in pull request #9147: [Feature] [Lateral-View] support outer combinator of table function

2022-04-21 Thread GitBox
HappenLee commented on code in PR #9147: URL: https://github.com/apache/incubator-doris/pull/9147#discussion_r855384900 ## be/src/vec/functions/function_fake.cpp: ## @@ -17,18 +17,43 @@ #include "vec/functions/function_fake.h" +#include +#include +#include + namespace d

[GitHub] [incubator-doris] kkfnui opened a new issue, #9160: [Bug] `1.0.0-rc3` show routine load task raise NullPointerException when no BE scheduled for job

2022-04-21 Thread GitBox
kkfnui opened a new issue, #9160: URL: https://github.com/apache/incubator-doris/issues/9160 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version 1.0.0-r

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9131: [docs][typo] Fix some typos in "alter-table" content.

2022-04-21 Thread GitBox
github-actions[bot] commented on PR #9131: URL: https://github.com/apache/incubator-doris/pull/9131#issuecomment-1105901210 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9131: [docs][typo] Fix some typos in "alter-table" content.

2022-04-21 Thread GitBox
github-actions[bot] commented on PR #9131: URL: https://github.com/apache/incubator-doris/pull/9131#issuecomment-1105901226 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9124: [docs][typo] Fix some typos in "getting-started" content.

2022-04-21 Thread GitBox
github-actions[bot] commented on PR #9124: URL: https://github.com/apache/incubator-doris/pull/9124#issuecomment-1105902058 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9124: [docs][typo] Fix some typos in "getting-started" content.

2022-04-21 Thread GitBox
github-actions[bot] commented on PR #9124: URL: https://github.com/apache/incubator-doris/pull/9124#issuecomment-1105902039 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [incubator-doris] yangzhg commented on a diff in pull request #9123: [enhancement](load) optimize load string data and dict page write

2022-04-21 Thread GitBox
yangzhg commented on code in PR #9123: URL: https://github.com/apache/incubator-doris/pull/9123#discussion_r855703713 ## be/src/olap/rowset/segment_v2/binary_plain_page.h: ## @@ -47,14 +47,13 @@ namespace segment_v2 { class BinaryPlainPageBuilder : public PageBuilder { public:

[GitHub] [incubator-doris] yangzhg commented on a diff in pull request #9123: [enhancement](load) optimize load string data and dict page write

2022-04-21 Thread GitBox
yangzhg commented on code in PR #9123: URL: https://github.com/apache/incubator-doris/pull/9123#discussion_r855705856 ## be/src/olap/memtable.cpp: ## @@ -65,44 +75,46 @@ int MemTable::RowCursorComparator::operator()(const char* left, const char* righ return compare_row(lhs

[GitHub] [incubator-doris] yangzhg commented on a diff in pull request #9123: [enhancement](load) optimize load string data and dict page write

2022-04-21 Thread GitBox
yangzhg commented on code in PR #9123: URL: https://github.com/apache/incubator-doris/pull/9123#discussion_r855706646 ## be/src/olap/rowset/segment_v2/binary_dict_page.cpp: ## @@ -90,13 +92,18 @@ Status BinaryDictPageBuilder::add(const uint8_t* vals, size_t* count) {

[GitHub] [incubator-doris] yangzhg commented on a diff in pull request #9123: [enhancement](load) optimize load string data and dict page write

2022-04-21 Thread GitBox
yangzhg commented on code in PR #9123: URL: https://github.com/apache/incubator-doris/pull/9123#discussion_r855706783 ## be/src/olap/rowset/segment_v2/bitshuffle_page.h: ## @@ -93,13 +93,52 @@ class BitshufflePageBuilder : public PageBuilder { bool is_page_full() override {

[GitHub] [incubator-doris] yangzhg commented on a diff in pull request #9123: [enhancement](load) optimize load string data and dict page write

2022-04-21 Thread GitBox
yangzhg commented on code in PR #9123: URL: https://github.com/apache/incubator-doris/pull/9123#discussion_r855707706 ## be/src/olap/rowset/segment_v2/bitshuffle_page.h: ## @@ -93,13 +93,52 @@ class BitshufflePageBuilder : public PageBuilder { bool is_page_full() override {

[GitHub] [incubator-doris] Gabriel39 opened a new pull request, #9161: [BUG] fix compiling bug for java udf

2022-04-21 Thread GitBox
Gabriel39 opened a new pull request, #9161: URL: https://github.com/apache/incubator-doris/pull/9161 # Proposed changes Introduced by #9063 ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the original behavior:

[GitHub] [incubator-doris] zbtzbtzbt commented on a diff in pull request #9123: [enhancement](load) optimize load string data and dict page write

2022-04-21 Thread GitBox
zbtzbtzbt commented on code in PR #9123: URL: https://github.com/apache/incubator-doris/pull/9123#discussion_r855719343 ## be/src/olap/memtable.cpp: ## @@ -65,44 +75,46 @@ int MemTable::RowCursorComparator::operator()(const char* left, const char* righ return compare_row(l

[GitHub] [incubator-doris] zbtzbtzbt commented on a diff in pull request #9123: [enhancement](load) optimize load string data and dict page write

2022-04-21 Thread GitBox
zbtzbtzbt commented on code in PR #9123: URL: https://github.com/apache/incubator-doris/pull/9123#discussion_r855722235 ## be/src/olap/rowset/segment_v2/binary_plain_page.h: ## @@ -47,14 +47,13 @@ namespace segment_v2 { class BinaryPlainPageBuilder : public PageBuilder { publi

[GitHub] [incubator-doris] yiguolei commented on issue #8984: [Discussion] Remove AlphaRowset Related Code

2022-04-21 Thread GitBox
yiguolei commented on issue #8984: URL: https://github.com/apache/incubator-doris/issues/8984#issuecomment-1105947382 It's great. If we could remove alpha rowset we could remove many unused code, it will accelerate our develop speed. -- This is an automated message from the Apache Git Se

[GitHub] [incubator-doris] xy720 opened a new issue, #9162: [Bug] New coming routine load tasks are always rejected and report TOO_MANY_TASK error

2022-04-21 Thread GitBox
xy720 opened a new issue, #9162: URL: https://github.com/apache/incubator-doris/issues/9162 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version latest v

[GitHub] [incubator-doris] weizhengte commented on a diff in pull request #8860: [feature-wip](statistics) step3: schedule the statistics tasks and update relevant info

2022-04-21 Thread GitBox
weizhengte commented on code in PR #8860: URL: https://github.com/apache/incubator-doris/pull/8860#discussion_r855725739 ## fe/fe-core/src/main/java/org/apache/doris/statistics/StatisticsTaskScheduler.java: ## @@ -17,63 +17,95 @@ package org.apache.doris.statistics; +import

[GitHub] [incubator-doris] yiguolei commented on a diff in pull request #9037: [feature] add `SHOW TABLET STORAGE FORMAT` stmt

2022-04-21 Thread GitBox
yiguolei commented on code in PR #9037: URL: https://github.com/apache/incubator-doris/pull/9037#discussion_r855725802 ## docs/zh-CN/sql-reference/sql-statements/Data Manipulation/SHOW TABLET STORAGE FORMAT.md: ## @@ -0,0 +1,53 @@ +--- +{ +"title": "SHOW TABLET STORAGE FORM

[GitHub] [incubator-doris] weizhengte commented on a diff in pull request #8860: [feature-wip](statistics) step3: schedule the statistics tasks and update relevant info

2022-04-21 Thread GitBox
weizhengte commented on code in PR #8860: URL: https://github.com/apache/incubator-doris/pull/8860#discussion_r855725739 ## fe/fe-core/src/main/java/org/apache/doris/statistics/StatisticsTaskScheduler.java: ## @@ -17,63 +17,95 @@ package org.apache.doris.statistics; +import

[GitHub] [incubator-doris] yiguolei commented on a diff in pull request #9037: [feature] add `SHOW TABLET STORAGE FORMAT` stmt

2022-04-21 Thread GitBox
yiguolei commented on code in PR #9037: URL: https://github.com/apache/incubator-doris/pull/9037#discussion_r855725802 ## docs/zh-CN/sql-reference/sql-statements/Data Manipulation/SHOW TABLET STORAGE FORMAT.md: ## @@ -0,0 +1,53 @@ +--- +{ +"title": "SHOW TABLET STORAGE FORM

[GitHub] [incubator-doris] yiguolei commented on a diff in pull request #9037: [feature] add `SHOW TABLET STORAGE FORMAT` stmt

2022-04-21 Thread GitBox
yiguolei commented on code in PR #9037: URL: https://github.com/apache/incubator-doris/pull/9037#discussion_r855727400 ## docs/zh-CN/sql-reference/sql-statements/Data Manipulation/SHOW TABLET STORAGE FORMAT.md: ## @@ -0,0 +1,53 @@ +--- +{ +"title": "SHOW TABLET STORAGE FORM

[GitHub] [incubator-doris] weizhengte commented on a diff in pull request #8860: [feature-wip](statistics) step3: schedule the statistics tasks and update relevant info

2022-04-21 Thread GitBox
weizhengte commented on code in PR #8860: URL: https://github.com/apache/incubator-doris/pull/8860#discussion_r855727868 ## fe/fe-core/src/main/java/org/apache/doris/statistics/StatisticsManager.java: ## @@ -128,12 +135,47 @@ private List showTableStats(Table table) throws Anal

[GitHub] [incubator-doris] weizhengte commented on a diff in pull request #8860: [feature-wip](statistics) step3: schedule the statistics tasks and update relevant info

2022-04-21 Thread GitBox
weizhengte commented on code in PR #8860: URL: https://github.com/apache/incubator-doris/pull/8860#discussion_r855728273 ## fe/fe-core/src/main/java/org/apache/doris/statistics/StatisticsTaskResult.java: ## @@ -17,17 +17,40 @@ package org.apache.doris.statistics; +import co

[GitHub] [incubator-doris] pengxiangyu commented on a diff in pull request #8806: Support remote storage, step3, only for be, add migration_task_v2

2022-04-21 Thread GitBox
pengxiangyu commented on code in PR #8806: URL: https://github.com/apache/incubator-doris/pull/8806#discussion_r855728881 ## be/src/olap/storage_engine.cpp: ## @@ -839,10 +849,42 @@ OLAPStatus StorageEngine::_do_sweep(const string& scan_root, const time_t& local

[GitHub] [incubator-doris] yangzhg commented on a diff in pull request #9123: [enhancement](load) optimize load string data and dict page write

2022-04-21 Thread GitBox
yangzhg commented on code in PR #9123: URL: https://github.com/apache/incubator-doris/pull/9123#discussion_r855730553 ## be/src/olap/rowset/segment_v2/bitshuffle_page.h: ## @@ -93,13 +93,52 @@ class BitshufflePageBuilder : public PageBuilder { bool is_page_full() override {

[GitHub] [incubator-doris] weizhengte commented on a diff in pull request #8860: [feature-wip](statistics) step3: schedule the statistics tasks and update relevant info

2022-04-21 Thread GitBox
weizhengte commented on code in PR #8860: URL: https://github.com/apache/incubator-doris/pull/8860#discussion_r855733266 ## fe/fe-core/src/main/java/org/apache/doris/statistics/StatisticsManager.java: ## @@ -104,7 +111,7 @@ public List> showColumnStatsList(TableName tableName)

[GitHub] [incubator-doris] xy720 opened a new pull request, #9164: [Bug] Fix bug that new coming routine load tasks are rejected all the time and report TOO_MANY_TASK error

2022-04-21 Thread GitBox
xy720 opened a new pull request, #9164: URL: https://github.com/apache/incubator-doris/pull/9164 # Proposed changes Issue Number: close #9162 ## Problem Summary: This bug is caused by the data consumer group get by this routine load task. Sometimes, the kafka's begin

[GitHub] [incubator-doris] BiteTheDDDDt commented on a diff in pull request #9134: [optimize](storage)optimize read by rowids in storage layer

2022-04-21 Thread GitBox
BiteThet commented on code in PR #9134: URL: https://github.com/apache/incubator-doris/pull/9134#discussion_r855742380 ## be/src/olap/rowset/segment_v2/segment_iterator.cpp: ## @@ -892,12 +892,40 @@ void SegmentIterator::_read_columns_by_rowids(std::vector& read_column

[GitHub] [incubator-doris] weizhengte commented on a diff in pull request #8860: [feature-wip](statistics) step3: schedule the statistics tasks and update relevant info

2022-04-21 Thread GitBox
weizhengte commented on code in PR #8860: URL: https://github.com/apache/incubator-doris/pull/8860#discussion_r855744904 ## fe/fe-core/src/main/java/org/apache/doris/statistics/StatisticsJobScheduler.java: ## @@ -33,31 +47,211 @@ Switch job state from pending to scheduling. *

[GitHub] [incubator-doris] EmmyMiao87 commented on a diff in pull request #8947: [feature](statistics) Statistics derivation.Step 1:ScanNode implement…

2022-04-21 Thread GitBox
EmmyMiao87 commented on code in PR #8947: URL: https://github.com/apache/incubator-doris/pull/8947#discussion_r855731138 ## fe/fe-core/src/main/java/org/apache/doris/statistics/StatsDeriveResult.java: ## @@ -0,0 +1,57 @@ +// Licensed to the Apache Software Foundation (ASF) under

[GitHub] [incubator-doris] EmmyMiao87 commented on a diff in pull request #8947: [feature](statistics) Statistics derivation.Step 1:ScanNode implement…

2022-04-21 Thread GitBox
EmmyMiao87 commented on code in PR #8947: URL: https://github.com/apache/incubator-doris/pull/8947#discussion_r855747534 ## fe/fe-core/src/main/java/org/apache/doris/statistics/BaseStatsDerive.java: ## @@ -0,0 +1,122 @@ +// Licensed to the Apache Software Foundation (ASF) under

svn commit: r54014 - /release/incubator/doris/KEYS

2022-04-21 Thread jiafengzheng
Author: jiafengzheng Date: Fri Apr 22 04:09:22 2022 New Revision: 54014 Log: Update jiafeng.Zhang's KEYS Modified: release/incubator/doris/KEYS Modified: release/incubator/doris/KEYS == --- release/incubator/doris/KE

svn commit: r54015 - /dev/incubator/doris/KEYS

2022-04-21 Thread jiafengzheng
Author: jiafengzheng Date: Fri Apr 22 04:16:25 2022 New Revision: 54015 Log: Add doris manager 1.0.0-rc02 Modified: dev/incubator/doris/KEYS Modified: dev/incubator/doris/KEYS == --- dev/incubator/doris/KEYS (origina

[GitHub] [incubator-doris] wangbo commented on a diff in pull request #9134: [optimize](storage)optimize read by rowids in storage layer

2022-04-21 Thread GitBox
wangbo commented on code in PR #9134: URL: https://github.com/apache/incubator-doris/pull/9134#discussion_r855753474 ## be/src/olap/rowset/segment_v2/segment_iterator.cpp: ## @@ -892,12 +892,40 @@ void SegmentIterator::_read_columns_by_rowids(std::vector& read_column

svn commit: r54016 - in /dev/incubator/doris/doris-manager/1.0.0: apache-doris-incubating-manager-src-1.0.0-rc02.tar.gz apache-doris-incubating-manager-src-1.0.0-rc02.tar.gz.asc apache-doris-incubatin

2022-04-21 Thread jiafengzheng
Author: jiafengzheng Date: Fri Apr 22 04:20:43 2022 New Revision: 54016 Log: remove doris manager 1.0.0-rc02 Removed: dev/incubator/doris/doris-manager/1.0.0/apache-doris-incubating-manager-src-1.0.0-rc02.tar.gz dev/incubator/doris/doris-manager/1.0.0/apache-doris-incubating-manager-src

svn commit: r54017 - /dev/incubator/doris/KEYS

2022-04-21 Thread jiafengzheng
Author: jiafengzheng Date: Fri Apr 22 04:22:24 2022 New Revision: 54017 Log: Update jiafeng.Zhang's KEYS Modified: dev/incubator/doris/KEYS Modified: dev/incubator/doris/KEYS == --- dev/incubator/doris/KEYS (original

svn commit: r54018 - in /dev/incubator/doris/doris-manager/1.0.0: apache-doris-manager-1.0.0-incubating-src.tar.gz apache-doris-manager-1.0.0-incubating-src.tar.gz.asc apache-doris-manager-1.0.0-incub

2022-04-21 Thread jiafengzheng
Author: jiafengzheng Date: Fri Apr 22 04:23:53 2022 New Revision: 54018 Log: add doris manager 1.0.0-rc02 Added: dev/incubator/doris/doris-manager/1.0.0/apache-doris-manager-1.0.0-incubating-src.tar.gz (with props) dev/incubator/doris/doris-manager/1.0.0/apache-doris-manager-1.0.0-in

[GitHub] [incubator-doris] zhengshiJ commented on a diff in pull request #8947: [feature](statistics) Statistics derivation.Step 1:ScanNode implement…

2022-04-21 Thread GitBox
zhengshiJ commented on code in PR #8947: URL: https://github.com/apache/incubator-doris/pull/8947#discussion_r855759883 ## fe/fe-core/src/main/java/org/apache/doris/statistics/StatsDeriveResult.java: ## @@ -0,0 +1,57 @@ +// Licensed to the Apache Software Foundation (ASF) under

[GitHub] [incubator-doris] hf200012 opened a new pull request, #9165: [fix]Modify the release version to prepare the key generation problem solution

2022-04-21 Thread GitBox
hf200012 opened a new pull request, #9165: URL: https://github.com/apache/incubator-doris/pull/9165 Modify the release version to prepare the key generation problem solution # Proposed changes Issue Number: close #xxx ## Problem Summary: Describe the overview of ch

[GitHub] [incubator-doris] cody195 commented on pull request #9089: [enhancement](*): add checkstyle file

2022-04-21 Thread GitBox
cody195 commented on PR #9089: URL: https://github.com/apache/incubator-doris/pull/9089#issuecomment-1106047553 > LGTM Hi @EmmyMiao87, it is not a good idea to add `checkstyle` file with so many rules directly. The project already build failed, why you approved these changes?

[GitHub] [incubator-doris] jackwener closed pull request #9089: [enhancement](*): add checkstyle file

2022-04-21 Thread GitBox
jackwener closed pull request #9089: [enhancement](*): add checkstyle file URL: https://github.com/apache/incubator-doris/pull/9089 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9147: [Feature] [Lateral-View] support outer combinator of table function

2022-04-21 Thread GitBox
github-actions[bot] commented on PR #9147: URL: https://github.com/apache/incubator-doris/pull/9147#issuecomment-1106053694 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9147: [Feature] [Lateral-View] support outer combinator of table function

2022-04-21 Thread GitBox
github-actions[bot] commented on PR #9147: URL: https://github.com/apache/incubator-doris/pull/9147#issuecomment-1106053721 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[GitHub] [incubator-doris-flink-connector] hellozhaoxudong opened a new issue, #28: [Bug] IllegalArgumentException: Row arity: 5, but serializer arity: 4

2022-04-21 Thread GitBox
hellozhaoxudong opened a new issue, #28: URL: https://github.com/apache/incubator-doris-flink-connector/issues/28 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### V

[GitHub] [incubator-doris] weizhengte commented on a diff in pull request #8860: [feature-wip](statistics) step3: schedule the statistics tasks and update relevant info

2022-04-21 Thread GitBox
weizhengte commented on code in PR #8860: URL: https://github.com/apache/incubator-doris/pull/8860#discussion_r855812063 ## fe/fe-core/src/main/java/org/apache/doris/statistics/StatisticsTask.java: ## @@ -33,23 +37,88 @@ * @granularityDesc: StatsGranularity=partition */ pub

[GitHub] [incubator-doris] weizhengte commented on a diff in pull request #8860: [feature-wip](statistics) step3: schedule the statistics tasks and update relevant info

2022-04-21 Thread GitBox
weizhengte commented on code in PR #8860: URL: https://github.com/apache/incubator-doris/pull/8860#discussion_r855725739 ## fe/fe-core/src/main/java/org/apache/doris/statistics/StatisticsTaskScheduler.java: ## @@ -17,63 +17,95 @@ package org.apache.doris.statistics; +import

[GitHub] [incubator-doris] weizhengte commented on a diff in pull request #8860: [feature-wip](statistics) step3: schedule the statistics tasks and update relevant info

2022-04-21 Thread GitBox
weizhengte commented on code in PR #8860: URL: https://github.com/apache/incubator-doris/pull/8860#discussion_r855814433 ## fe/fe-core/src/main/java/org/apache/doris/statistics/StatisticsJobManager.java: ## @@ -19,55 +19,160 @@ import org.apache.doris.analysis.AnalyzeStmt; i

[GitHub] [incubator-doris] weizhengte commented on a diff in pull request #8860: [feature-wip](statistics) step3: schedule the statistics tasks and update relevant info

2022-04-21 Thread GitBox
weizhengte commented on code in PR #8860: URL: https://github.com/apache/incubator-doris/pull/8860#discussion_r855814866 ## fe/fe-core/src/main/java/org/apache/doris/statistics/StatisticsTask.java: ## @@ -33,23 +37,108 @@ * @granularityDesc: StatsGranularity=partition */ pu

[GitHub] [incubator-doris] weizhengte commented on a diff in pull request #8859: [feature-wip](statistics) step2: schedule the statistics job and generate executable tasks

2022-04-21 Thread GitBox
weizhengte commented on code in PR #8859: URL: https://github.com/apache/incubator-doris/pull/8859#discussion_r854889779 ## fe/fe-core/src/main/java/org/apache/doris/statistics/StatisticsJob.java: ## @@ -18,62 +18,200 @@ package org.apache.doris.statistics; import org.apache