Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-22 Thread via GitHub
yiguolei merged PR #28745: URL: https://github.com/apache/doris/pull/28745 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apa

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-22 Thread via GitHub
doris-robot commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1867747448 TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Tpch sf100 test result on commit 11c69e8f8f67631c37b6c4095fde567edfb2048a, data reload: false run tpc

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-22 Thread via GitHub
github-actions[bot] commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1867714878 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-22 Thread via GitHub
doris-robot commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1867711599 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 44.54 seconds stream load tsv: 564 seconds loaded 74807831229 Bytes,

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-22 Thread via GitHub
doris-robot commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1867685079 TeamCity be ut coverage result: Function Coverage: 36.53% (8539/23373) Line Coverage: 28.62% (69432/242564) Region Coverage: 27.65% (35932/129975) Branch Coverage: 24.3

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-22 Thread via GitHub
github-actions[bot] commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1867624999 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-22 Thread via GitHub
kaijchen commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1867617550 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-22 Thread via GitHub
github-actions[bot] commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1867608768 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-21 Thread via GitHub
github-actions[bot] commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1867342389 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-21 Thread via GitHub
github-actions[bot] commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1867237674 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-21 Thread via GitHub
doris-robot commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1865939881 TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Tpch sf100 test result on commit 22bc1233989b6c47150a85ebbdf1914165105717, data reload: false run tpc

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-21 Thread via GitHub
doris-robot commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1865885642 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 43.99 seconds stream load tsv: 566 seconds loaded 74807831229 Bytes,

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-21 Thread via GitHub
doris-robot commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1865870540 TeamCity be ut coverage result: Function Coverage: 36.46% (8532/23403) Line Coverage: 28.56% (69319/242709) Region Coverage: 27.59% (35885/130061) Branch Coverage: 24.3

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-21 Thread via GitHub
github-actions[bot] commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1865854856 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-21 Thread via GitHub
kaijchen commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1865844913 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-21 Thread via GitHub
github-actions[bot] commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1865843595 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
doris-robot commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1865790015 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 44.41 seconds stream load tsv: 575 seconds loaded 74807831229 Bytes,

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
doris-robot commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1865785277 TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Tpch sf100 test result on commit b6daf41e375ef86e746b5ac449ce5c987ef75324, data reload: false run tpc

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
doris-robot commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1865769091 TeamCity be ut coverage result: Function Coverage: 36.46% (8533/23402) Line Coverage: 28.57% (69346/242704) Region Coverage: 27.61% (35906/130059) Branch Coverage: 24.3

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
github-actions[bot] commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1865713196 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
kaijchen commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1865694464 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
doris-robot commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1865646012 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 44.28 seconds stream load tsv: 568 seconds loaded 74807831229 Bytes,

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
doris-robot commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1865624290 TeamCity be ut coverage result: Function Coverage: 36.46% (8533/23402) Line Coverage: 28.57% (69349/242704) Region Coverage: 27.61% (35904/130059) Branch Coverage: 24.3

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
doris-robot commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1865616608 TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Tpch sf100 test result on commit e000a08e3a8fed1e160c1c6cd06ba7c3332e0144, data reload: false run tpc

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
github-actions[bot] commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1865571860 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
kaijchen commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-186280 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
doris-robot commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1864762594 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 44.7 seconds stream load tsv: 563 seconds loaded 74807831229 Bytes, a

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
doris-robot commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1864748565 TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Tpch sf100 test result on commit fc5ca98b0da4853ab65ccdeef937a25cc44e6b40, data reload: false run tpc

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
doris-robot commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1864737654 TeamCity be ut coverage result: Function Coverage: 36.47% (8533/23400) Line Coverage: 28.58% (69345/242649) Region Coverage: 27.61% (35902/130025) Branch Coverage: 24.3

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
github-actions[bot] commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1864717000 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
github-actions[bot] commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1864707711 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
kaijchen commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1864704367 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
github-actions[bot] commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1864677223 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
github-actions[bot] commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1864677333 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
doris-robot commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1864433024 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 44.87 seconds stream load tsv: 573 seconds loaded 74807831229 Bytes,

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
doris-robot commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1864416326 TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Tpch sf100 test result on commit 32d8ee064980bf88f98f1ef5d9576b80cd593e94, data reload: false run tpc

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
doris-robot commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1864411656 TeamCity be ut coverage result: Function Coverage: 36.44% (8530/23407) Line Coverage: 28.56% (69311/242687) Region Coverage: 27.59% (35885/130049) Branch Coverage: 24.3

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
github-actions[bot] commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1864367935 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
kaijchen commented on PR #28745: URL: https://github.com/apache/doris/pull/28745#issuecomment-1864357611 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[PR] [improve](move-memtable) remove heavy work pool from load stream [doris]

2023-12-20 Thread via GitHub
kaijchen opened a new pull request, #28745: URL: https://github.com/apache/doris/pull/28745 ## Proposed changes Heavy work pool is causing too many context switches, remove it from LoadStream. `bthread::Mutex` in LoadStream is only used in bthread context. And blocking IO happen