Re: [PR] [enchement](mc)Optimize reading of maxcompute partition tables. [doris]

2024-12-08 Thread via GitHub
morningman merged PR #45148: URL: https://github.com/apache/doris/pull/45148 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.a

Re: [PR] [enchement](mc)Optimize reading of maxcompute partition tables. [doris]

2024-12-08 Thread via GitHub
github-actions[bot] commented on PR #45148: URL: https://github.com/apache/doris/pull/45148#issuecomment-2525535613 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [PR] [enchement](mc)Optimize reading of maxcompute partition tables. [doris]

2024-12-08 Thread via GitHub
github-actions[bot] commented on PR #45148: URL: https://github.com/apache/doris/pull/45148#issuecomment-2525535620 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] [enchement](mc)Optimize reading of maxcompute partition tables. [doris]

2024-12-07 Thread via GitHub
hubgeter commented on PR #45148: URL: https://github.com/apache/doris/pull/45148#issuecomment-2525405285 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [PR] [enchement](mc)Optimize reading of maxcompute partition tables. [doris]

2024-12-07 Thread via GitHub
hubgeter commented on code in PR #45148: URL: https://github.com/apache/doris/pull/45148#discussion_r1874606165 ## fe/fe-core/src/main/java/org/apache/doris/datasource/SplitAssignment.java: ## @@ -156,7 +156,7 @@ public BlockingQueue> getAssignedSplits(Backend return s

Re: [PR] [enchement](mc)Optimize reading of maxcompute partition tables. [doris]

2024-12-06 Thread via GitHub
hubgeter commented on code in PR #45148: URL: https://github.com/apache/doris/pull/45148#discussion_r1874356318 ## fe/fe-core/src/main/java/org/apache/doris/datasource/maxcompute/source/MaxComputeScanNode.java: ## @@ -181,32 +174,118 @@ boolean createTableBatchReadSession() thro

Re: [PR] [enchement](mc)Optimize reading of maxcompute partition tables. [doris]

2024-12-06 Thread via GitHub
morningman commented on code in PR #45148: URL: https://github.com/apache/doris/pull/45148#discussion_r1874352612 ## fe/fe-core/src/main/java/org/apache/doris/datasource/SplitAssignment.java: ## @@ -156,7 +156,7 @@ public BlockingQueue> getAssignedSplits(Backend return

Re: [PR] [enchement](mc)Optimize reading of maxcompute partition tables. [doris]

2024-12-06 Thread via GitHub
hubgeter commented on PR #45148: URL: https://github.com/apache/doris/pull/45148#issuecomment-2524853462 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [PR] [enchement](mc)Optimize reading of maxcompute partition tables. [doris]

2024-12-06 Thread via GitHub
doris-robot commented on PR #45148: URL: https://github.com/apache/doris/pull/45148#issuecomment-2524853433 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+proce

[PR] [enchement](mc)Optimize reading of maxcompute partition tables. [doris]

2024-12-06 Thread via GitHub
hubgeter opened a new pull request, #45148: URL: https://github.com/apache/doris/pull/45148 ### What problem does this PR solve? Problem Summary: Optimize reading of maxcompute partition tables: 1. Introduce batch mode to generate splits for Maxcompute partition tables to optimize s