yangzhg opened a new issue #8095:
URL: https://github.com/apache/incubator-doris/issues/8095


   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and 
found no similar issues.
   
   
   ### Description
   
   Since OlapScanNode calculates the number of scanners per tablet based on the 
scan range, 
   
https://github.com/apache/incubator-doris/blob/143c4085ee58007954f3eef8910556f5b8ce6b39/be/src/exec/olap_scan_node.cpp#L771
   when the query conditions are few, the number of scanners for the tablet may 
be too large, 
   and when calculating the amount of data scanned by each scanner in the next 
step, it will be use `scanners_per_tablet` as the denominator,
   
   
https://github.com/apache/incubator-doris/blob/143c4085ee58007954f3eef8910556f5b8ce6b39/be/src/exec/olap_scan_node.cpp#L786
   
    so each scanner scans only a small amount of data. 
   The total number of scanners is roughly the number of scan ranges multiplied 
by the number of conds in each range, which will result in a large number of 
scanners scanning a small amount of data at the same time.
   
   ### Solution
   
   Consider the tablet size when calculating scanners_per_tablet, no more 
scanners are generated for small tablets
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org

Reply via email to