Yingjie Cao created FLINK-25780:
-----------------------------------
Summary: Reduce the maximum number of data output buffers for
sort-shuffle
Key: FLINK-25780
URL: https://issues.apache.org/jira/browse/FLINK-25780
Project: Flink
Issue Type: Sub-task
Components: Runtime / Network
Reporter: Yingjie Cao
Fix For: 1.15.0
The data output buffer of sort-shuffle is for better disk IO performance and
currently, the total data output buffer size is 16M which is pretty big.
However, blocking request too many buffers may influence performance. This
ticket aims to reduce the maximum number of data output buffers to reduce the
buffer request time. The selected value is an empirical one based on the TPC-DS
test results.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
