Hi community
This parameter makes me confused.
| taskmanager.network.numberOfBuffers |
700000
|
In my job, i use 700 slots, but ,i have to set the this parameter to
700000.If not,i will get a exception.
java.io.IOException: Insufficient number of network buffers: required 700,
but only 1 available. The total number of network buffers is currently set to
80000 of 32768 bytes each. You can increase this number by setting the
configuration keys 'taskmanager.network.memory.fraction',
'taskmanager.network.memory.min', and 'taskmanager.network.memory.max'.
But actually this waste too many resource.
Memory Segments
| Type | Count |
| Available | 698,838 |
|
Total
| 700,000 |
| Direct | 700,103 | 21.4 GB | 21.4 GB |
| Mapped | 0 | 0 B | 0 B |
Best Wishes
forideal
