Hi Folks,
I found that Datastreamer may consume heap or use increased heap
amount when loading into a persistent cache.
This may happen with streamer's 'allowOverwite'==true and the cache is
in PRIMARY_SYNC mode.
What I don't like here is that the case looks simple. Not the
defaults, but user might meet the issue just in a trival test,
trying/researching the streamer.
Streamer has related 'perNodeParallelOperations()' which helps. But
addinional DFLT_PARALLEL_PERSISTENT_OPS_MULTIPLIER might be set for PDS.
My question are:
1) Is it an issue at all? Need to fix? A minor?
2) Should we bring additional default
DFLT_PARALLEL_PERSISTENT_OPS_MULTIPLIER for PDS because it reduces heap
consumption?
3) Better solution is backpressure. But does it worth the case?
Ticket: https://issues.apache.org/jira/browse/IGNITE-17735
PR: https://github.com/apache/ignite/pull/10343