Hi Folks,

    I found that Datastreamer may consume heap or use increased heap amount when loading into a persistent cache. This may happen with streamer's 'allowOverwite'==true and the cache is in PRIMARY_SYNC mode.

    What I don't like here is that the case looks simple. Not the defaults, but user might meet the issue just in a trival test, trying/researching the streamer.

    Streamer has related 'perNodeParallelOperations()' which helps. But addinional DFLT_PARALLEL_PERSISTENT_OPS_MULTIPLIER might be set for PDS.

    My question are:
1) Is it an issue at all? Need to fix? A minor?
2) Should we bring additional default DFLT_PARALLEL_PERSISTENT_OPS_MULTIPLIER for PDS because it reduces heap consumption?
3) Better solution is backpressure. But does it worth the case?

Ticket: https://issues.apache.org/jira/browse/IGNITE-17735
PR: https://github.com/apache/ignite/pull/10343

Reply via email to