Hello!
Why do you have nodeParallelOperations of 1?
Do you really have issues with default configuration?
Regards,
--
Ilya Kasnacheev
ср, 27 февр. 2019 г. в 08:59, ashishb888 :
> Sure. But in my case I can not do so. Any other options for single threads?
>
>
>
> --
> Sent from: http://apache
Sure. But in my case I can not do so. Any other options for single threads?
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
I agree with Ilya, That's the silver bullet may be :)
On Fri, Dec 28, 2018 at 3:16 PM Ilya Kasnacheev
wrote:
> Hello!
>
> Maybe times have changed but it used to be that the best optimization was
> to feed DataStreamer's addData() from multiple threads in parallel.
>
> Can you try that?
>
> Rega
Hello!
Maybe times have changed but it used to be that the best optimization was
to feed DataStreamer's addData() from multiple threads in parallel.
Can you try that?
Regards,
--
Ilya Kasnacheev
пт, 28 дек. 2018 г. в 14:32, ashishb888 :
> I am using below settings:
> allowOverwrite: fals
To achieve the best data streaming performance, you should
aim at highest utilization of resources on data nodes.
There is no silver bullet for data streamer tuning, unfortunately.
Try changing parameters and see, how they affect the utilization and
overall performance.
For me default data streame
I am using below settings:
allowOverwrite: false
nodeParallelOperations: 1
autoFlushFrequency: 10
perNodeBufferSize: 500
My records size is around 2000 bytes. And see the "grid-data-loader-flusher"
thread stats as below:
Thread Count Average Longest Duration
grid-data-load
