: "user@flink.apache.org"
Date: Thursday, February 16, 2017 at 8:24 AM
To: "user@flink.apache.org"
Subject: Re: Resource under-utilization when using RocksDb state backend
[SOLVED]
Hi Cliff,
It will be really helpful if you could share your RocksDB configuration.
I am also runni
;>>>>
>>>>> Here is a sample top:
>>>>>
>>>>> Cpu0 : 20.5%us, 0.0%sy, 0.0%ni, 79.5%id, 0.0%wa, 0.0%hi, 0.0%si,
>>>>> 0.0%st
>>>>> Cpu1 : 18.5%us, 0.0%sy, 0.0%ni, 81.5%id, 0.0%wa, 0.0%hi, 0.0%si,
>
Great to hear!
On Fri, 9 Dec 2016 at 01:02 Cliff Resnick wrote:
> It turns out that most of the time in RocksDBFoldingState was spent on
> serialization/deserializaton. RocksDb read/write was performing well. By
> moving from Kryo to custom serialization we were able to increase
> throughput dra
It turns out that most of the time in RocksDBFoldingState was spent on
serialization/deserializaton. RocksDb read/write was performing well. By
moving from Kryo to custom serialization we were able to increase
throughput dramatically. Load is now where it should be.
On Mon, Dec 5, 2016 at 1:15 PM,
