Re: RocksDB native checkpoint time

2019-05-14 Thread Gyula Fóra
Hey, I have collected some rocksdb logs for the snapshot itself but I cant really wrap my head around where exactly the time is spent: https://gist.github.com/gyfora/9a37aa349f63c35cd6abe2da2cf19d5b The general pattern where the time is spent is this: 2019/05/14-09:15:49.486455 7fbe6a8ee700 [db/d

Re: RocksDB native checkpoint time

2019-05-03 Thread Konstantin Knauf
o speedup calls to >> `org.rocksdb.Checkpoint#create`. >> >> Piotrek >> >> On 3 May 2019, at 10:30, Gyula Fóra wrote: >> >> Hi! >> >> Does anyone know what parameters might affect the RocksDB native >> checkpoint time? (basically the syn

Re: RocksDB native checkpoint time

2019-05-03 Thread Gyula Fóra
ources how to speedup calls to > `org.rocksdb.Checkpoint#create`. > > Piotrek > > On 3 May 2019, at 10:30, Gyula Fóra wrote: > > Hi! > > Does anyone know what parameters might affect the RocksDB native > checkpoint time? (basically the sync part of the rocksdb increme

Re: RocksDB native checkpoint time

2019-05-03 Thread Stefan Richter
>> On 3 May 2019, at 10:30, Gyula Fóra > <mailto:gyula.f...@gmail.com>> wrote: >> >> Hi! >> >> Does anyone know what parameters might affect the RocksDB native checkpoint >> time? (basically the sync part of the rocksdb incremental snapshots) >&

Re: RocksDB native checkpoint time

2019-05-03 Thread Piotr Nowojski
2019, at 10:30, Gyula Fóra wrote: > > Hi! > > Does anyone know what parameters might affect the RocksDB native checkpoint > time? (basically the sync part of the rocksdb incremental snapshots) > > It seems to take 60-70 secs in some cases for larger state sizes, and I &g

RocksDB native checkpoint time

2019-05-03 Thread Gyula Fóra
Hi! Does anyone know what parameters might affect the RocksDB native checkpoint time? (basically the sync part of the rocksdb incremental snapshots) It seems to take 60-70 secs in some cases for larger state sizes, and I wonder if there is anything we could tune to reduce this. Maybe its only a