Re: state size effects latency

2017-10-31 Thread Stefan Richter
Hi, I think there are a couple of potential explanations for the increased latency. Let me point out two of the most obvious that come to my mind: 1) A state size of 20 MB sounds like something that could (completely or to a large extend) fit into some cache layer of a modern CPU, whereas 200 M

RE: state size effects latency

2017-10-30 Thread Sofer, Tovi
From: Biplob Biswas [mailto:revolutioni...@gmail.com] Sent: יום ב 30 אוקטובר 2017 11:02 To: Sofer, Tovi [ICG-IT] Cc: Narendra Joshi ; user Subject: Re: state size effects latency Hi Tovi, This might seem a really naive question (and its neither a solution or answer to your question ) but I am

Re: state size effects latency

2017-10-30 Thread Biplob Biswas
; *Sent:* יום א 29 אוקטובר 2017 12:13 > *To:* Sofer, Tovi [ICG-IT] > *Cc:* user > *Subject:* Re: state size effects latency > > > > We have also faced similar issues. The only thing that happens in sync > when using async snaphots is getting a persistent point in time

RE: state size effects latency

2017-10-30 Thread Sofer, Tovi
: Re: state size effects latency We have also faced similar issues. The only thing that happens in sync when using async snaphots is getting a persistent point in time picture which in case of rocksdb backend is making symlinks. That would linearly increase with number of files to symlink but

Re: state size effects latency

2017-10-29 Thread Narendra Joshi
We have also faced similar issues. The only thing that happens in sync when using async snaphots is getting a persistent point in time picture which in case of rocksdb backend is making symlinks. That would linearly increase with number of files to symlink but this should be negligible. We could no

state size effects latency

2017-10-29 Thread Sofer, Tovi
Hi all, In our application we have a requirement to very low latency, preferably less than 5ms. We were able to achieve this so far, but when we start increasing the state size, we see distinctive decrease in latency. We have added MinPauseBetweenCheckpoints, and are using async snapshots. *