Re: Question about ATS garbage collector

2017-06-01 Thread Anh Le Duc (2)
@Alan: Fragment sizes are not fixed, right? By the formula in section Stripe Directory , we have adaptive sizes ( *size* + 1 ) * 2 ^ ( CACHE_BLOCK_SHIFT + 3 * *big* ) On Fri,

Re: Question about ATS garbage collector

2017-06-01 Thread John Plevyak
While large objects are not stored contiguously, the chunk size is configurable (as Alan pointed out). Increasing the chunk size increases memory usage and decreases the number of seeks required to read an object. It does not decease the number of seeks required to write the object because we use

Triggering PR build requests

2017-06-01 Thread Leif Hedstrom
Hi all, since we’re depending more and more on Github PR builds with our Jenkins, I’ve made some additional changes to allow for selective triggering individual checks to build. So, all committers can now do the following in a comment on a PR: [approve ci] - Triggers all builds

Re: slow client triggered cache fill will slow down the subsequence fast clients when read_while_writer enabled

2017-06-01 Thread ri lu
Alan, thanks for your quick response. I'm trying to workout a plugin which will hook at the lookup content phase and put the client transaction into a pending queue if it's cache-miss, and then fake a client request by issue a request by HttpFetch api and set a special http request header. Meanwhi

Re: slow client triggered cache fill will slow down the subsequence fast clients when read_while_writer enabled

2017-06-01 Thread Alan Carroll
There's not really a work around, other than flow control, at this time. Changing it would be tricky bit of work as at the time the first transaction occurs there is no cache producer to which to attach. After the second client, the first transaction / HttpTunnel would somehow need to be restruc

Re: Question about ATS garbage collector

2017-06-01 Thread Alan Carroll
You might try playing with the expected fragment size. That's tunable and you can get a partial effect of more contiguous fragments by making it larger, although I think the absolute maximum is 16M. This doesn't cost additional disk space as it is a maximum fragment size, not a forced one.

Re: Question about ATS garbage collector

2017-06-01 Thread Anh Le Duc (2)
Thanks for your thorough explanation. I'm gonna play with the idea. :D On Thu, Jun 1, 2017 at 9:23 AM, Alan Carroll < solidwallofc...@yahoo-inc.com.invalid> wrote: > Each fragment is part of a specific object. No two objects share a > fragment. > I don't think making the fragments contiguous will