RE: Does HBase RegionServer benefit from OS Page Cache

2013-03-25 Thread Liyin Tang
in the compaction, and mark the blocks of the resulting compacted file which contain previously cached keyvalues to be cached after the compaction. I have to research the feasibility of this approach. Enis On Sun, Mar 24, 2013 at 10:15 PM, Liyin Tang wrote: > Block cache is for uncompres

RE: Does HBase RegionServer benefit from OS Page Cache

2013-03-25 Thread Liyin Tang
From: Liyin Tang To: user@hbase.apache.org Sent: Saturday, March 23, 2013 9:44 PM Subject: Re: Does HBase RegionServer benefit from OS Page Cache We (Facebook) are closely monitoring the OS page cache hit ratio in the production environments. My experience is if your data access pattern is very random

Re: Does HBase RegionServer benefit from OS Page Cache

2013-03-23 Thread Liyin Tang
We (Facebook) are closely monitoring the OS page cache hit ratio in the production environments. My experience is if your data access pattern is very random, then the OS page cache won't help you so much even though the data locality is very high. On the other hand, if the requests are always again