Re: key cache hit rate and BF false positive

2013-07-31 Thread Keith Wright
0 0 493 >> 0 0 >> 19556660 056 >> 0 0 >> 23467990 081 >> 0 0 >> 2816159 0

Re: key cache hit rate and BF false positive

2013-07-31 Thread aaron morton
gt; 10090808 0 0 0 0 > 0 > 12108970 0 0 0 0 > 0 > 14530764 0 0 0 0 >

Re: key cache hit rate and BF false positive

2013-07-29 Thread Keith Wright
@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Subject: Re: key cache hit rate and BF false positive Also here is the output from cfhistograms if that helps. Thanks all! users/cookie_user_lookup histograms Offset SSTables Write Latenc

Re: key cache hit rate and BF false positive

2013-07-26 Thread Keith Wright
...@nanigans.com>> Reply-To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Date: Friday, July 26, 2013 11:10 PM To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.or

key cache hit rate and BF false positive

2013-07-26 Thread Keith Wright
Hi all, I am experiencing VERY poor key cache hit rate on my 6 node C* 1.2.4 with Vnode cluster. I am using CQL3 with LCS and yesterday increased my SSTable size from default 5 MB to 256 MB although I did not force a major compaction and am instead letting the new size take effect

Re: Poor key cache hit rate

2013-01-30 Thread Edward Capriolo
: > Hi all, > > I am running 1.1.9 with 2 data centers and 3 nodes each. Recently I have been seeing a terrible key cache hit rate (around 1-3%) with a 98% row cache hit rate. The seed node appears to take higher traffic than the other nodes (approximately twice) but I believe I have

Poor key cache hit rate

2013-01-29 Thread Keith
Hi all, I am running 1.1.9 with 2 data centers and 3 nodes each. Recently I have been seeing a terrible key cache hit rate (around 1-3%) with a 98% row cache hit rate. The seed node appears to take higher traffic than the other nodes (approximately twice) but I believe I have astyanax

Re: Key cache hit rate issue

2012-02-17 Thread Eran Chinthaka Withana
gt; To give you little bit more context (not sure whether this will help but > > anyway), about 2-3 weeks back the read latency was 4-8ms with about > 90-95% > > key cache hit rate. But after that point, I stopped all the reads and > kept > > only writes into the system. Whe

Re: Key cache hit rate issue

2012-02-17 Thread Jonathan Ellis
e you little bit more context (not sure whether this will help but > anyway), about 2-3 weeks back the read latency was 4-8ms with about 90-95% > key cache hit rate. But after that point, I stopped all the  reads and kept > only writes into the system. When I enabled reads this week, then o

Re: Key cache hit rate issue

2012-02-17 Thread Eran Chinthaka Withana
I never used JMX for any changes and use JMX only for monitoring. All my updates goes through schema updates. To give you little bit more context (not sure whether this will help but anyway), about 2-3 weeks back the read latency was 4-8ms with about 90-95% key cache hit rate. But after that

Re: Key cache hit rate issue

2012-02-17 Thread Jonathan Ellis
; Space used (live): 66300297338 > Space used (total): 66300297338 > Number of Keys (estimate): 61152896 > Memtable Columns Count: 881972 > Memtable Data Size: 211749842 > Memtable Switch Count: 267 > Read Count: 590667 > Read Latency: 16.859 ms. > Write Count: 12720068 &g

Re: Key cache hit rate issue

2012-02-17 Thread Todd Burruss
gt; Column Family: YY >>>> SSTable count: 18 >>>> Space used (live): 103318720685 >>>> Space used (total): 103318720685 >>>> Number of Keys (estimate): 92404992 >>>> Memtable Columns Count: 1425580 >>>> Memtable Data Size: 359655747

Re: Key cache hit rate issue

2012-02-16 Thread Eran Chinthaka Withana
mtable Switch Count: 267 Read Count: 590667 Read Latency: 16.859 ms. Write Count: 12720068 Write Latency: 0.060 ms. Pending Tasks: 0 Bloom Filter False Postives: 507 Bloom Filter False Ratio: 0.00099 Bloom Filter Space Used: 168118968 Key cache capacity: 4000 Key cache size: 3838755 Key cache

Re: Re: Key cache hit rate issue

2012-02-16 Thread zhangcheng
all in the most recent sstable, by this, I think the read performace will be better. 2012-02-17 zhangcheng 发件人: Jonathan Ellis 发送时间: 2012-02-17 10:13:20 收件人: user 抄送: 主题: Re: Key cache hit rate issue On Thu, Feb 16, 2012 at 3:52 PM, Eran Chinthaka Withana wrote: > Thanks

Re: Re: Key cache hit rate issue

2012-02-16 Thread zhangcheng
Thanks, Jonathan. I got it. 2012-02-17 zhangcheng 发件人: Jonathan Ellis 发送时间: 2012-02-17 10:15:05 收件人: user 抄送: 主题: Re: Key cache hit rate issue Look for this code in SSTableReader.getPosition: Pair unifiedKey = new Pair(descriptor, decoratedKey); Long

Re: Re: Key cache hit rate issue

2012-02-16 Thread zhangcheng
according to the read process, the key of the keycache should be the row key. 2012-02-17 zhangcheng 发件人: Todd Burruss 发送时间: 2012-02-17 06:23:47 收件人: user@cassandra.apache.org 抄送: 主题: Re: Key cache hit rate issue jonathan, you said the key to the cache is key + sstable? looking

Re: Key cache hit rate issue

2012-02-16 Thread Jonathan Ellis
t; Memtable Switch Count: 2522 >>> Read Count: 1123637972 >>> Read Latency: 14.731 ms. >>> Write Count: 128201833 >>> Write Latency: NaN ms. >>> Pending Tasks: 0 >>> Bloom Filter False Postives: 1488 >>> Bloom Filter False Ratio: 0.

Re: Key cache hit rate issue

2012-02-16 Thread Jonathan Ellis
On Thu, Feb 16, 2012 at 3:52 PM, Eran Chinthaka Withana wrote: > Thanks for the reply. Yes there is a possibility that the keys can be > distributed in multiple SSTables, but my data access patterns are such that > I always read/write the whole row. So I expect all the data to be in the > same SST

Re: Key cache hit rate issue

2012-02-16 Thread Eran Chinthaka Withana
t; Memtable Switch Count: 2522 >> > Read Count: 1123637972 >> > Read Latency: 14.731 ms. >> > Write Count: 128201833 >> > Write Latency: NaN ms. >> > Pending Tasks: 0 >> > Bloom Filter False Postives: 1488 >> > Bloom Filter Fals

Re: Key cache hit rate issue

2012-02-16 Thread Todd Burruss
Latency: 14.731 ms. >> Write Count: 128201833 >> Write Latency: NaN ms. >> Pending Tasks: 0 >> Bloom Filter False Postives: 1488 >> Bloom Filter False Ratio: 0.0 >> Bloom Filter Space Used: 331522920 >> Key cache capacity: 16637958 >> Key cache

Re: Key cache hit rate issue

2012-02-16 Thread Todd Burruss
: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Subject: Re: Key cache hit rate issue Hi Jonathan, Thanks for the reply. Yes there is a possibility that the keys can be distributed in multiple SSTables, but my data access pat

Re: Key cache hit rate issue

2012-02-16 Thread Franc Carter
le Data Size: 359655747 >> > Memtable Switch Count: 2522 >> > Read Count: 1123637972 >> > Read Latency: 14.731 ms. >> > Write Count: 128201833 >> > Write Latency: NaN ms. >> > Pending Tasks: 0 >> > Bloom Filter False Postives: 1488 >

Re: Key cache hit rate issue

2012-02-16 Thread Eran Chinthaka Withana
ta Size: 359655747 > > Memtable Switch Count: 2522 > > Read Count: 1123637972 > > Read Latency: 14.731 ms. > > Write Count: 128201833 > > Write Latency: NaN ms. > > Pending Tasks: 0 > > Bloom Filter False Postives: 1488 > > Bloom Filter False Ratio: 0.

Re: Key cache hit rate issue

2012-02-16 Thread Jonathan Ellis
Count: 128201833 > Write Latency: NaN ms. > Pending Tasks: 0 > Bloom Filter False Postives: 1488 > Bloom Filter False Ratio: 0.0 > Bloom Filter Space Used: 331522920 > Key cache capacity: 16637958 > Key cache size: 16637958 > Key cache hit rate: 0.2708 > Row

Re: Key cache hit rate issue

2012-02-16 Thread Eran Chinthaka Withana
Filter Space Used: 331522920 Key cache capacity: 16637958 Key cache size: 16637958 Key cache hit rate: 0.2708 Row cache: disabled Compacted row minimum size: 51 Compacted row maximum size: 6866 Compacted row mean size: 2560 Thanks, Eran Chinthaka Withana On Thu, Feb 16, 2012 at 12:30

Re: Key cache hit rate issue

2012-02-16 Thread aaron morton
hanks, > Eran Chinthaka Withana > > > On Tue, Feb 14, 2012 at 3:42 PM, aaron morton wrote: > Out of interest what does cfstats say about the bloom filter stats ? A high > false positive could lead to a low key cache hit rate. > >> Also, is there a way to warm start the

Re: Key cache hit rate issue

2012-02-14 Thread Eran Chinthaka Withana
false positive could lead to a low key cache hit rate. > > Also, is there a way to warm start the key cache, meaning pre-load the > amount of keys I set as keys_cached? > > See key_cache_save_period when creating the CF. > > Cheers > > > - > Aaron Mort

Re: Key cache hit rate issue

2012-02-14 Thread aaron morton
Out of interest what does cfstats say about the bloom filter stats ? A high false positive could lead to a low key cache hit rate. > Also, is there a way to warm start the key cache, meaning pre-load the amount > of keys I set as keys_cached? See key_cache_save_period when creating

Key cache hit rate issue

2012-02-14 Thread Eran Chinthaka Withana
Hi, I'm using Cassandra 1.0.7 and I've set the keys_cached to about 80% (using the numerical values). This is visible in cfstats too. But I'm getting less than 20% (or sometimes even 0%) key cache hit rate. Well, the data access pattern is not the issue here as I know they are retr

Re: Key cache hit rate

2011-04-15 Thread Watanabe Maki
> it is 3.8880248833592535E then does it mean I got only 3% hit or .0003? > > -- > View this message in context: > http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Key-cache-hit-rate-tp6277236p6278397.html > Sent from the cassandra-u...@incubator.apache.org mailing list archive at > Nabble.com.

Re: Key cache hit rate

2011-04-15 Thread mcasandra
You mean read it like .00038880248833592535E? I didn't quite follow why? If it is 3.8880248833592535E then does it mean I got only 3% hit or .0003? -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Key-cache-hit-rate-tp6277236p6278397.html

Re: Key cache hit rate

2011-04-15 Thread Aaron Morton
Move the decimal point 4 places to the left. It's the percent of your queries that get a hit from the key cache . Aaron On 16/04/2011, at 6:25 AM, mcasandra wrote: > > How to intepret "Key cache hit rate"? What does this no mean? > > > Keyspace: StressKeysp

Key cache hit rate

2011-04-15 Thread mcasandra
How to intepret "Key cache hit rate"? What does this no mean? Keyspace: StressKeyspace Read Count: 87579 Read Latency: 11.792417360326105 ms. Write Count: 179749 Write Latency: 0.009272318622078566 ms. Pending Tasks: 0 Col

Re: Error reporting Key cache hit rate with cfstats or with JMX

2010-05-27 Thread Jonathan Ellis
gt; >> On Wed, May 26, 2010 at 2:54 PM, Ran Tavory wrote: >> > If I disable row cache the numbers look good - key cache hit rate is > >> > 0, so >> > it seems to be related to row cache. >> > Interestingly, after running for a really long time and with both r

Re: Error reporting Key cache hit rate with cfstats or with JMX

2010-05-26 Thread Ran Tavory
> It sure sounds like you're seeing the "my row cache contains the > entire hot data set, so the key cache only gets the cold reads" > effect. > > On Wed, May 26, 2010 at 2:54 PM, Ran Tavory wrote: > > If I disable row cache the numbers look good - key cache

Re: Error reporting Key cache hit rate with cfstats or with JMX

2010-05-26 Thread Jonathan Ellis
It sure sounds like you're seeing the "my row cache contains the entire hot data set, so the key cache only gets the cold reads" effect. On Wed, May 26, 2010 at 2:54 PM, Ran Tavory wrote: > If I disable row cache the numbers look good - key cache hit rate is > 0, so > i

Re: Error reporting Key cache hit rate with cfstats or with JMX

2010-05-26 Thread Ran Tavory
If I disable row cache the numbers look good - key cache hit rate is > 0, so it seems to be related to row cache. Interestingly, after running for a really long time and with both row and keys caches I do start to see Key cache hit rate > 0 but the numbers are so small that it doesn't

Re: Error reporting Key cache hit rate with cfstats or with JMX

2010-05-25 Thread Jonathan Ellis
What happens if you disable row cache? On Tue, May 25, 2010 at 4:53 AM, Ran Tavory wrote: > It seems there's an error reporting the Key cache hit rate. The value is > always 0.0 and I have a feeling it's incorrect. This is seen both by using > notetool cfstats as well as acc

Error reporting Key cache hit rate with cfstats or with JMX

2010-05-25 Thread Ran Tavory
It seems there's an error reporting the Key cache hit rate. The value is always 0.0 and I have a feeling it's incorrect. This is seen both by using notetool cfstats as well as accessing JMX directly (org.apache.cassandra.db:type=Caches,keyspace=outbrain_kvdb,cache=KvAdsKeyCache Rec