mmit log).
>
>
>
> Parag
>
>
>
> *From:* DuyHai Doan [mailto:doanduy...@gmail.com]
> *Sent:* Thursday, April 10, 2014 3:35 PM
> *To:* user@cassandra.apache.org
> *Subject:* Re: Cassandra memory consumption
>
>
>
> Data structures that are stored off hea
live? (keep in mind in this scenario the data has been been purged
to the data directory. It's only been added to the commit log).
Parag
From: DuyHai Doan [mailto:doanduy...@gmail.com]
Sent: Thursday, April 10, 2014 3:35 PM
To: user@cassandra.apache.org
Subject: Re: Cassandra memory consump
Data structures that are stored off heaps:
1) Row cache (if JNA enabled, otherwise on heap)
2) Bloom filter
3) Compression offset
4) Key Index sample
On heap:
1) Memtables
2) Partition Key cache
Hope that I did not forget anything
Regards
Duy Hai DOAN
On Thu, Apr 10, 2014 at 9:13 PM, Pa
We're using Cassandra 1.2.12. What aspects of the data is stored in off heap
memory vs heap memory?
On Wed, Feb 16, 2011 at 11:22 AM, Victor Kabdebon
wrote:
> Thanks robert, and do you know if there is a way to control the maximum
> likely number of memtables ? (I'd like to cap it at 2)
That "likely number of memtables" is the number of memtables which :
a) have been created
b) may or may not
Thanks robert, and do you know if there is a way to control the maximum
likely number of memtables ? (I'd like to cap it at 2)
2011/2/16 Robert Coli
> On Wed, Feb 16, 2011 at 7:12 AM, Victor Kabdebon
> wrote:
> > Someone please correct me if I am wrong, but I think the overhead you can
> > expe
On Wed, Feb 16, 2011 at 7:12 AM, Victor Kabdebon
wrote:
> Someone please correct me if I am wrong, but I think the overhead you can
> expect is something like :
>
MemTableThroughtPutInMB * *
JavaOverHeadFudgeFactor is "at least 2".
The maximum likely number of such memtables is usually roughl
Someone please correct me if I am wrong, but I think the overhead you can
expect is something like :
16* MemTableThroughtPutInMB
but I don't know when BinaryMemTableThroughputInMb come into account..
2011/2/16 ruslan usifov
>
>
> 2011/2/16 Victor Kabdebon
>
>
>>
>> Ruslan I have seen your que
2011/2/16 Victor Kabdebon
>
>
> Ruslan I have seen your question in the other mail and I have the same
> problem. How many CF do you have ?
>
>
> 16
Yes I didn't see there was 2 different parameters. I was personally setting
( in cassandra 0.6.6 ) MemTableThoughputInMB, but I don't know what
BinaryMemtableThroughtputInMB is.
And I take this opportunity to ask a question :
If you have a small amount of data per key so that your memtable is mayb
> Each of your 21 column families will have its own memtable if you have
> the default memtable settings your memory usage will grow quite large
> over time. Have you tuned down your memtable size?
>
Which config parameter make this? binary_memtable_throughput_in_mb?
../conf:bin/../build/classes:bin/../lib/antlr-3.1.3.jar:bin/../lib/apache-cassandra-06.6.jar:bin/../lib/avro-1.2.0-dev.jar:bin/../lib/cassandra-javautils.jar:bin/../lib/clhm-production.jar:bin/../lib/commons-cli-1.1.jar:bin/../lib/commons-codec-1.2.jar:bin/../lib/commons-collections-3.2.1.jar:bin/../lib/c
ar:bin/../lib/commons-lang-2.4.jar:bin/../lib/commons-pool-1.5.4.jar:bin/../lib/google-collections-1.0.jar:bin/../lib/hadoop-core-0.20.1.jar:bin/../lib/hector-0.6.0-14.jar:bin/../lib/high-scale-lib.jar:bin/./lib/ivy-2.1.0.jar:bin/../lib/jackson-core-asl-1.4.0.jar:bin/../lib/jackson-mapper-asl-1.4.0.jar:bi
.jar:bin/./lib/ivy-2.1.0.jar:bin/../lib/jackson-core-asl-1.4.0.jar:bin/../lib/jackson-mapper-asl-1.4.0.jar:bin/../lib/jline-0.9.94.jar:bin/../lib/jna.jar:bin/../lib/json-simple-1.1.jar:bin/../lib/libthrift-r917130.jar:bin/../lib/log4j-1.2.14.jar:bin/../lib/perf4j-0.9.12.jar:bin/../lib/slf4j-api-1.5.8.jar:
ly an annoying problem if we cannot really foresee memory
> consumption.
>
> Best regards,
> Victor K
>
> 2011/2/8 Victor Kabdebon <victor.kabde...@gmail.com>
>>
>> Dear all,
>>
>> Sorry to come back again to this point but I am really worried about
>
:bin/../lib/log4j-1.2.14.jar:bin/../lib/perf4j-0.9.12.jar:bin/../lib/slf4j-api-1.5.8.jar:bin/../lib/slf4j-log4j12-1.5.8.jar:bin/../lib/uuid-3.1.jar
>> > org.apache.cassandra.thrift.CassandraDaemon
>> >
>> > It is really an annoying problem if we cannot really foresee memory
&
ache.cassandra.thrift.CassandraDaemon
> >
> > It is really an annoying problem if we cannot really foresee memory
> > consumption.
> >
> > Best regards,
> > Victor K
> >
> > 2011/2/8 Victor Kabdebon
> >>
> >> Dear all,
> >>
>
y foresee memory
> consumption.
>
> Best regards,
> Victor K
>
> 2011/2/8 Victor Kabdebon
>>
>> Dear all,
>>
>> Sorry to come back again to this point but I am really worried about
>> Cassandra memory consumption. I have a single machine that runs on
eally an annoying problem if we cannot really foresee memory
> consumption.
>
> Best regards,
> Victor K
>
> 2011/2/8 Victor Kabdebon
>>
>> Dear all,
>>
>> Sorry to come back again to this point but I am really worried about
>> Cassandra memory consumption.
t; Cassandra memory consumption. I have a single machine that runs one
> Cassandra server. There is almost no data on it but I see a crazy memory
> consumption and it doesn't care at all about the instructions...
> Note that I am not using mmap, but "Standard", I use also JNA
Dear all,
Sorry to come back again to this point but I am really worried about
Cassandra memory consumption. I have a single machine that runs one
Cassandra server. There is almost no data on it but I see a crazy memory
consumption and it doesn't care at all about the instructions...
Note t
21 matches
Mail list logo
