Re: Question re: the use of multiple ColumnFamilies

2011-01-24 Thread Andy Burgess
Yes, that's exactly so. I have no need for multiple DataFileDirectories, except that it was a convenient way to test the hypothesis that the performance bottleneck I was experiencing due to writing only one sstable to disk at once could be solved by increasing the queue size for the writer (the

Re: Question re: the use of multiple ColumnFamilies

2011-01-21 Thread Peter Schuller
> "A number of people have experienced lose from using multiple > DataFileDirectories, and to my knowledge no one has experienced win > from doing so." I presume that's disk space reasons. > Do you have an actual use case for this functionality in which you > experience win? I understood his use

Re: Question re: the use of multiple ColumnFamilies

2011-01-21 Thread Robert Coli
On 1/18/11, Andy Burgess wrote: > Sorry for the delayed reply, but thanks very much - this pointed me at > the exact problem. I found that the queue size here was equal to the > number of configured DataFileDirectories, so a good test was to lie to > Cassandra and claim that there were more DataFi

Re: Question re: the use of multiple ColumnFamilies

2011-01-18 Thread Peter Schuller
> Sorry for the delayed reply, but thanks very much - this pointed me at the > exact problem. I found that the queue size here was equal to the number of > configured DataFileDirectories, so a good test was to lie to Cassandra and > claim that there were more DataFileDirectories than I needed. Inte

Re: Question re: the use of multiple ColumnFamilies

2011-01-18 Thread Andy Burgess
Sorry for the delayed reply, but thanks very much - this pointed me at the exact problem. I found that the queue size here was equal to the number of configured DataFileDirectories, so a good test was to lie to Cassandra and claim that there were more DataFileDirectories than I needed. Interest

Re: Question re: the use of multiple ColumnFamilies

2011-01-08 Thread Peter Schuller
Filed: https://issues.apache.org/jira/browse/CASSANDRA-1955 -- / Peter Schuller

Re: Question re: the use of multiple ColumnFamilies

2011-01-08 Thread Peter Schuller
[multiple active cf;s, often triggering flush at the same time] > Can anyone confirm whether or not this behaviour is expected, and > suggest anything that I could do about it? This is on 0.6.6, by the way. > Patched with time-to-live code, if that makes a difference. I looked at the code (trunk

Question re: the use of multiple ColumnFamilies

2011-01-07 Thread Andy Burgess
Hi, I have a performance problem related to my use of multiple ColumnFamilies. Maybe there's a better way to represent my data such that I don't hit this problem, I don't know, but as things stand, I'm putting data into each ColumnFamily at a rate which is more-or-less the same for each. This mea