Re: Commit log + Data directory on same partition (software raid)

2012-08-11 Thread Thibaut Britz
Unfortunately ssd drives are no option at the moment. I have to use 2 regular hds. Has anyone tried above scenario? THanks, Thibaut On Fri, Aug 10, 2012 at 3:30 PM, Radim Kolar wrote: > > I was thinking about putting both the commit log and the data directory >> on a software raid partition s

Commit log + Data directory on same partition (software raid)

2012-08-10 Thread Thibaut Britz
Hi, Has anyone of you made some experience with software raid (raid 1, mirroring 2 disks)? Our workload is rather read based at the moment (Commit Log directory only grows by 128MB every 2-3 minutes), while the second hd is under high load due to the read requests to our cassandra cluster. I was

Re: cassandra 0.8.7 + hector 0.8.3: All Quorum reads result in writes?

2012-04-11 Thread Thibaut Britz
lined in my parallel post) but if it fixes it for you, then > beautiful. Just wanted to let you know our experience with similar > symptoms. > > On Apr 11, 2012, at 11:56 AM, Thibaut Britz wrote: > > > Fixed in https://issues.apache.org/jira/browse/CASSANDRA-3843 > > >

Re: cassandra 0.8.7 + hector 0.8.3: All Quorum reads result in writes?

2012-04-11 Thread Thibaut Britz
Fixed in https://issues.apache.org/jira/browse/CASSANDRA-3843 On Wed, Apr 11, 2012 at 5:58 PM, Thibaut Britz < thibaut.br...@trendiction.com> wrote: > We have read repair disabled (0.0). > > Even if this would be the case, this also doesn't explain why the writes >

Re: cassandra 0.8.7 + hector 0.8.3: All Quorum reads result in writes?

2012-04-11 Thread Thibaut Britz
12 at 5:52 PM, R. Verlangen wrote: > Are you sure this isn't read-repair? > http://wiki.apache.org/cassandra/ReadRepair > > > 2012/4/11 Thibaut Britz > >> Also executing the same multiget rangeslice query over the same range >> again will trigger the same writes a

Re: cassandra 0.8.7 + hector 0.8.3: All Quorum reads result in writes?

2012-04-11 Thread Thibaut Britz
Also executing the same multiget rangeslice query over the same range again will trigger the same writes again and again. On Wed, Apr 11, 2012 at 5:41 PM, Thibaut Britz < thibaut.br...@trendiction.com> wrote: > Hi, > > I just diagnosted this strange behavior: > > When

cassandra 0.8.7 + hector 0.8.3: All Quorum reads result in writes?

2012-04-11 Thread Thibaut Britz
Hi, I just diagnosted this strange behavior: When I fetch a rangeslice through hector and set the consistency level to quorum, according to cfstats (and also to the output files on the hd), cassandra seems to execute a write request for each read I execute. The write count in cfstats is increased

Re: how stable is 1.0 these days?

2012-03-05 Thread Thibaut Britz
was fixed. > > > 2012/3/2 Marcus Eriksson > >> beware of https://issues.apache.org/jira/browse/CASSANDRA-3820 though if >> you have many keys per node >> >> other than that, yep, it seems solid >> >> /Marcus >> >> >> On Wed, Feb 2

Re: how stable is 1.0 these days?

2012-02-29 Thread Thibaut Britz
Thanks! We will test it on our test cluster in the coming weeks and hopefully put it into production on our 200 node main cluster. :) Thibaut On Wed, Feb 29, 2012 at 5:52 PM, Edward Capriolo wrote: > On Wed, Feb 29, 2012 at 10:35 AM, Thibaut Britz > wrote: > > Any more feedba

Re: how stable is 1.0 these days?

2012-02-29 Thread Thibaut Britz
Any more feedback on larger deployments of 1.0.*? We are eager to try out the new features in production, but don't want to run into bugs as on former 0.7 and 0.8 versions. Thanks, Thibaut On Tue, Jan 31, 2012 at 6:59 AM, Ben Coverston wrote: > I'm not sure what Carlo is referring to, but gen

Re: Accessing expired data

2012-01-03 Thread Thibaut Britz
Thanks Sylvain! That's exactly what I needed to know. On Mon, Jan 2, 2012 at 12:49 PM, Sylvain Lebresne wrote: > On Mon, Jan 2, 2012 at 11:51 AM, Thibaut Britz > wrote: > > Hi, > > > > due to a misconfiguration on our site, some parts of our data got saved >

Accessing expired data

2012-01-02 Thread Thibaut Britz
Hi, due to a misconfiguration on our site, some parts of our data got saved with a wrong expiration date, which expired just recently. How can I recover the data? Is it sufficient to copy over a backup of the tables into the table directory and iterate over the table (e.g. Read.ALL). Does cassand

Re: 0.8.1: JVM Crash Segmentation Fault

2011-11-02 Thread Thibaut Britz
Hi, We use these type of crashes as indicator that the node might have some hardware errors. Did you check the ram? (eg memtest86) Thibaut On Wed, Nov 2, 2011 at 2:03 PM, Jahangir Mohammed wrote: > Hello All, > > JVM is crashing on the cassandra nodes. Re-start doesn't help for long. > > Ri

Re: [RELEASE] Apache Cassandra 1.0 released

2011-10-18 Thread Thibaut Britz
Great news! Especially the improved read performance and compactions are great! Thanks, Thibaut On Tue, Oct 18, 2011 at 2:11 PM, Jonathan Ellis wrote: > Thanks for the help, everyone!  This is a great milestone for Cassandra. > > On Tue, Oct 18, 2011 at 7:01 AM, Sylvain Lebresne > wrote: >>

Re: Cluster key distribution wrong after upgrading to 0.8.4

2011-08-22 Thread Thibaut Britz
ve keys are of any length, how many values exist between > a and h ? > > Cheers > > - > Aaron Morton > Freelance Cassandra Developer > @aaronmorton > http://www.thelastpickle.com > > On 22/08/2011, at 3:33 AM, Thibaut Britz wrote: > >> Hi, >> &

Re: Cluster key distribution wrong after upgrading to 0.8.4

2011-08-21 Thread Thibaut Britz
from cfstats to get an idea > of whats happening. > Hope that helps. > - > Aaron Morton > Freelance Cassandra Developer > @aaronmorton > http://www.thelastpickle.com > On 19/08/2011, at 9:42 PM, Thibaut Britz wrote: > > Hi, > > we were using apache-cassandra-2011-06-

Cluster key distribution wrong after upgrading to 0.8.4

2011-08-19 Thread Thibaut Britz
Hi, we were using apache-cassandra-2011-06-28_08-04-46.jar so far in production and wanted to upgrade to 0.8.4. Our cluster was well balanced and we only saved keys with a lower case md5 prefix. (Orderpreserving partitioner). Each node owned 20% of the tokens, which was also displayed on each nod

Re: Native heap leaks?

2011-05-05 Thread Thibaut Britz
Reading this, I tried it again (this time on a freshly formated node due to hd failure). Before crashing, my data dir was only 7.7M big. Using nmap_indexonly (mlockall was successfull) on a 64bit machine. Anything else I could try to get this to work? Ps. All the other nodes (and this node) run f

Re: OOM on heavy write load

2011-04-28 Thread Thibaut Britz
Could this be related as well to https://issues.apache.org/jira/browse/CASSANDRA-2463? Thibaut On Wed, Apr 27, 2011 at 11:35 PM, Aaron Morton wrote: > I'm a bit confused by the two different cases you described, so cannot > comment specially on your case. > > In general if Cassandra is slowing

Re: SSTable Corruption

2011-03-24 Thread Thibaut Britz
Just accidently hard resetet a node running 0.7.2 (with some patches from 0.7.3) and had the same problem. I'm a little hesitating upgrading to 0.7.4 Can I always delete the Statistics.db without any data loss? Thibaut On Thu, Mar 24, 2011 at 1:37 AM, Brandon Williams wrote: > On Wed, Mar 23

Re: Upgrade to a different version?

2011-03-17 Thread Thibaut Britz
t On Thu, Mar 17, 2011 at 6:53 PM, Paul Pak wrote: > On 3/17/2011 1:06 PM, Thibaut Britz wrote: > > If it helps you to sleep better, > > > > we use cassandra (0.7.2 with the flush fix) in production on > 100 > > servers. > > > > Thibaut > > > >

Re: Upgrade to a different version?

2011-03-17 Thread Thibaut Britz
As for the version, we will wait a few more days, and if nothing really bad shows up, move to 0.7.4. On Thu, Mar 17, 2011 at 10:40 PM, Thibaut Britz < thibaut.br...@trendiction.com> wrote: > Hi Paul, > > It's more of a scientific mining app. We crawl websites and extrac

Re: Upgrade to a different version?

2011-03-17 Thread Thibaut Britz
If it helps you to sleep better, we use cassandra (0.7.2 with the flush fix) in production on > 100 servers. Thibaut On Thu, Mar 17, 2011 at 5:58 PM, Paul Pak wrote: > I'm at a crossroads right now. We built an application around .7 and > the features in .7, so going back to .6 wasn't an opt

Re: Fill disks more than 50%

2011-02-24 Thread Thibaut Britz
Hi, How would you use rsync instead of repair in case of a node failure? Rsync all files from the data directories from the adjacant nodes (which are part of the quorum group) and then run a compactation which will? remove all the unneeded keys? Thanks, Thibaut On Thu, Feb 24, 2011 at 4:22 AM,

Re: Benchmarking Cassandra with YCSB

2011-02-15 Thread Thibaut Britz
Cassandra is very CPU hungry so you might be hitting a CPU bottleneck. What's your CPU usage during these tests? On Tue, Feb 15, 2011 at 8:45 PM, Markus Klems wrote: > Hi there, > > we are currently benchmarking a Cassandra 0.6.5 cluster with 3 > High-Mem Quadruple Extra Large EC2 nodes > (http:

Re: What if write consistency level cannot me met ?

2011-02-15 Thread Thibaut Britz
Your write will fail. But if the write has reached at least one node, it will eventually reach all the other nodes as well. So it won't rollback. On Tue, Feb 15, 2011 at 7:38 PM, A J wrote: > Say I set write consistency level to ALL and all but one node are down. What > happens to writes ? Does

Re: [0.7.1] more exceptions: Illegal mode

2011-02-07 Thread Thibaut Britz
I think this is related to a faulty disk. On Mon, Feb 7, 2011 at 3:35 PM, Patrik Modesto wrote: > INFO 15:30:49,647 Compacted to > /www/foo/cassandra/data/foo/Url-tmp-f-767-Data.db.  4,199,999,762 to > 4,162,579,242 (~99% of original) bytes for 379,179 keys.  Time: > 137,149ms. > ERROR 15:30:49,

Re: Bootstrapping taking long

2011-01-05 Thread Thibaut Britz
uot;Avoid dropping messages off the client > request path" (CASSANDRA-1676) related to the bootstrap questions I had? > > > On Wed, Jan 5, 2011 at 5:23 PM, Thibaut Britz < > thibaut.br...@trendiction.com> wrote: > >> https://issues.apache.org/jira/browse/CASSANDRA-1676 &g

Re: Bootstrapping taking long

2011-01-05 Thread Thibaut Britz
https://issues.apache.org/jira/browse/CASSANDRA-1676 you have to use at least 0.6.7 On Wed, Jan 5, 2011 at 4:19 PM, Edward Capriolo wrote: > On Wed, Jan 5, 2011 at 10:05 AM, Ran Tavory wrote: > > In storage-conf I see this comment [1] from which I understand that the > > recommended way to boo

Re: Quorum: killing 1 out of 3 server kills the cluster (?)

2010-12-09 Thread Thibaut Britz
Hi, The UnavailableExceptions will be thrown because quorum of size 2 needs at least 2 nodes to be alive (as for qurom of size 3 as well). The data won't be automatically redistributed to other nodes. Thibaut On Thu, Dec 9, 2010 at 4:40 PM, Timo Nentwig wrote: > Hi! > > I've 3 servers runnin

Re: Question about consitency level & data propagation & eventually consistent

2010-11-11 Thread Thibaut Britz
ke sure that my application won't read from this node). I guess chaning the port temporarely will not work, since cassandra will communicate the node through the other nodes to my client? Thanks, Thibaut On Wed, Nov 10, 2010 at 5:52 PM, Jonathan Ellis wrote: > On Wed, Nov 10, 2010 at

Question about consitency level & data propagation & eventually consistent

2010-11-10 Thread Thibaut Britz
Hi, Assuming I'm reading and writing with consitency level 1 (one), read repair turned off, I have a few questions about data propagation. Data is being stored at consistency level 3. I'm not interested in the deletes. I can live with older data (or data that has been deleted and will reappear),

Re: New nodes won't bootstrap on .66

2010-11-08 Thread Thibaut Britz
t; when having multiple keyspaces. >> >> 2010/11/8 Thibaut Britz >> >> Hi, >>> >>> No I didn't solve the problem. I reinitialized the cluster and gave each >>> node manually a token before adding data. There are a few messages in >>>

Re: New nodes won't bootstrap on .66

2010-11-08 Thread Thibaut Britz
ing nodes are 32 bits. Can > this be a problem? > > Thank you. > > > 2010/10/28 Dimitry Lvovsky > > Maybe your7000 is being blocked by iptables >> or some firewall or maybe you have it bound ( tag ) to >> localhost instead an ip address. >> >> Ho

Re: New nodes won't bootstrap on .66

2010-10-28 Thread Thibaut Britz
Hi, I have the same problem with 0.6.5 New nodes will hang forever in bootstrap mode (no streams are being opened) and the receiver thread just waits for data forever: INFO [Thread-53] 2010-10-27 20:33:37,399 SSTableReader.java (line 120) Sampling index for /hd2/cassandra/data/table_xyz/ table

Re: Cluster load balancing?

2010-10-28 Thread Thibaut Britz
> > On Wed, Oct 27, 2010 at 1:46 PM, Thibaut Britz < > thibaut.br...@trendiction.com> wrote: > >> Depending on the range I choose, choosing manually a token will also fail. >> (node will never exit boostrap, streams doesn't list any open streams)

Re: Cluster load balancing?

2010-10-27 Thread Thibaut Britz
nt.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) On Wed, Oct 27, 2010 at 8:27 PM, Thibaut Britz < thibaut.br...@trendiction.com> wrote: > Hello Tyler, > > thanksf or the quick answer. That's true, I should have

Re: Cluster load balancing?

2010-10-27 Thread Thibaut Britz
not* evenly > distributed > around the ring. > > Apparently you have lots of keys that are between ~'t' and 'x', so start > bunching > your tokens there. > > - Tyler > > > On Wed, Oct 27, 2010 at 12:00 PM, Thibaut Britz < > thibaut.br...

Re: Job Opportunity in Europe (Nosql, hadoop, crawling)

2010-08-25 Thread Thibaut Britz
: > Hi, > I have worked on Cassandra, Thrift and Hector, and I did it for 3 months, I > have written code for loading and fetching data from Cassandra in single > node, I want to work on this domain. Will u provide me the environment to > work on this? > > > On Wed, Aug 18,

Job Opportunity in Europe (Nosql, hadoop, crawling)

2010-08-18 Thread Thibaut Britz
Hi, We are searching at least 3 more developers in the fields of search & automatic content/site extraction, crawling, duplicate content, news/spam detection. We do content fetching and aggregation (news,message boards, blogs, ...) for market research institutes, media analytics companies, etc...