RE: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-07 Thread Poziombka, Wade L
duh, sorry. That estimate is 2 TB would be 15 nodes rf = 3 From: Poziombka, Wade L [mailto:wade.l.poziom...@intel.com] Sent: Friday, December 07, 2012 7:15 AM To: user@cassandra.apache.org Subject: RE: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction. So if my calculations

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-07 Thread Hiller, Dean
elastpickle.com] Sent: Thursday, December 06, 2012 9:43 PM To: user@cassandra.apache.org<mailto:user@cassandra.apache.org> Subject: Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction. Meaning terabyte size databases. Lots of people have TB sized systems. Just add

RE: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-07 Thread Poziombka, Wade L
de From: aaron morton [mailto:aa...@thelastpickle.com<mailto:aa...@thelastpickle.com>] Sent: Wednesday, December 05, 2012 9:23 PM To: user@cassandra.apache.org<mailto:user@cassandra.apache.org> Subject: Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction. Basically we w

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-06 Thread Michael Kjellman
red to recover downed node. > But this 300-400MB business is interesting to me. > > > > Thanks in advance. > > > > Wade > > > > > > From: aaron morton [mailto:aa...@thelastpickle.com] > Sent: Wednesday, December 05, 2012 9:23 PM > To: user@ca

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-06 Thread Wei Zhu
I think Aaron meant 300-400GB instead of 300-400MB. Thanks. -Wei - Original Message - From: "Wade L Poziombka" To: user@cassandra.apache.org Sent: Thursday, December 6, 2012 6:53:53 AM Subject: RE: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction. “

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-06 Thread aaron morton
; > Wade > > > > From: aaron morton [mailto:aa...@thelastpickle.com] > Sent: Wednesday, December 05, 2012 9:23 PM > To: user@cassandra.apache.org > Subject: Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered > compaction. > > > > Basically we were

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-06 Thread Edward Capriolo
dnesday, December 05, 2012 9:23 PM > *To:* user@cassandra.apache.org > *Subject:* Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered > compaction. > > ** ** > > Basically we were successful on two of the nodes. They both took ~2 days > and 11 hours to compl

RE: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-06 Thread Poziombka, Wade L
12 9:23 PM To: user@cassandra.apache.org Subject: Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction. Basically we were successful on two of the nodes. They both took ~2 days and 11 hours to complete and at the end we saw one very large file ~900GB and the rest much sm

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-05 Thread aaron morton
> Basically we were successful on two of the nodes. They both took ~2 days and > 11 hours to complete and at the end we saw one very large file ~900GB and the > rest much smaller (the overall size decreased). This is what we expected! I would recommend having up to 300MB to 400MB per node on a re

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-05 Thread Alexandru Sicoe
Hi guys, Sorry for the late follow-up but I waited to run major compactions on all 3 nodes at a time before replying with my findings. Basically we were successful on two of the nodes. They both took ~2 days and 11 hours to complete and at the end we saw one very large file ~900GB and the rest muc

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-11-22 Thread aaron morton
> From what I know having too much data on one node is bad, not really sure > why, but I think that performance will go down due to the size of indexes > and bloom filters (I may be wrong on the reasons but I'm quite sure you can't > store too much data per node). If you have many hundreds of

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-11-22 Thread Alain RODRIGUEZ
Hi Alexandru, "We are running a 3 node Cassandra 1.1.5 cluster with a 3TB Raid 0 disk per node for the data dir and separate disk for the commitlog, 12 cores, 24 GB RAM" I think you should tune your architecture in a very different way. From what I know having too much data on one node is bad, no