Stefan, The Riak 2.0 technical preview hasn't been heavily tested with Riak CS because it isn't a stable release. The best combination of Riak and Riak CS to run right now is Riak 1.4.2 and Riak CS 1.4.3.
Below are a few settings you can tweak to reclaim disk space more aggressively in Riak CS: - `leeway_seconds` – Number of seconds before an object is garbage collected (might want to start with 3600) - `gc_interval` – Ensure that all nodes in your cluster *but one* are set to `infinity` (disables GC on all nodes but one to reduce redundant work) - `delete_concurrency` – Number of blocks to delete concurrently You may want to add another node to your cluster before making any of these changes so that disk utilization on the existing nodes in your cluster goes down. -- Hector On Sat, Nov 30, 2013 at 6:19 PM, Silasi Stefan <silasiste...@gmail.com> wrote: > Thanks for your reply Hector. > I'm using the simple python/boto script for upload via the > key.set_content_from_file method. Each object has an unique key name. > > Today, 2 of the nodes are at 100% disk usage after I tried to remove one of > them via "riak-admin cluster remove riak@node". > I upgraded to the technical preview version 2.0... so far, it didn't help. > > Thank you, > Stefan. > > > On Sat, Nov 30, 2013 at 8:27 PM, Hector Castro <hec...@basho.com> wrote: >> >> Hello Silasi, >> >> Can you please explain the process you're using to add the image/video >> data into Riak CS? Are you overwriting objects or using multipart >> upload? >> >> -- >> Hector >> >> >> On Thu, Nov 28, 2013 at 5:33 AM, Silasi Stefan <silasiste...@gmail.com> >> wrote: >> > Hello, >> > >> > I'm preparing an evironment for an image/video storage website, with >> > riak-cs >> > on top of riak cluster. >> > I have 5 servers with a 900gb disk each and about 700gb of images/videos >> > collected, mainly images. >> > >> > I have a little over 300,000 objects in total, all stored in one place >> > occupying a little over 700gb data. Based on the formula: 700gb x 3 >> > replication factor, I was expecting to use around 2.1-2.2 TB data. >> > >> > After uploading half of the 700gb data (350gb x 3 = 1,05TB), I notice >> > the >> > disk usage is around 70% already on all nodes (640gb x 5 = ~3.2TB). The >> > nodes are dedicated to riak/riak-cs. >> > >> > Am I missing something? >> > >> > Thank you, >> > Stefan. >> > >> > _______________________________________________ >> > riak-users mailing list >> > riak-users@lists.basho.com >> > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com >> > > > _______________________________________________ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
