Hi, On 13 Feb 2013, at 07:37, Bogdan Flueras <flueras.bog...@gmail.com> wrote:
> Hello all, > I've got a 5 node cluster with Riak 1.2.1, all machines are multicore, > with min 4GB RAM. > > I want to insert something like 50 million records in Riak with the java > client (Protobuf used) with default settings. I've tried also with HTTP > protocol and set w = 1 but got some problems. > > However the process is very slow: it doesn't write more than 6GB/ hour or > aprox. 280 KB/second. > To have all my data filled in, it would take aprox 2 days !! > > What can I do to have the data filled into Riak ASAP? > How should I configure the cluster ? (vm.args/ app.config) I don't care so > much about consistency at this point. If you are certain to be only inserting new data setting your bucket(s) to last write wins will speed things up. Also, are you using multiple threads for the Java client insert? Spreading the load across all five nodes? Are you using the "withoutFetch()" option on the java client? Cheers Russell > > Thank you, > ing. Bogdan Flueras > > _______________________________________________ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com _______________________________________________ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
