You can also add in that Riak is, by default, going to pull back the freshly
written copy of the data from disk. You can disable this behavior by setting
ReturnBody to false. Disabling this is great for bulk data loads.
Consumer hard drives just plain suck for performance. You're going to be
li
On 11/20/2011 01:34 PM, Catalin Constantin wrote:
To make it simple. No more networking. Just one node (with n = 1) and
local tests.
The producing of data is a simple CSV file read (ruled out too cause
this is fast).
Read from the same disk? If you're interleaving every write with a read
from
To make it simple. No more networking. Just one node (with n = 1) and local
tests.
The producing of data is a simple CSV file read (ruled out too cause this
is fast).
Switched to bitcask:
{storage_backend, riak_kv_bitcask_backend},
Removed the index from the RiakObject (so now we have simple k/v)
Kyle's recommendations are solid.
If you're reaching a maximum throughput rate of 300 inserts per second
regardless of number of nodes, then there's a fundamental infrastructure
problem.
Eliminate every possible bottleneck one at a time:
You can eliminate disk as a bottleneck by testing with
On 11/20/2011 12:14 PM, Catalin Constantin wrote:
I am 100% sure the transfer rate is 10MBytes / second. This is not the
problem.
In ten years of network administration I have never encountered an
ethernet device with a wire rate of 10 MBps. I have, however,
encountered frequent confusion ove
*basho.com
>>
>> <mailto:riak-users-bounces@**lists.basho.com>]
>> On Behalf Of Catalin
>>Constantin [daz...@gmail.com <mailto:daz...@gmail.com>]
>>
>>Sent: 20 November 2011 11:10
>>To: riak-users@lists.basho.com
>> <mailt
l.com>]
Sent: 20 November 2011 11:10
To: riak-users@lists.basho.com <mailto:riak-users@lists.basho.com>
Subject: slow 2 node cluster
Hello,
I am trying to evaluate / run some tests on a 4 mil dataset.
I have 2 nodes setup (different machines - 8GB ram each, I7 cpus)
the network utilization.
>
> From: riak-users-boun...@lists.basho.com [
> riak-users-boun...@lists.basho.com] On Behalf Of Catalin Constantin [
> daz...@gmail.com]
> Sent: 20 November 2011 11:10
> To: riak-users@lists.basho.com
> Subject: slow 2 node cluster
>
Constantin [daz...@gmail.com]
Sent: 20 November 2011 11:10
To: riak-users@lists.basho.com
Subject: slow 2 node cluster
Hello,
I am trying to evaluate / run some tests on a 4 mil dataset.
I have 2 nodes setup (different machines - 8GB ram each, I7 cpus).
10 MB connection between them.
I am trying to
Hello,
I am trying to evaluate / run some tests on a 4 mil dataset.
I have 2 nodes setup (different machines - 8GB ram each, I7 cpus).
10 MB connection between them.
I am trying to insert data into riak using w=1 and dw=1 (also tried with dw
= 0, w = 0).
For each risk object i have 4 indexes (2 b
10 matches
Mail list logo
