Re: Riak 1.4.2 10G Ethernet Performance Problems

2014-06-20 Thread Chris Read
We still have this problem (we're on riak 1.4.9) and it's very frustrating! Our average object size right now is ~250k. We're running with: +zdbbl 2097151 I've tried the settings above on a 5 node test cluster, no improvement. I then bumped both buffers up to 1048576 on all nodes - no improvem

Re: Riak 1.4.2 10G Ethernet Performance Problems

2014-06-20 Thread Evan Vigil-McClanahan
In my testing with large but smaller binaries (median 40k), I found that the settings gave a noticeable bump (8000 -> 1 ops/s) , but only so far as the disk could keep up (and the disk cache, of course). Typically, for larger objects, you're going to be disk limited most of the time. Remember

Re: Riak 1.4.2 10G Ethernet Performance Problems

2014-06-20 Thread Earl Ruby
True, but if I test random-writes of 1M objects using fio on the filesystem -- no Riak involved -- the disk random write aggregate speed (32 fio threads all randomly writing to one node's array) is 9.4 Gbits/sec ***per node***, and I have 6 nodes. If Riak was distributing all writes evenly and I ha