On Apr 4, 2013, at 6:24 PM, Matthew MacClary
wrote:
> I am measuring throughput by the wall clock time needed to move a few gigs of
> data into Riak. I have glanced at iostat, but I was not collecting data from
> that tool at this point.
It's worth noting then that comparing throughput of th
If you are not adverse to building from source, you might like the leveldb
updates slated for 1.4 Riak. There is an emphasis on write throughput. The
best branch for trial would be mv-level-work2 in github's basho/leveldb
repository. I suspect you will find about 50% improvement in data inges
PBC is certainly something I have on my list of things to explore.
Conceptually I am not sure if the speed gains from this protocol will be
apparent with large binary payloads. I thought that main speed gains were
from 1) more compact binary representation and 2) lower interpretation
overhead. In m
I am measuring throughput by the wall clock time needed to move a few gigs
of data into Riak. I have glanced at iostat, but I was not collecting data
from that tool at this point.
-Matt
On Thu, Apr 4, 2013 at 2:45 PM, Reid Draper wrote:
>
> On Apr 4, 2013, at 4:14 PM, Matthew MacClary <
> macc
On Apr 4, 2013, at 4:14 PM, Matthew MacClary
wrote:
> Thanks for the feedback. I made two changes to my test setup and saw better
> throughput:
>
> 1) Don't write to the same key over and over. Updating a key appears to be a
> lot slower than creating a new key
>
> 2) I used parallel PUTs
>
Just as a side note, you might want to retry the test with PBC. While I
have only did testings with < 10kb documents, my tests indicates that
PBC is twice as fast as HTTP in almost all cases.
Shuhao
On 13-04-04 04:14 PM, Matthew MacClary wrote:
Thanks for the feedback. I made two changes to m
Thanks for the feedback. I made two changes to my test setup and saw better
throughput:
1) Don't write to the same key over and over. Updating a key appears to be
a lot slower than creating a new key
2) I used parallel PUTs
The throughput I was measuring before was about 26MB/s on localhost. Wit
inline:
On Apr 2, 2013, at 6:48 PM, Matthew MacClary
wrote:
> Hi all, I am new to this list. Thanks for taking the time to read my
> questions! I just want to know if the data throughput I am seeing is expected
> for the bitcask backend or if it is too low.
>
> I am doing the preliminary fe
Hi all, I am new to this list. Thanks for taking the time to read my
questions! I just want to know if the data throughput I am seeing is
expected for the bitcask backend or if it is too low.
I am doing the preliminary feasibility study to decide if we should
implement a Riak data store. Our appli
