Performance testing different virtual machine cluster configurations
Hi group, I've been happily using Riak in production on VMs for years. It's time to scale up so I'm running performance tests with basho_bench and my own app code on a new VM cluster. Here's an example question I'd like to answer: will a cluster perform better with 5 VMs at 8gb each, or 10 VMs at 4gb each? The cost of the VMs is the same, and I'm guessing the performance will not be exactly the same. As I'm going through the trouble, I'll share my results. I hope this will be interesting to other people, especially with all the changes in Riak 2.0. I really like Riak so I want to make sure I give it a fair showing. Please review my config and initial results below. So far I've set up the first cluster of 5 VMs with 8gb each. I'm driving the test off a separate (6th) VM. I anticipate I'll set up the second cluster with 10 VMs at 4GB each in the next few days. Please let me know if you have any suggestions. Thanks! Daniel -- initial results: basho_bench riakc_pb for 5vm cluster, 8gb on each machine: https://www.dropbox.com/s/mpt9ame3t082lct/5vm-8gb-riakc_pb.png basho_bench counters for 5vm cluster, 8gb on each machine: https://www.dropbox.com/s/8eyp1zbpy5h16s1/5vm-8gb-counters.png riak.conf used for these tests: https://www.dropbox.com/s/krufixa2wmnaxum/base.riak.conf.txt I'm currently loading records in to the cluster through my app code. After 18h and 68M records, they're still going in at 1k records/second. The records are around 750 bytes each. They're each indexed with either 4 or 6 different 2i values. Search indexing is on as well. I'm going to use this test dataset to compare 2i vs search for my application. system stuff: VM plan through linode: 8 GB RAM 6 CPU Cores 192 GB SSD Storage 8 TB Transfer 40 Gbit Network In 1000 Mbit Network Out filesystem: /dev/xvda on / type ext4 (rw,noatime,errors=remount-ro) file limits: riak soft nofile 65536 riak hard nofile 65536 root soft nofile 65536 root hard nofile 65536 ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
A question about Riak search 2 delete values from index
Hi there,
I am trying riak search 2, and have followed instructions on
http://docs.basho.com/riak/2.0.0/dev/using/search/
to create an index and query an index without any problems.
However, I could not delete values from the index by either i) using the
solr interface, or ii) search-cmd, I followed instructions on
http://docs.basho.com/riak/2.0.0/dev/references/search-indexing/
Could you please help?
The error from the solr interface is as follows:
curl -XPOST http://localhost:8098/solr/famous/update -H
'content-type:text/xml' --data-binary @delete.xml
404 Not FoundNot FoundThe
requested document was not found on this
server.mochiweb+webmachine web
server
The following is the error by search-cmd:
search-cmd show-schema famous
** The search-cmd tool is for a deprecated version of Riak Search.
** Please upgrade to the new version of Riak Search.
%% Schema for 'famous'
RPC to 'riak@127.0.0.1' failed: {'EXIT',
{noproc,
{gen_server,call,
[riak_search_config,
{get_raw_schema,<<"famous">>},
infinity]}}}
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: A question about Riak search 2 delete values from index
Hi Kevin,
The top of the document you reference has this disclaimer:
"This document refers to the now deprecated Riak Search."
Please use this document as a reference (you link to it earlier in your email):
http://docs.basho.com/riak/2.0.0/dev/using/search/
Finally, if you inserted objects using Riak's Key/Value operations,
you should delete them that way as well. Have you tried that?
--
Luke Bakken
CSE
lbak...@basho.com
On Tue, Aug 26, 2014 at 3:30 PM, Kevin Chan wrote:
> Hi there,
>
> I am trying riak search 2, and have followed instructions on
> http://docs.basho.com/riak/2.0.0/dev/using/search/
> to create an index and query an index without any problems.
>
> However, I could not delete values from the index by either i) using the
> solr interface, or ii) search-cmd, I followed instructions on
> http://docs.basho.com/riak/2.0.0/dev/references/search-indexing/
>
> Could you please help?
>
>
> The error from the solr interface is as follows:
>
>
> curl -XPOST http://localhost:8098/solr/famous/update -H
> 'content-type:text/xml' --data-binary @delete.xml
>
> 404 Not FoundNot FoundThe
> requested document was not found on this
> server.mochiweb+webmachine web
> server
>
>
>
> The following is the error by search-cmd:
>
> search-cmd show-schema famous
> ** The search-cmd tool is for a deprecated version of Riak Search.
> ** Please upgrade to the new version of Riak Search.
>
> %% Schema for 'famous'
> RPC to 'riak@127.0.0.1' failed: {'EXIT',
> {noproc,
> {gen_server,call,
>[riak_search_config,
> {get_raw_schema,<<"famous">>},
> infinity]}}}
>
> ___
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: A question about Riak search 2 delete values from index
Thank you, Luke! I inserted values followed examples in
http://docs.basho.com/riak/2.0.0/dev/using/search/
curl -XPUT "$RIAK_HOST/types/animals/buckets/cats/keys/liono" \ -H
'content-type:application/json' \ -d'{"name_s":"Lion-o", "age_i":30,
"leader_b":true}'
However, it is not clear to remove this key. I tried this:
curl -v -X DELETE http://127.0.0.1:8098/buckets/cats/keys/liono
< HTTP/1.1 404 Object Not Found
* Server MochiWeb/1.1 WebMachine/1.10.5 (jokes are better explained) is not
blacklisted
< Server: MochiWeb/1.1 WebMachine/1.10.5 (jokes are better explained)
< Date: Tue, 26 Aug 2014 23:14:40 GMT
< Content-Type: text/plain
< Content-Length: 10
On Tue, Aug 26, 2014 at 3:44 PM, Luke Bakken wrote:
> Hi Kevin,
>
> The top of the document you reference has this disclaimer:
>
> "This document refers to the now deprecated Riak Search."
>
> Please use this document as a reference (you link to it earlier in your
> email):
>
> http://docs.basho.com/riak/2.0.0/dev/using/search/
>
> Finally, if you inserted objects using Riak's Key/Value operations,
> you should delete them that way as well. Have you tried that?
>
> --
> Luke Bakken
> CSE
> lbak...@basho.com
>
>
> On Tue, Aug 26, 2014 at 3:30 PM, Kevin Chan wrote:
> > Hi there,
> >
> > I am trying riak search 2, and have followed instructions on
> > http://docs.basho.com/riak/2.0.0/dev/using/search/
> > to create an index and query an index without any problems.
> >
> > However, I could not delete values from the index by either i) using the
> > solr interface, or ii) search-cmd, I followed instructions on
> > http://docs.basho.com/riak/2.0.0/dev/references/search-indexing/
> >
> > Could you please help?
> >
> >
> > The error from the solr interface is as follows:
> >
> >
> > curl -XPOST http://localhost:8098/solr/famous/update -H
> > 'content-type:text/xml' --data-binary @delete.xml
> >
> > 404 Not FoundNot
> FoundThe
> > requested document was not found on this
> > server.mochiweb+webmachine web
> > server
> >
> >
> >
> > The following is the error by search-cmd:
> >
> > search-cmd show-schema famous
> > ** The search-cmd tool is for a deprecated version of Riak Search.
> > ** Please upgrade to the new version of Riak Search.
> >
> > %% Schema for 'famous'
> > RPC to 'riak@127.0.0.1' failed: {'EXIT',
> > {noproc,
> > {gen_server,call,
> >[riak_search_config,
> > {get_raw_schema,<<"famous">>},
> > infinity]}}}
> >
> > ___
> > riak-users mailing list
> > riak-users@lists.basho.com
> > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
> >
>
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: A question about Riak search 2 delete values from index
Hi Kevin -
Notice that your PUT statement uses the bucket type "animals" and
"cats" bucket within that type:
curl -XPUT "$RIAK_HOST/types/animals/buckets/cats/keys/liono"
The corresponding delete would be this statement:
curl -XDELETE "$RIAK_HOST/types/animals/buckets/cats/keys/liono"
--
Luke Bakken
CSE
lbak...@basho.com
On Tue, Aug 26, 2014 at 4:16 PM, Kevin Chan wrote:
>
> Thank you, Luke! I inserted values followed examples in
> http://docs.basho.com/riak/2.0.0/dev/using/search/
>
> curl -XPUT "$RIAK_HOST/types/animals/buckets/cats/keys/liono" \
> -H'content-type:application/json' \ -d'{"name_s":"Lion-o", "age_i":30,
> "leader_b":true}'
>
> However, it is not clear to remove this key. I tried this:
>
> curl -v -X DELETE http://127.0.0.1:8098/buckets/cats/keys/liono
>
> < HTTP/1.1 404 Object Not Found
> * Server MochiWeb/1.1 WebMachine/1.10.5 (jokes are better explained) is not
> blacklisted
> < Server: MochiWeb/1.1 WebMachine/1.10.5 (jokes are better explained)
> < Date: Tue, 26 Aug 2014 23:14:40 GMT
> < Content-Type: text/plain
> < Content-Length: 10
>
>
>
>
> On Tue, Aug 26, 2014 at 3:44 PM, Luke Bakken wrote:
>>
>> Hi Kevin,
>>
>> The top of the document you reference has this disclaimer:
>>
>> "This document refers to the now deprecated Riak Search."
>>
>> Please use this document as a reference (you link to it earlier in your
>> email):
>>
>> http://docs.basho.com/riak/2.0.0/dev/using/search/
>>
>> Finally, if you inserted objects using Riak's Key/Value operations,
>> you should delete them that way as well. Have you tried that?
>>
>> --
>> Luke Bakken
>> CSE
>> lbak...@basho.com
>>
>>
>> On Tue, Aug 26, 2014 at 3:30 PM, Kevin Chan wrote:
>> > Hi there,
>> >
>> > I am trying riak search 2, and have followed instructions on
>> > http://docs.basho.com/riak/2.0.0/dev/using/search/
>> > to create an index and query an index without any problems.
>> >
>> > However, I could not delete values from the index by either i) using the
>> > solr interface, or ii) search-cmd, I followed instructions on
>> > http://docs.basho.com/riak/2.0.0/dev/references/search-indexing/
>> >
>> > Could you please help?
>> >
>> >
>> > The error from the solr interface is as follows:
>> >
>> >
>> > curl -XPOST http://localhost:8098/solr/famous/update -H
>> > 'content-type:text/xml' --data-binary @delete.xml
>> >
>> > 404 Not FoundNot FoundThe
>> > requested document was not found on this
>> > server.mochiweb+webmachine web
>> > server
>> >
>> >
>> >
>> > The following is the error by search-cmd:
>> >
>> > search-cmd show-schema famous
>> > ** The search-cmd tool is for a deprecated version of Riak Search.
>> > ** Please upgrade to the new version of Riak Search.
>> >
>> > %% Schema for 'famous'
>> > RPC to 'riak@127.0.0.1' failed: {'EXIT',
>> > {noproc,
>> > {gen_server,call,
>> >[riak_search_config,
>> > {get_raw_schema,<<"famous">>},
>> > infinity]}}}
>> >
>> > ___
>> > riak-users mailing list
>> > riak-users@lists.basho.com
>> > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>> >
>
>
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: A question about Riak search 2 delete values from index
Many thanks for the quick and detailed answer. It works!
On Tue, Aug 26, 2014 at 4:21 PM, Luke Bakken wrote:
> Hi Kevin -
>
> Notice that your PUT statement uses the bucket type "animals" and
> "cats" bucket within that type:
>
> curl -XPUT "$RIAK_HOST/types/animals/buckets/cats/keys/liono"
>
> The corresponding delete would be this statement:
>
> curl -XDELETE "$RIAK_HOST/types/animals/buckets/cats/keys/liono"
>
> --
> Luke Bakken
> CSE
> lbak...@basho.com
>
> On Tue, Aug 26, 2014 at 4:16 PM, Kevin Chan wrote:
> >
> > Thank you, Luke! I inserted values followed examples in
> http://docs.basho.com/riak/2.0.0/dev/using/search/
> >
> > curl -XPUT "$RIAK_HOST/types/animals/buckets/cats/keys/liono" \
> -H'content-type:application/json' \ -d'{"name_s":"Lion-o", "age_i":30,
> "leader_b":true}'
> >
> > However, it is not clear to remove this key. I tried this:
> >
> > curl -v -X DELETE http://127.0.0.1:8098/buckets/cats/keys/liono
> >
> > < HTTP/1.1 404 Object Not Found
> > * Server MochiWeb/1.1 WebMachine/1.10.5 (jokes are better explained) is
> not blacklisted
> > < Server: MochiWeb/1.1 WebMachine/1.10.5 (jokes are better explained)
> > < Date: Tue, 26 Aug 2014 23:14:40 GMT
> > < Content-Type: text/plain
> > < Content-Length: 10
> >
> >
> >
> >
> > On Tue, Aug 26, 2014 at 3:44 PM, Luke Bakken wrote:
> >>
> >> Hi Kevin,
> >>
> >> The top of the document you reference has this disclaimer:
> >>
> >> "This document refers to the now deprecated Riak Search."
> >>
> >> Please use this document as a reference (you link to it earlier in your
> email):
> >>
> >> http://docs.basho.com/riak/2.0.0/dev/using/search/
> >>
> >> Finally, if you inserted objects using Riak's Key/Value operations,
> >> you should delete them that way as well. Have you tried that?
> >>
> >> --
> >> Luke Bakken
> >> CSE
> >> lbak...@basho.com
> >>
> >>
> >> On Tue, Aug 26, 2014 at 3:30 PM, Kevin Chan
> wrote:
> >> > Hi there,
> >> >
> >> > I am trying riak search 2, and have followed instructions on
> >> > http://docs.basho.com/riak/2.0.0/dev/using/search/
> >> > to create an index and query an index without any problems.
> >> >
> >> > However, I could not delete values from the index by either i) using
> the
> >> > solr interface, or ii) search-cmd, I followed instructions on
> >> > http://docs.basho.com/riak/2.0.0/dev/references/search-indexing/
> >> >
> >> > Could you please help?
> >> >
> >> >
> >> > The error from the solr interface is as follows:
> >> >
> >> >
> >> > curl -XPOST http://localhost:8098/solr/famous/update -H
> >> > 'content-type:text/xml' --data-binary @delete.xml
> >> >
> >> > 404 Not FoundNot
> FoundThe
> >> > requested document was not found on this
> >> > server.mochiweb+webmachine web
> >> > server
> >> >
> >> >
> >> >
> >> > The following is the error by search-cmd:
> >> >
> >> > search-cmd show-schema famous
> >> > ** The search-cmd tool is for a deprecated version of Riak Search.
> >> > ** Please upgrade to the new version of Riak Search.
> >> >
> >> > %% Schema for 'famous'
> >> > RPC to 'riak@127.0.0.1' failed: {'EXIT',
> >> > {noproc,
> >> > {gen_server,call,
> >> >[riak_search_config,
> >> > {get_raw_schema,<<"famous">>},
> >> > infinity]}}}
> >> >
> >> > ___
> >> > riak-users mailing list
> >> > riak-users@lists.basho.com
> >> > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
> >> >
> >
> >
>
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Multi-backend and retiring storage
Hello list,
Apologies in advance for the longish preamble - the question (when I get to
it) is fairly straight forward.
We’ve been happily running Riak for a couple of years now using
multi-backend to map various buckets onto different disk locations (for
infosec compliance reasons).
Our config is essentially this:
{riak_kv, [
{storage_backend, riak_kv_multi_backend},
%% Configure multiple eleveldb storage locations
{multi_backend_default, <<"default">>},
{multi_backend, [
%% Default fallback: this is unused
{<<"default">>, riak_kv_eleveldb_backend, [
{data_root, "/mnt/riak/eleveldb/default"}
]},
%% Storage1
{<<"eleveldb_storage1">>, riak_kv_eleveldb_backend, [
{data_root, "/mnt/riak/eleveldb/storage1"}
]},
%% Storage2
{<<"eleveldb_storage2">>, riak_kv_eleveldb_backend, [
{data_root, "/mnt/riak/eleveldb/storage2"}
]},
...
Bucket properties then map Riak buckets onto the relevant backend.
Again for infosec compliance reasons, we need to “retire” one of our
backends, and the data contained therein.
What would a process be for doing this? What happens across the cluster as
I remove the config from each node? At what point can I safely delete the
data directories?
Thanks
Matt
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
