Hi Daniel, Thanks for providing all of that information.
You are missing important configuration for riak_kv that can only be provided in an /etc/riak/advanced.config file. Please see the following document, especially the section to which I link here: http://docs.basho.com/riak/cs/2.1.1/cookbooks/configuration/ riak-for-cs/#setting-up-the-proper-riak-backend [ {riak_kv, [ *% NOTE: double-check this path for your environment:* {add_paths, ["/usr/lib/riak-cs/lib/riak_cs-2.1.1/ebin"]}, {storage_backend, riak_cs_kv_multi_backend}, {multi_backend_prefix_list, [{<<"0b:">>, be_blocks}]}, {multi_backend_default, be_default}, {multi_backend, [ {be_default, riak_kv_eleveldb_backend, [ {data_root, "/opt/data/ecryptfs/riak"} ]}, {be_blocks, riak_kv_eleveldb_backend, [ {data_root, "/opt/data/ecryptfs/riak_blocks"} ]} ]} ]} ]. Your configuration will look like the above. The contents of this file are merged with the contents of /etc/riak/riak.conf to produce the configuration that Riak uses. Notice that I chose riak_kv_eleveldb_backend twice because of the discussion you had previously about RAM usage and bitcask ( http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-November/ 018801.html) In your current configuration, you are not using the expected prefix for the block data. My guess is that on very rare occasions your data happens to overwrite the manifest for a file. You may also have corrupted files at this point without noticing it at all. *IMPORTANT:* you can't switch from your current configuration to this new one without re-saving all of your data. -- Luke Bakken Engineer lbak...@basho.com -- Luke Bakken Engineer lbak...@basho.com On Tue, Mar 7, 2017 at 6:47 AM, Daniel Miller <dmil...@dimagi.com> wrote: > Responses inline. > > On Mon, Mar 6, 2017 at 3:04 PM, Luke Bakken <lbak...@basho.com> wrote: > >> Hi Daniel, >> >> Two questions: >> >> * Do you happen to have an /etc/riak/app.config file present? >> > > No. > > Not sure if relevant, but I did notice that /etc/riak-cs/advanced.config > does exist, which contradicts with what I said earlier. This is surprising > to me because I did not create this file. Maybe it was created by the riak > installer? Anyway, the content is: > > $ cat /etc/riak-cs/advanced.config > [ > {riak_cs, > [ > ]} > ]. > > >> >> * On one of your Riak nodes, could you please execute the following >> commands: >> >> riak attach >> rp(application:get_all_env(riak_kv)). >> >> Copy the output of the previous command and attach as a separate file >> to your response. Please note that the period is significant. Use >> CTRL-C CTRL-C to exit the "riak attach" session. >> > > Attached. > > >
_______________________________________________ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com