yz_index_hashtree error every 1 hour
Hi,
I'm getting the error below on all 5 nodes of a cluster, exactly once every
hour. I'm running Riak 2.1.1 and have search enabled on all nodes.
[error] emulator Error in process <0.10379.177> on node 'riak@192.168.100.20'
with exit value:
{function_clause,[{proplists,get_value,[n_val,{error,no_type},undefined],[{file,"proplists.erl"},{line,225}]},{riak_kv_util,get_index_n,1,[{file,"src/riak_kv_util.erl"},{line,190}]},{yz_index_hashtree,'-fold_keys/2-fun-0-'...
I've seen the error mentioned in this post (
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-June/017303.html)
but related to a version prior to 2.1.1.
Any idea what's going on and how this could be fixed?
Thanks!
Paulo
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Connection multiplexing in the Erlang client
Hi, Does the Erlang Riak client support multiplexing multiple concurrent calls in a single TCP connection? Specifically when using the PB interface (riakc_pb_socket:start_link). Thanks. Regards, Paulo ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Connection multiplexing in the Erlang client
Hi, A poolboy or other connection pool based solution still means 1 open tcp connection per worker. I'm exploring the option of having a single TCP connection (actually 1 for each Riak node) and then multiplex concurrent requests to a DB node in a single TCP connection (think HTTP/2 TCP connection multiplexing). Thanks. Paulo On Thu, Dec 31, 2015 at 2:59 AM, Bryan Hunt wrote: > Paulo, > > You can find a list of community maintained PBC pooling libraries in the > Erlang sub-section of this page: > > > http://docs.basho.com/riak/latest/dev/using/libraries/#Community-Libraries > > II was under the impression that Riak Erlang client ships with poolboy so > I'm uncertain of the distinction between the different libraries listed. > > Perhaps someone could comment to clarify? > > Bryan > > > > *From: *Paulo Almeida > *Sent: *Wednesday, December 30, 2015 10:40 PM > *To: *riak-users@lists.basho.com > *Subject: *Connection multiplexing in the Erlang client > > Hi, > > Does the Erlang Riak client support multiplexing multiple concurrent calls > in a single TCP connection? Specifically when using the PB interface > (riakc_pb_socket:start_link). > > Thanks. > > Regards, > > Paulo > > ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Connection multiplexing in the Erlang client
Hi Luke, I have not hit a limit yet and the current implementation using a pool of TCP connections works fine. I considered this after taking a look at the RethinkDB Elixir client, which uses multiplexing. RabbitMQ, another component in my infra-structure allows up to 65536 logic channels in a single TCP Connection. I'm using same Riak cluster as a persistence layer to several small apps, and each apps keeps a pool of TCP connection spread across all nodes in the cluster. I'm just considering the options to keep the file handle count lower on the server side. Regards, Paulo On Thu, Dec 31, 2015 at 5:21 PM, Luke Bakken wrote: > Hi Paulo, > > Why are you considering this? Are you running into issues or > limitations using the current Erlang client? > > -- > Luke Bakken > Engineer > lbak...@basho.com > > On Thu, Dec 31, 2015 at 12:47 AM, Paulo Almeida > wrote: > > > > Hi, > > > > A poolboy or other connection pool based solution still means 1 open tcp > connection per worker. I'm exploring the option of having a single TCP > connection (actually 1 for each Riak node) and then multiplex concurrent > requests to a DB node in a single TCP connection (think HTTP/2 TCP > connection multiplexing). > > > > Thanks. > > > > Paulo > ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Connection multiplexing in the Erlang client
Hi Russell, Thanks for the confirmation. I'll take a look at the riak_api. I suspect the protobuf messages would also need to be changed to include a token/correlation id in order to allow async request/replies. Regards, Paulo On Thu, Dec 31, 2015 at 10:16 AM, Russell Brown wrote: > Hi Paulo, > You’ll need more than client work. If you’re interested in exploring the > server side code riak_api (https://github.com/basho/riak_api) is probably > where you want to look. > > I’m happy to help/advise on this if you want to get stuck in :D > > Cheers > > Russell > > On 31 Dec 2015, at 08:47, Paulo Almeida > wrote: > > > Hi, > > > > A poolboy or other connection pool based solution still means 1 open tcp > connection per worker. I'm exploring the option of having a single TCP > connection (actually 1 for each Riak node) and then multiplex concurrent > requests to a DB node in a single TCP connection (think HTTP/2 TCP > connection multiplexing). > > > > Thanks. > > > > Paulo > > > > On Thu, Dec 31, 2015 at 2:59 AM, Bryan Hunt > wrote: > > Paulo, > > > > You can find a list of community maintained PBC pooling libraries in > the Erlang sub-section of this page: > > > > > http://docs.basho.com/riak/latest/dev/using/libraries/#Community-Libraries > > > > II was under the impression that Riak Erlang client ships with poolboy > so I'm uncertain of the distinction between the different libraries listed. > > > > Perhaps someone could comment to clarify? > > > > Bryan > > > > > > > > From: Paulo Almeida > > Sent: Wednesday, December 30, 2015 10:40 PM > > To: riak-users@lists.basho.com > > Subject: Connection multiplexing in the Erlang client > > > > Hi, > > > > Does the Erlang Riak client support multiplexing multiple concurrent > calls in a single TCP connection? Specifically when using the PB interface > (riakc_pb_socket:start_link). > > > > Thanks. > > > > Regards, > > > > Paulo > > > > > > ___ > > riak-users mailing list > > riak-users@lists.basho.com > > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
