Unable to store certain documents in Riak - child_terminated errors

Michael Jakl Thu, 02 Feb 2012 08:40:40 -0800

Hi, I've recently upgraded to Riak 1.0.3, now Riak won't accept
certain documents anymore.


I'm running Riak 1.0.3 in a three node configuration on Linux Debian
6.0 with increased file-handle-limit and the eleveldb backend.
On the client side I use the java client, also version 1.0.3. I've
tried the protocol buffer and the HTTP connection, both with the same
result.

Is there something obvious in the logs I haven't seen? Other types of
documents are accepted as always.

Is it possible that the document is malformed since the error message
contains "no function clause matching riak_kv_vnode:put_merge"?

I'm not 100% sure it has to do with the upgrade, but the times seem to
correlate.

Please help,
Michael

console.log:
2012-02-02 17:22:09.445 [error] <0.402.0> gen_fsm <0.402.0> in state
active terminated with reason: no function clause matching
riak_kv_vnode:put_merge(true, <<"true">>,
{r_object,<<"documents">>,<<"Twitter_164708349135433728">>,[{r_content,{dict,7,16,16,8,80,48,{[]...}...}...}]...},
{r_object,<<"documents">>,<<"Twitter_164708349135433728">>,[{r_content,{dict,7,16,16,8,80,48,{[]...}...}...}]...},
<<202,121,10,114,78,248,151,237>>, 63495418929)
2012-02-02 17:22:09.447 [error] <0.402.0> CRASH REPORT Process
<0.402.0> with 0 neighbours crashed with reason: no function clause
matching riak_kv_vnode:put_merge(true, <<"true">>,
{r_object,<<"documents">>,<<"Twitter_164708349135433728">>,[{r_content,{dict,7,16,16,8,80,48,{[]...}...}...}]...},
{r_object,<<"documents">>,<<"Twitter_164708349135433728">>,[{r_content,{dict,7,16,16,8,80,48,{[]...}...}...}]...},
<<202,121,10,114,78,248,151,237>>, 63495418929)
2012-02-02 17:22:09.449 [error] <0.105.0> Supervisor
riak_core_vnode_sup had child undefined started with
{riak_core_vnode,start_link,undefined} at <0.402.0> exit with reason
no function clause matching riak_kv_vnode:put_merge(true, <<"true">>,
{r_object,<<"documents">>,<<"Twitter_164708349135433728">>,[{r_content,{dict,7,16,16,8,80,48,{[]...}...}...}]...},
{r_object,<<"documents">>,<<"Twitter_164708349135433728">>,[{r_content,{dict,7,16,16,8,80,48,{[]...}...}...}]...},
<<202,121,10,114,78,248,151,237>>, 63495418929) in context
child_terminated
2012-02-02 17:26:09.477 [error] <0.2494.0> gen_fsm <0.2494.0> in state
active terminated with reason: no function clause matching
riak_kv_vnode:put_merge(true, <<"true">>,
{r_object,<<"documents">>,<<"Twitter_164708349135433728">>,[{r_content,{dict,7,16,16,8,80,48,{[]...}...}...}]...},
{r_object,<<"documents">>,<<"Twitter_164708349135433728">>,[{r_content,{dict,7,16,16,8,80,48,{[]...}...}...}]...},
<<202,121,10,114,78,248,151,237>>, 63495419169)
2012-02-02 17:26:09.480 [error] <0.2494.0> CRASH REPORT Process
<0.2494.0> with 0 neighbours crashed with reason: no function clause
matching riak_kv_vnode:put_merge(true, <<"true">>,
{r_object,<<"documents">>,<<"Twitter_164708349135433728">>,[{r_content,{dict,7,16,16,8,80,48,{[]...}...}...}]...},
{r_object,<<"documents">>,<<"Twitter_164708349135433728">>,[{r_content,{dict,7,16,16,8,80,48,{[]...}...}...}]...},
<<202,121,10,114,78,248,151,237>>, 63495419169)
2012-02-02 17:26:09.483 [error] <0.105.0> Supervisor
riak_core_vnode_sup had child undefined started with
{riak_core_vnode,start_link,undefined} at <0.2494.0> exit with reason
no function clause matching riak_kv_vnode:put_merge(true, <<"true">>,
{r_object,<<"documents">>,<<"Twitter_164708349135433728">>,[{r_content,{dict,7,16,16,8,80,48,{[]...}...}...}]...},
{r_object,<<"documents">>,<<"Twitter_164708349135433728">>,[{r_content,{dict,7,16,16,8,80,48,{[]...}...}...}]...},
<<202,121,10,114,78,248,151,237>>, 63495419169) in context
child_terminated

crash.log
2012-02-02 17:26:09 =SUPERVISOR REPORT====
     Supervisor: {local,riak_core_vnode_sup}
     Context:    child_terminated
     Reason:
{function_clause,[{riak_kv_vnode,put_merge,[true,<<"true">>,{r_object,<<"documents">>,<<"Twitter_164708349135433728">>,[{r_content,{dict,7,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[[<<"Links">>]],[],[],[],[],[],[],[],[[<<"content-type">>,116,101,120,116,47,112,108,97,105,110],[<<"X-Riak-VTag">>,51,52,68,86,115,119,97,66,70,115,48,88,71,87,82,90,52,106,109,48,88,99]],[[<<"index">>]],[],[[<<"X-Riak-Last-Modified">>|{1328,199729,299974}]],[],[[<<"charset">>,85,84,70,45,56],[<<"X-Riak-Meta">>]]}}},<<"{"_original":{"contributors":null,"truncated":false,"text":"#Health
Chinese workers kidnapped in Egypt freed: BEIJING (Reuters) -
Twenty-five Chinese kidnapped in Egypt wer...
http://t.co/bJ3gberQ","in_reply_to_status_id":null,"id":164708349135433728,"source":";<a
href=\"http://twitterfeed.com\";
rel=\"nofollow\">twitterfeed</a>","retweeted":false,"coordinates":null,"entities":{"user_mentions":[],"hashtags":[{"indices":[0,7],"text":"Health"}],"urls":[{"indices":[116,136],"url":"http://t.co/bJ3gberQ","expanded_url":"http://j.mp/wvSByE","display_url":"j.mp/wvSByE"}]},"in_reply_to_screen_name":null,"id_str":"164708349135433728","retweet_count":0,"in_reply_to_user_id":null,"favorited":false,"user":{"follow_request_sent":null,"profile_use_background_image":true,"id":242603575,"verified":false,"profile_image_url_https":"https://si0.twimg.com/profile_images/1225118000/Lean_Fit_Lifestyle2_normal.jpg","profile_sidebar_fill_color":"DDEEF6","geo_enabled":false,"profile_text_color":"333333","followers_count":4872,"protected":false,"location":"72829
Engstingen","default_profile_image":false,"id_str":"242603575","utc_offset":null,"statuses_count":6642,"description":"Health
& Fitness is your source for health articles and information about
nutrition, diseases, medical conditions, weight loss, exercise and
more... 
","friends_count":5238,"profile_link_color":"0084B4","profile_image_url":"http://a3.twimg.com/profile_images/1225118000/Lean_Fit_Lifestyle2_normal.jpg","notifications":null,"show_all_inline_media":false,"profile_background_image_url_https":"https://si0.twimg.com/profile_background_images/324146416/TwitterBG_1.jpg","profile_background_color":"737479","profile_background_image_url":"http://a3.twimg.com/profile_background_images/324146416/TwitterBG_1.jpg","screen_name":"HealthzFitness","lang":"en","following":null,"profile_background_tile":false,"favourites_count":0,"name":"Health
Fitness","url":"http://j.mp/v9pTtf","created_at":"Tue Jan 25 04:39:46
+0000 
2011","contributors_enabled":false,"time_zone":null,"profile_sidebar_border_color":"C0DEED","default_profile":false,"is_translator":false,"listed_count":20},"geo":null,"in_reply_to_user_id_str":null,"possibly_sensitive":false,"created_at":"Wed
Feb 01 13:55:05 +0000
2012","possibly_sensitive_editable":true,"in_reply_to_status_id_str":null,"place":null},"contentType":"text","language":"EN","title":"@HealthzFitness:
#Health Chinese workers kidnapped in Egypt freed: BEIJING (Reuters) -
Twenty-five Chinese kidnapped in Egypt wer...
http://t.co/bJ3gberQ","sourceName":"Twitter
@HealthzFitness","country":"--","author":"HealthzFitness","mediaType":"Microblog","publishDate":"2012-02-01T13:55:05Z","content":"#Health
Chinese workers kidnapped in Egypt freed: BEIJING (Reuters) -
Twenty-five Chinese kidnapped in Egypt wer... http://t.co/bJ3gberQ
","link":"https://twitter.com/#!/HealthzFitness/status/164708349135433728","provider":"Twitter","homepage":"http://twitter.com/HealthzFitness","id":"Twitter_164708349135433728","tags":{"Topic":["Twenty-Five","Workers","Egypt"],"Location":["Egypt","BEIJING"]}}";>>}],[{<<115,130,209,154,78,248,151,255>>,{1,63495418929}}],{dict,1,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[[clean|true]],[]}}},undefined},{r_object,<<"documents">>,<<"Twitter_164708349135433728">>,[{r_content,{dict,7,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[[<<"Links">>]],[],[],[],[],[],[],[],[[<<"content-type">>,116,101,120,116,47,112,108,97,105,110],[<<"X-Riak-VTag">>,55,102,102,103,56,122,49,48,79,66,88,70,122,75,88,72,85,79,79,70,101,68]],[[<<"index">>]],[],[[<<"X-Riak-Last-Modified">>|{1328,199969,482660}]],[],[[<<"charset">>,85,84,70,45,56],[<<"X-Riak-Meta">>]]}}},<<"{"_original":{"contributors":null,"truncated":false,"text":"#Health
Chinese workers kidnapped in Egypt freed: BEIJING (Reuters) -
Twenty-five Chinese kidnapped in Egypt wer...
http://t.co/bJ3gberQ","in_reply_to_status_id":null,"id":164708349135433728,"source":";<a
href=\"http://twitterfeed.com\";
rel=\"nofollow\">twitterfeed</a>","retweeted":false,"coordinates":null,"entities":{"user_mentions":[],"hashtags":[{"indices":[0,7],"text":"Health"}],"urls":[{"indices":[116,136],"url":"http://t.co/bJ3gberQ","expanded_url":"http://j.mp/wvSByE","display_url":"j.mp/wvSByE"}]},"in_reply_to_screen_name":null,"id_str":"164708349135433728","retweet_count":0,"in_reply_to_user_id":null,"favorited":false,"user":{"follow_request_sent":null,"profile_use_background_image":true,"id":242603575,"verified":false,"profile_image_url_https":"https://si0.twimg.com/profile_images/1225118000/Lean_Fit_Lifestyle2_normal.jpg","profile_sidebar_fill_color":"DDEEF6","geo_enabled":false,"profile_text_color":"333333","followers_count":4872,"protected":false,"location":"72829
Engstingen","default_profile_image":false,"id_str":"242603575","utc_offset":null,"statuses_count":6642,"description":"Health
& Fitness is your source for health articles and information about
nutrition, diseases, medical conditions, weight loss, exercise and
more... 
","friends_count":5238,"profile_link_color":"0084B4","profile_image_url":"http://a3.twimg.com/profile_images/1225118000/Lean_Fit_Lifestyle2_normal.jpg","notifications":null,"show_all_inline_media":false,"profile_background_image_url_https":"https://si0.twimg.com/profile_background_images/324146416/TwitterBG_1.jpg","profile_background_color":"737479","profile_background_image_url":"http://a3.twimg.com/profile_background_images/324146416/TwitterBG_1.jpg","screen_name":"HealthzFitness","lang":"en","following":null,"profile_background_tile":false,"favourites_count":0,"name":"Health
Fitness","url":"http://j.mp/v9pTtf","created_at":"Tue Jan 25 04:39:46
+0000 
2011","contributors_enabled":false,"time_zone":null,"profile_sidebar_border_color":"C0DEED","default_profile":false,"is_translator":false,"listed_count":20},"geo":null,"in_reply_to_user_id_str":null,"possibly_sensitive":false,"created_at":"Wed
Feb 01 13:55:05 +0000
2012","possibly_sensitive_editable":true,"in_reply_to_status_id_str":null,"place":null},"contentType":"text","language":"EN","title":"@HealthzFitness:
#Health Chinese workers kidnapped in Egypt freed: BEIJING (Reuters) -
Twenty-five Chinese kidnapped in Egypt wer...
http://t.co/bJ3gberQ","sourceName":"Twitter
@HealthzFitness","country":"--","author":"HealthzFitness","mediaType":"Microblog","publishDate":"2012-02-01T13:55:05Z","content":"#Health
Chinese workers kidnapped in Egypt freed: BEIJING (Reuters) -
Twenty-five Chinese kidnapped in Egypt wer... http://t.co/bJ3gberQ
","link":"https://twitter.com/#!/HealthzFitness/status/164708349135433728","provider":"Twitter","homepage":"http://twitter.com/HealthzFitness","id":"Twitter_164708349135433728","tags":{"Topic":["Twenty-Five","Workers","Egypt"],"Location":["Egypt","BEIJING"]}}";>>}],[{<<115,130,209,154,78,248,151,255>>,{1,63495418929}}],{dict,1,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[[clean|true]],[]}}},undefined},<<202,121,10,114,78,248,151,237>>,63495419169]},{riak_kv_vnode,prepare_put,2},{riak_kv_vnode,do_put,7},{riak_kv_vnode,handle_command,3},{riak_core_vnode,vnode_command,3},{gen_fsm,handle_msg,7},{proc_lib,init_p_do_apply,3}]}
     Offender:
[{pid,<0.2494.0>},{name,undefined},{mfargs,{riak_core_vnode,start_link,undefined}},{restart_type,temporary},{shutdown,300000},{child_type,worker}]

_______________________________________________
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Unable to store certain documents in Riak - child_terminated errors

Reply via email to