spurious secondary index writes

2015-07-31 Thread Damien Krotkine

Hi,

On my cluster, I am using the Multi backend, with a bunch of bitcask
backends configured and a leveldb one. However, I am *never* writing to
the leveldb backend. And I'm never writing any 2i

However, riak-admin status is reporting secondary index writes:

sudo riak-admin status | grep index

index_fsm_active : 0
index_fsm_create : 0
index_fsm_create_error : 0
vnode_index_deletes : 0
vnode_index_deletes_postings : 0
vnode_index_deletes_postings_total : 0
vnode_index_deletes_total : 0
vnode_index_reads : 0
vnode_index_reads_total : 0
vnode_index_refreshes : 0
vnode_index_refreshes_total : 0
vnode_index_writes : 3484
vnode_index_writes_postings : 0
vnode_index_writes_postings_total : 0
vnode_index_writes_total : 67341668


I don't understand how this can happen. Is Riak using secondary indexes
internally, or is the metric being polluted byt other values ? I ned to
make sure my cluster is not creating secondary indexes :)

Thanks,
Damien Krotkine

___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com


An outbound handoff of partition error enotconn

2015-07-31 Thread changmao wang
Hi Riak-users,

I have found some errors related to handoff of partition in
/etc/riak/log/errors.
Details are as below:

2015-07-30 16:04:33.643 [error]
<0.12872.15>@riak_core_handoff_sender:start_fold:262 ownership_transfer
transfer of riak_kv_vnode from 'riak@10.21.136.76'
45671926166590716193865151022383844364247891968 to 'riak@10.21.136.93'
45671926166590716193865151022383844364247891968 failed because of enotconn
2015-07-30 16:04:33.643 [error]
<0.197.0>@riak_core_handoff_manager:handle_info:289 An outbound handoff of
partition riak_kv_vnode 45671926166590716193865151022383844364247891968 was
terminated for reason: {shutdown,{error,enotconn}}



I have searched it with google and found related articles. However, there's
no solution.
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2014-October/016052.html

-- 
Amao Wang
Best & Regards
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com


Selective indexing of Riak Data Types

2015-07-31 Thread Marius Cobzarenco
Hi all,

I was curios if there's a way to enable Solr indexing on only some of the
fields of a Riak CRDT Map (not all of them). E.g. for a map:
[{"field_1", "register"}, {"field_2", "register"}] I would like to _only_
create the Solar index field_1_register .

By default if I enable search on a bucket with maps, Riak creates Solr
indexes for all fields in the map.
https://docs.basho.com/riak/latest/dev/search/search-data-types/

Many thanks,
Marius

-- 


-- 

___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com


Re: Selective indexing of Riak Data Types

2015-07-31 Thread Zeeshan Lakhani
Hello Marius, 

Yes, you can by just specifying those fields in the schema, e.g. 
field_1_register. For example, I created similar fields in this test (using a 
custom schema, inlined): 
https://github.com/basho/riak_test/pull/800/files#diff-ab08303805d0b8fe5d7fe683273b2fbfR75
 
,
 and then set them in the map like so: 
https://github.com/basho/riak_test/pull/800/files#diff-ab08303805d0b8fe5d7fe683273b2fbfR178
 
.
 Obviously, you then don’t need the default, embedded dynamic *_register fields 
and such, which captures all of them.

Hope that helps!

Zeeshan Lakhani
programmer | 
software engineer at @basho | 
org. member/founder of @papers_we_love | paperswelove.org
twitter => @zeeshanlakhani

> On Jul 31, 2015, at 10:59 AM, Marius Cobzarenco  wrote:
> 
> Hi all,
> 
> I was curios if there's a way to enable Solr indexing on only some of the 
> fields of a Riak CRDT Map (not all of them). E.g. for a map:
> [{"field_1", "register"}, {"field_2", "register"}] I would like to _only_ 
> create the Solar index field_1_register .
> 
> By default if I enable search on a bucket with maps, Riak creates Solr 
> indexes for all fields in the map.
> https://docs.basho.com/riak/latest/dev/search/search-data-types/ 
> 
> 
> Many thanks,
> Marius
> 
> 
> 
> 
> ___
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com


Re: Selective indexing of Riak Data Types

2015-07-31 Thread Marius Cobzarenco
Hi Zeeshan,

It makes sense, thanks loads for the pointer & code examples, it's exactly
what I was looking for.

Cheers,
Marius

On 31 July 2015 at 16:14, Zeeshan Lakhani  wrote:

> Hello Marius,
>
> Yes, you can by just specifying those fields in the schema, e.g.
> field_1_register. For example, I created similar fields in this test (using
> a custom schema, inlined):
> https://github.com/basho/riak_test/pull/800/files#diff-ab08303805d0b8fe5d7fe683273b2fbfR75,
> and then set them in the map like so:
> https://github.com/basho/riak_test/pull/800/files#diff-ab08303805d0b8fe5d7fe683273b2fbfR178.
> Obviously, you then don’t need the default, embedded dynamic *_register
> fields and such, which captures all of them.
>
> Hope that helps!
>
> Zeeshan Lakhani
> programmer |
> software engineer at @basho |
> org. member/founder of @papers_we_love | paperswelove.org
> twitter => @zeeshanlakhani
>
> On Jul 31, 2015, at 10:59 AM, Marius Cobzarenco  wrote:
>
> Hi all,
>
> I was curios if there's a way to enable Solr indexing on only some of the
> fields of a Riak CRDT Map (not all of them). E.g. for a map:
> [{"field_1", "register"}, {"field_2", "register"}] I would like to _only_
> create the Solar index field_1_register .
>
> By default if I enable search on a bucket with maps, Riak creates Solr
> indexes for all fields in the map.
> https://docs.basho.com/riak/latest/dev/search/search-data-types/
>
> Many thanks,
> Marius
>
>
>
>
> ___
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
>
>

-- 


-- 

___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com


Re: Selective indexing of Riak Data Types

2015-07-31 Thread Zeeshan Lakhani
No problem :).

Zeeshan Lakhani
programmer | 
software engineer at @basho | 
org. member/founder of @papers_we_love | paperswelove.org
twitter => @zeeshanlakhani

> On Jul 31, 2015, at 11:17 AM, Marius Cobzarenco  wrote:
> 
> Hi Zeeshan,
> 
> It makes sense, thanks loads for the pointer & code examples, it's exactly 
> what I was looking for.
> 
> Cheers,
> Marius
> 
> On 31 July 2015 at 16:14, Zeeshan Lakhani  > wrote:
> Hello Marius, 
> 
> Yes, you can by just specifying those fields in the schema, e.g. 
> field_1_register. For example, I created similar fields in this test (using a 
> custom schema, inlined): 
> https://github.com/basho/riak_test/pull/800/files#diff-ab08303805d0b8fe5d7fe683273b2fbfR75
>  
> ,
>  and then set them in the map like so: 
> https://github.com/basho/riak_test/pull/800/files#diff-ab08303805d0b8fe5d7fe683273b2fbfR178
>  
> .
>  Obviously, you then don’t need the default, embedded dynamic *_register 
> fields and such, which captures all of them.
> 
> Hope that helps!
> 
> Zeeshan Lakhani
> programmer | 
> software engineer at @basho | 
> org. member/founder of @papers_we_love | paperswelove.org 
> 
> twitter => @zeeshanlakhani
> 
>> On Jul 31, 2015, at 10:59 AM, Marius Cobzarenco > > wrote:
>> 
>> Hi all,
>> 
>> I was curios if there's a way to enable Solr indexing on only some of the 
>> fields of a Riak CRDT Map (not all of them). E.g. for a map:
>> [{"field_1", "register"}, {"field_2", "register"}] I would like to _only_ 
>> create the Solar index field_1_register .
>> 
>> By default if I enable search on a bucket with maps, Riak creates Solr 
>> indexes for all fields in the map.
>> https://docs.basho.com/riak/latest/dev/search/search-data-types/ 
>> 
>> 
>> Many thanks,
>> Marius
>> 
>> 
>> 
>> 
>> ___
>> riak-users mailing list
>> riak-users@lists.basho.com 
>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com 
>> 
> 
> 
> 
> 
> 
> 

___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com


Riak CS Node Shutdown Because it Ran Out Data Space - Unbalanced With Other Nodes in Cluster

2015-07-31 Thread Valenti, Anthony
We have a Riak CS node that ran out of space on the data mount and the service 
shutdown.  This is strange since the other nodes in the cluster seem to be 
about 76%-78% full.  Why is it so out of balance and how can it be fixed?

Node - Riak07 (failed)
Filesystem1K-blocks  Used Available Use% Mounted on
/dev/mapper/vgroot-lvroot  21103116   3553252  16480772  18% /
udev   16464744 4  16464740   1% /dev
tmpfs   3294768   284   3294484   1% /run
none   5120 0  5120   0% /run/lock
none   16473828 0  16473828   0% /run/shm
/dev/mapper/vgroot-lvdata 642647464 642580056 67408 100% /data
/dev/sda1472036 60968386697  14% /boot
/dev/mapper/vgroot-lvhome   7688360266548   7031260   4% /home

All other nodes
Node - Riak01
Filesystem1K-blocks  Used Available Use% Mounted on
/dev/mapper/vgroot-lvroot  21196680   2156104  17971484  11% /
udev   16466476 4  16466472   1% /dev
tmpfs   6590228   288   6589940   1% /run
none   5120 0  5120   0% /run/lock
none   16475564 0  16475564   0% /run/shm
/dev/mapper/vgroot-lvdata 628271104 486828480 141442624  78% /data
/dev/sda1484068 49921409776  11% /boot
/dev/mapper/vgroot-lvhome   7785688446688   6948448   7% /home

Node - Riak02
Filesystem1K-blocks  Used Available Use% Mounted on
/dev/mapper/vgroot-lvroot  21200776   2401784  17729696  12% /
udev   16466476 4  16466472   1% /dev
tmpfs   6590228   280   6589948   1% /run
none   5120 0  5120   0% /run/lock
none   16475564 0  16475564   0% /run/shm
/dev/mapper/vgroot-lvdata 628275200 489217444 139057756  78% /data
/dev/sda1484068 49921409776  11% /boot
/dev/mapper/vgroot-lvhome   7785688410856   6984280   6% /home

Node - Riak03
Filesystem1K-blocks  Used Available Use% Mounted on
/dev/mapper/vgroot-lvroot  21200776   2304152  17827328  12% /
udev   16466476 4  16466472   1% /dev
tmpfs   6590228   272   6589956   1% /run
none   5120 0  5120   0% /run/lock
none   16475564 0  16475564   0% /run/shm
/dev/mapper/vgroot-lvdata 628275200 490374972 137900228  79% /data
/dev/sda1484068 49921409776  11% /boot
/dev/mapper/vgroot-lvhome   7785688410912   6984224   6% /home

Node - Riak08
Filesystem1K-blocks  Used Available Use% Mounted on
/dev/mapper/vgroot-lvroot  22135340   2838828  18175004  14% /
udev   16464744 4  16464740   1% /dev
tmpfs   3294768   280   3294488   1% /run
none   5120 0  5120   0% /run/lock
none   16473828 0  16473828   0% /run/shm
/dev/mapper/vgroot-lvdata 642647464 487758140 154889324  76% /data
/dev/sda1472036 60968386697  14% /boot
/dev/mapper/vgroot-lvhome   7688360266484   7031324   4% /home

Thanks,
Anthony



Inmar Confidentiality Note:  This e-mail and any attachments are confidential 
and intended to be viewed and used solely by the intended recipient.  If you 
are not the intended recipient, be aware that any disclosure, dissemination, 
distribution, copying or use of this e-mail or any attachment is prohibited.  
If you received this e-mail in error, please notify us immediately by returning 
it to the sender and delete this copy and all attachments from your system and 
destroy any printed copies.  Thank you for your cooperation.

Notice of Protected Rights:  The removal of any copyright, trademark, or 
proprietary legend contained in this e-mail or any attachment is prohibited 
without the express, written permission of Inmar, Inc.  Furthermore, the 
intended recipient must maintain all copyright notices, trademarks, and 
proprietary legends within this e-mail and any attachments in their original 
form and location if the e-mail or any attachments are reproduced, printed or 
distributed.



___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com


Riak Recap - July 31, 2015

2015-07-31 Thread Matthew Brender
Hey everyone! As always, there's been some great knowledge sharing over the
user lists. Here is your biweekly Recap!

Note that many of the "unanswered" are brand new and I know we'll get to
answering them. I just want you all to know we keep track of these.

## Announcements
* There's a new Java client in town! 2.0.2 was released [0]

## Recently Answered
* Roman asks about using a FQDN and is guided to use 0.0.0.0 instead [1]
* The Riak C client ran into a segfault that Chris explained [2]
* Humberto found setting ulimit on OS X is a little tricky [3]
* I gave Sevilha some resources to spin up Riak locally [4]
* Zeeshan makes sense of indexing Riak Data Types for Marius [5]

## New and Unanswered
* Damien needs some help thinking through ring-resizing on a live cluster
[6]
* Sean gets an error while deleting an object through the Erlang client [7]
* Humberto could still use help with ulimit settings on OS X [8]
* Nick is helping Johan with a known Erlang bug in need of a patch [9]
* Damien sees 2i writes when he isn't using 2i. Any idea why? [10]
* Amao sees an outbound handoff error and still needs some help [11]

## All the Meetups!
We've been busy on the meetup scene, hosting events in Portland, Austin and
Chicago. If you'd like to see where groups are, we have a new URL to do so
[12]. Let me know if you'd like to run one in your city!

## What'd we miss?
Have you brought Riak into production at a new place? Did you find a blog
or presentation helpful? Good! Share it in our release notes:
https://github.com/basho-labs/the-riak-community/tree/master/release-notes

Have a great weekend,
Matt Brender
Developer Advocate @ Basho
@mjbrender

[0]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-July/017374.html
[1]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-July/017370.html
[2]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-July/017366.html
[3]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-July/017379.html
[4]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-July/017385.html
[5]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-July/017390.html
[6]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-July/017364.html
[7]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-July/017368.html
[8]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-July/017383.html
[9]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-July/017377.html
[10]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-July/017386.html
[11]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-July/017387.html
[12] http://www.meetup.com/pro/basho/
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com