Riak.filterNotFound and Riak.reduceSort in reduce phase dramaticaly decrease performance

2014-04-17 Thread Alexander Popov
query1.sh: = curl -w %{time_connect}:%{time_starttransfer}:%{time_total} -X POST \ -H "content-type: application/json" \ -d @- \ http://localhost:8098/mapred \ < 0.005:1.468:1.468 query2.sh: curl -w %{time_connect}:%{time_starttransfer}:%{time_total} -X POST \ -H "content-type: app

Riak 2.0 search changes

2014-04-23 Thread Alexander Popov
1. Does it support wildcards in a middle or start? *abc, a*bc, 2. Does presort supports any field instead of key or score? I'm not found this in 2.0 docs. ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/ri

[no subject]

2014-04-26 Thread Alexander Popov
from documentation: >>Currently, the wildcard must come at the end of the term in both cases, and must be preceded by a minimum of two characters. Does it any way to able to search with one char? I use RiakSearch to search contacts, and should show something for users when they type one char onl

riak search presort

2014-04-29 Thread Alexander Popov
does riak support DESC order with presort=key ? simple presort=key desc gives me error {error, {error,function_clause, [{riak_search_client,search_doc, [{riak_search_schema,<<"items">>,"1.1",3,<<"value">>, <<"id">>, [{riak_search_fie

Riak 1.4.8, Riak Search numFound inconsistency

2014-05-13 Thread Alexander Popov
solr/some_index/select?q=some_query&wt=json&rows=50 { - responseHeader: { - status: 0, - QTime: 47, - params: { - q: "some_query", - q.op: "or", - filter: "", - wt: "json" } }, - response: { - numFound: 3

Re: Riak 1.4.8, Riak Search numFound inconsistency

2014-05-15 Thread Alexander Popov
othing happens. entry still returnig On Tue, May 13, 2014 at 5:11 PM, Alexander Popov wrote: > solr/some_index/select?q=some_query&wt=json&rows=50 > > { > >- responseHeader: >{ > - status: 0, > - QTime: 47, > - params: > { &

Indexing using the Solr Interface, add after delete will not applied on cluster

2014-05-21 Thread Alexander Popov
I've delete index using http://docs.basho.com/riak/latest/dev/references/search-indexing/#Deleting-using-the-Solr-Interface and than immediately add it by http://docs.basho.com/riak/latest/dev/references/search-indexing/#Indexing-using-the-Solr-Interface Item will not appears in search results in

Yokozuna search

2014-07-23 Thread Alexander Popov
Will queries support masks at beging and 1 char mask like *lala and a* ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Forbidden error after upgrade on riak 2.0

2014-09-26 Thread Alexander Popov
When query Yokozuna, sometimes fails with error: 403 ForbiddenForbiddenForbiddenmochiweb+webmachine web server url logged with error: /search/query/full-proof-info_index?q=owner%3A6d87f18a3dca4a60b0fc385b1f46c165%20AND%20archived%3Afalse%20AND%20NOT%20draft%3Atrue&start=0&rows=20&wt=json&sort=upd

should solr facet.pivot works with yokozuna?

2014-10-01 Thread Alexander Popov
I provide it to query, see in response in params section: id,owner,type but facet output section have no pivot section 71 14 1 1 does anybody can confirm this functionality works? probably it is disabled in SOLR? Or need some schema setup ? according to http://docs.basho.com/riak/

Proper way do delete datatypes ( map )

2014-10-02 Thread Alexander Popov
I have map bucket with some data( with neseted maps ) aprox structure( don't know does it matter or not ): { "update": { "some_register": "value", "some_flag": "disable", "nested_map": { "update": { "nested1_map": { "update": { "some_register": "value", "some_flag": "disable", } }, "nested1_map": {

Re: Proper way do delete datatypes ( map )

2014-10-02 Thread Alexander Popov
that works out OK for you, please? > > Cheers > > Russell > > On 2 Oct 2014, at 12:54, Alexander Popov wrote: > > I have map bucket with some data( with neseted maps ) > aprox structure( don't know does it matter or not ): > { > "update&

transfer partition restarts and failed many times.

2014-10-09 Thread Alexander Popov
and seems he cannot finish transfer part of log: 2014-10-09 07:07:27.360 [error] <0.988.2>@riak_core_handoff_sender:start_fold:272 ownership_transfer transfer of riak_kv_vnode from 'riak@10.0.0.218' 1370157784997721485815954530671515330927436759040 to 'ri ak@10.0.0.152' 137015778499772148581595453

[SOLR] different number of result on same query

2014-10-22 Thread Alexander Popov
RIAK 2.0.1, 5 nodes on different hosts query: comments_index?q=owner:6d87f18a3dca4a60b0fc385b1f46c165%20AND%20target:35975db44af44b2494751abddfcfe466&fl=id&wt=json&rows=15 RESULT1: { responseHeader: { status: 0, QTime: 3, params: { 10.0.0.150:8093: "_yz_pn:56 OR _yz_pn:41 OR _yz_pn:26 OR _yz_pn:

Re: [SOLR] different number of result on same query

2014-10-22 Thread Alexander Popov
Also if run query with specific id, on internal_solr directly on each host, for this problematic id it founds only on 2 hosts, but other id's found on 3 of them. On Wed, Oct 22, 2014 at 10:18 PM, Alexander Popov wrote: > RIAK 2.0.1, 5 nodes on different hosts > > > query: &

Re: [SOLR] different number of result on same query

2014-10-22 Thread Alexander Popov
; > On Oct 22, 2014, at 11:32 AM, Alexander Popov wrote: > > Also if run query with specific id, on internal_solr directly on each > host, for this problematic id it founds only on 2 hosts, but other id's > found on 3 of them. > > On Wed, Oct 22, 2014 at 10:18 PM, A

update schema without reindex all data

2014-11-02 Thread Alexander Popov
does it possible? now I use flow: curl -XPUT "http://localhost:8098/buckets/some_bucket/props"; -H'content-type: application/json' -d'{"props":{"search_index":"_dont_index_", "search":false}}' curl -XDELETE "http://localhost:8098/search/index/some_index"; curl -XPUT "http://localhost:8098/search

[SOLR]Does indexing is async operatoin?

2014-11-12 Thread Alexander Popov
I put data to some bucket with indexing schema, Immediately after that I'm trying to query this data using search interface very often just inserted data is missed. Does it any way to know when it will be done? or any other ways how to achieve this? ___

How you are dealing with spikes?

2014-12-09 Thread Alexander Popov
I have Riak 2.0.1 cluster with 5 nodes ( ec2 m3-large ) with elnm in front sometimes I got spikes up to 10 seconds I can't say that I have huge load at this time, max 200 requests per second for all 5 nodes. Most expensive queries is * list by secondary index ( usually returns from 0 to 100 re

Re: How you are dealing with spikes?

2014-12-09 Thread Alexander Popov
ineer / CSE > lbak...@basho.com > > > On Tue, Dec 9, 2014 at 4:58 AM, Alexander Popov wrote: >> I have Riak 2.0.1 cluster with 5 nodes ( ec2 m3-large ) with elnm in front >> sometimes I got spikes up to 10 seconds >> >> I can't say that I have huge loa

Re: How you are dealing with spikes?

2014-12-21 Thread Alexander Popov
populating buckets/files/owner_bin/user_id, If we change this query to SOLR analog -> can we gave some boost? Also, does key length matter for 2i performance? Does number of 2i indexes per object matter for 2i? On Tue, Dec 9, 2014 at 7:54 PM, Alexander Popov wrote: > Stats when recent

Re: How you are dealing with spikes?

2014-12-31 Thread Alexander Popov
: 18763, - search_index_latency_999: 37138, On Mon, Dec 22, 2014 at 1:39 AM, Alexander Popov wrote: > Left graph show counts, Right graph show times, graphs are synchronized by > time > What about SOLR requests instead 2i? should it be faster? > Or what you recommend to use for popu

adding nodes to cluster

2015-01-20 Thread Alexander Popov
Upgraded riak 2.0.2-> 2.0.4 trying to add nodes to cluster( was single node ) all new nodes located on another host, but multi-nodes installation from source each new node have config settings tuned like nodename = riak1@10.0.0.28 platform_data_dir = /var/lib/riak1 listener.http.internal = 0.0.0.0

Re: adding nodes to cluster

2015-01-20 Thread Alexander Popov
gt; > I’ll open a ticket for it. We changed the internal structure of both > Maps and Sets, and tested that they were backwards compatible, but clearly > missed something. > > > > On 20 Jan 2015, at 13:54, Alexander Popov wrote: > > > >> Upgraded riak 2.0.2-

Re: adding nodes to cluster

2015-01-21 Thread Alexander Popov
gt; > On 20 Jan 2015, at 15:12, Alexander Popov wrote: > > > Thanks. > > > > On Tue, Jan 20, 2015 at 5:07 PM, Russell Brown > wrote: > > FYI https://github.com/basho/riak/issues/667 > > > > I’ll get to work on it at once, we might be able to hit the 2.0.5 bui

2.0.5 compiled from source SOLR failed to start

2015-02-27 Thread Alexander Popov
> > 2015-02-27 10:38:27.960 [info] <0.563.0>@yz_solr_proc:ensure_data_dir:219 > No solr config found, creating a new one > 2015-02-27 10:38:27.961 [info] <0.563.0>@yz_solr_proc:init:96 Starting > solr: "/usr/bin/java" > ["-Djava.awt.headless=true","-Djetty.home=/var/riak-dist/riak1/bin/../lib/yokoz

Still getting peaks on solr queries

2015-03-06 Thread Alexander Popov
I not have stable reproduce but peaks happens several times in day and takes 10-50 sec. some times it happens on very low traffic, so I think it not related on traffic. Looks like query is locked somehow. What can I do for troubleshoot peaks? Enable addition logs or Monitoring ? There is no errors

Solr indexes becomes broken after node replacement

2015-06-08 Thread Alexander Popov
I was perform all nodes upgrade in x6 nodes cluster and at same time 4 of them was prooceed with node name changed by steps: http://docs.basho.com/riak/latest/ops/running/recovery/failed-node/#Node-Name-Changed after that search indexes becomes completely broken - many data missed, returns diff

Re: Solr indexes becomes broken after node replacement

2015-06-08 Thread Alexander Popov
gt; Zeeshan Lakhani > programmer | > software engineer at @basho > > On Jun 8, 2015, at 8:30 AM, Alexander Popov wrote: > > I was perform all nodes upgrade in x6 nodes cluster > and at same time 4 of them was prooceed with node name changed by steps: > > http://docs.bash

How you are manage your clusters on Amazon aws

2015-06-09 Thread Alexander Popov
does it any reasonable alternatives to chef/ops works? Use cases: easy to scale up/scale down Easy to manage - run commands, apply configuration to all nodes, restart nodes, buck up. Monitor cluster, audit all actions, collect logs ___ riak-users mailing

riak restart does not restart yokozuka well

2015-09-14 Thread Alexander Popov
i'm doing riak restart and got 'ok' in answer, but node appears in shutdown state. in proccess list i found that solr is still running, and in logs found : 2015-09-14 09:21:03.939 [info] <0.579.0>@yz_solr_proc:init:96 Starting solr: "/usr/bin/java" ["-Djava.awt.headless=true","-Djetty.home=/usr/

Re: riak restart does not restart yokozuka well

2015-09-14 Thread Alexander Popov
ill it. > > -Fred > > On Sep 14, 2015, at 5:28 AM, Alexander Popov wrote: > > i'm doing riak restart > and got 'ok' in answer, but node appears in shutdown state. > > in proccess list i found that solr is still running, and in logs found : > > 2015-09

limit of bucket/solr indexes

2015-11-18 Thread Alexander Popov
1. does Riak have restrictions on bucket numbers? 2. same for SOLR indexes? Interesting not theoretical, but practical limits when it start works bad. Use case: we want split users bucket to bucket-per-team model, this bucket have also solr index on top. Can it work for 1000 teams? 10k? 100k?

AWS instance types

2015-12-08 Thread Alexander Popov
What to choose C4 or M4 ? M4 benefits: * twice more memory C4 benefits: * can be launched in one placement group, that potential can improve nodes communications performance ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/m

2i indexes and keys request inconsistencies

2016-03-08 Thread Alexander Popov
Noticied that sometimes 2i query and all keys requesrs returns extra records ~2% of all records. When call this items by get request after, it returns 404 and after that key stops to returns in 2i and keys requests. Does it normally or my database is corrupted? __

Re: 2i indexes and keys request inconsistencies

2016-03-09 Thread Alexander Popov
ry is correct in giving you the key and the 404 > afterward is also correct. They represent two different versions of the > database over time. > > Not sure if this is a valid scenario for you or not. > > Matthew > > > On Mar 8, 2016, at 1:22 PM, Alexander Popov wrote:

Solr http endpoint and POST

2016-04-26 Thread Alexander Popov
Does it possible? if yes - which encoding? form-data or multipart? if no - does it possible to enlarge GET query length? (looks like maximum is around 6500) ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/r

Update solr schema

2017-03-06 Thread Alexander Popov
After release riak 2.2 does it any new possibilities to update search schema without re-index all data? ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

2.2 CPU usage

2017-03-06 Thread Alexander Popov
Did Upgrade production cluster to 2.2.0 looks that it eat more CPU, in idle time 10-30% always( on 2.1.4 was up to 10% with same load ) in Peaks it takes up to 100% ( on 2.1.4 was peaks was up to 75% ) 2.2: [image: Inline image 1] [image: Inline image 2] 2.1.4: [image: Inline image 4]