Re: Riak search, post schema change reindexation

2016-08-29 Thread Guillaume Boddaert
Hi Fred, thanks for your answer. I'm using Riak 2.1 see attached status export. I'm working on a single cluster, and need to update from time to time the some search index on all nodes. As a cloud user, I can consider buying a spare host for a few days in order to achieve a complete rollout.

Re: Riak search, post schema change reindexation

2016-08-29 Thread Fred Dushin
Hi Guillame, A few questions. What version of Riak? Does the reindexing need to occur across the entire cluster, or just on one node? What are the expectations about query-ability while re-indexing is going on? If you can afford to take a node out of commission for query, then one approach w

Re: Riak Search: cursormark support

2016-07-25 Thread Zeeshan Lakhani
Hello Guillaume, We’re definitely working on it for a future release and there is still an open ticket regarding it: https://github.com/basho/yokozuna/issues/309 . Thanks. Zeeshan Lakhani programmer | software engineer at @basho | org. member/fou

Re: Riak Search and custom Solr components

2016-05-31 Thread Steve Garon
Thanks Luke, I knew you guys were working on this. And the solr reload is just amazing. I in fact used it today! Steve On 31 May 2016 at 13:08, Luke Bakken wrote: > Hi Steve and Guillaume - > > If you subscribe to this GitHub issue you can provide input and follow > progress on improving acce

Re: Riak Search and custom Solr components

2016-05-31 Thread Luke Bakken
Hi Steve and Guillaume - If you subscribe to this GitHub issue you can provide input and follow progress on improving access to solrconfig.xml: https://github.com/basho/yokozuna/issues/537 You might be able to restart a Solr core via the HTTP /solr endpoint - that may be easier than restarting al

Re: Riak Search and custom Solr components

2016-05-31 Thread Alexander Sicular
Solr config is a bit of an acquired skill, a black art even. Would you be willing to shed some light on what you find to work best for you with your use case? Thank you, Alexander @siculars http://siculars.posthaven.com Sent from my iRotaryPhone > On May 31, 2016, at 10:54, Steve Garon wr

Re: Riak Search and custom Solr components

2016-05-31 Thread Steve Garon
Hey Guillaume, We had to alter the solrconfig.xml in our deployment because the default solrconfig.xml does not give good search throughput with a large amount of documents updating often. I've opened a ticket at basho to get the solrconfig.xml save into the buckets settings that way they would be

Re: Riak Search and custom Solr components

2016-05-30 Thread Guillaume Boddaert
Please allow me to bump this previous message that was sent late last friday and that didn't attract much attention due to a well deserved week-end. On 27/05/2016 19:14, Guillaume Boddaert wrote: Hi there, I'm currently testing custom Component in my Riak Search system. As I need a suggestio

Re: Riak search with case-insensitive searches

2016-05-15 Thread Alex De la rosa
Yeah... I realised it... either way, my use case doesn't really require case-sensitive searches, so is good for me ;) Thanks, Alex On Sun, May 15, 2016 at 2:06 PM, Vitaly <13vitam...@gmail.com> wrote: > If you take a closer look, you can notice that the idea is to convert the > field to lower ca

Re: Riak search with case-insensitive searches

2016-05-15 Thread Vitaly
If you take a closer look, you can notice that the idea is to convert the field to lower case in insertion/indexing, and then look for a lowercase match during search. Which means you won't be able to use the same field for case-sensitive search. Unfortunately, I'm not aware of other ways of implem

Re: Riak search with case-insensitive searches

2016-05-15 Thread Alex De la rosa
I see, cool :) thanks for the help Alex On Sun, May 15, 2016 at 1:49 PM, Vitaly <13vitam...@gmail.com> wrote: > You can use a case-insensitive field type for this, for example > > sortMissingLast="true" omitNorms="true"> > > > >

Re: Riak search with case-insensitive searches

2016-05-15 Thread Vitaly
You can use a case-insensitive field type for this, for example Of course, you'll have to adjust your datatype/schema to make use of the new type. Regards, Vita

Re: Riak search on an index limited to only 1 bucket

2016-05-13 Thread Alex De la rosa
Oh, nice snippets! thanks Drew! Alex On Fri, May 13, 2016 at 11:28 PM, Drew Kerrigan wrote: > @Alex please kindly take a look at the default solr schema for Riak > Search. You should have based your custom schema on this (if you've created > a custom schema): > https://docs.basho.com/riak/kv/2.

Re: Riak search on an index limited to only 1 bucket

2016-05-13 Thread Drew Kerrigan
@Alex please kindly take a look at the default solr schema for Riak Search. You should have based your custom schema on this (if you've created a custom schema): https://docs.basho.com/riak/kv/2.1.4/developing/usage/search-schemas/ -> https://raw.githubusercontent.com/basho/yokozuna/develop/priv/de

Re: Riak search on an index limited to only 1 bucket

2016-05-13 Thread Alex De la rosa
Yes, using Python client. I'm able to store sets without problem into Riak, just wondered if indexing them in SOLR would be as simple as just adding the multiValued attribute to the "set" field... seems is going to be that way :) Thanks, Alex On Fri, May 13, 2016 at 11:15 PM, Vitaly <13vitam...@g

Re: Riak search on an index limited to only 1 bucket

2016-05-13 Thread Vitaly
In general, Riak/Solr is capable of indexing multi-valued properties (i.g. lists). You're right thinking that multiValued = "true" should be used for it. That said, check if it works with your client library (it's Python, isn't it?). I believe it does. Regards, Vitaly On Fri, May 13, 2016 at 9:59

Re: Riak search on an index limited to only 1 bucket

2016-05-13 Thread Alex De la rosa
Another question... if I have a set of tags for the elements... like photo.set['tags'] with things like: ["holidays", "Hawaii", "2016"]... will it be indexed like this? Thanks, Alex On Fri, May 13, 2016 at 10:52 PM, Alex De la rosa wrote: > Oh!! silly me... *_yz_rb* and *_yz_rt*... how didn't

Re: Riak search on an index limited to only 1 bucket

2016-05-13 Thread Alex De la rosa
Oh!! silly me... *_yz_rb* and *_yz_rt*... how didn't I think of that?... thanks also for the "*:*" tip ; ) Thanks! Alex On Fri, May 13, 2016 at 10:50 PM, Vitaly <13vitam...@gmail.com> wrote: > Hi Alex, > > 'likes_counter:[100 TO *] AND _yz_rb:photos' will limit query results to > the photos buc

Re: Riak search on an index limited to only 1 bucket

2016-05-13 Thread Vitaly
Hi Alex, 'likes_counter:[100 TO *] AND _yz_rb:photos' will limit query results to the photos bucket only. Similarly, "_yz_rt" is for a bucket type. Searching for anything in an index can be done with "*:*" (any field, any value). Regards, Vitaly On Fri, May 13, 2016 at 9:40 PM, Alex De la rosa

Re: Riak search 2 returning multiple stale results for single record

2016-02-17 Thread Zeeshan Lakhani
and when they might be available? > > Thanks, > Peter > > From: Zeeshan Lakhani mailto:zlakh...@basho.com>> > Date: Monday, 15 February 2016 20:27 > To: Peter Roberts mailto:peter.robe...@piksel.com>> > Cc: "riak-users@lists.basho.com <mailto:riak-users@lists.ba

Re: Riak search 2 returning multiple stale results for single record

2016-02-17 Thread Peter Roberts
m>> Cc: "riak-users@lists.basho.com<mailto:riak-users@lists.basho.com>" mailto:riak-users@lists.basho.com>> Subject: Re: Riak search 2 returning multiple stale results for single record Hello Peter, The cleanup for delete, as a call to SOLR, occurs after the reap hap

Re: Riak search 2 returning multiple stale results for single record

2016-02-15 Thread Zeeshan Lakhani
Hello Peter, The cleanup for delete, as a call to SOLR, occurs after the reap happens in the backend, depending on delete_mode of course. Did you notice any Solr errors in the logs related to “failed to index” or something similar? Maybe the delete request never hit the solr_core/search_index,

Re: Riak Search indexing json

2016-02-10 Thread Colin Walker
Thanks for the quick response everyone! It actually turned out I wasn't using my bucket types correctly. The bucket type must correspond to the Solr index I want to use, I know that now! Sorry for the confusion, I mixed up my types and my buckets. Without your help it wouldn't have worked though si

Re: Riak Search indexing json

2016-02-10 Thread Vitaly E
I would try setting the content type to "application/json" http://docs.basho.com/riak/latest/dev/taste-of-riak/java/#Creating-Objects-in-Riak to see if it solves the problem. If it's absolutely necessary to send custom JSON to Riak client. That said, I've never actually tried this since the client

Re: Riak Search indexing json

2016-02-10 Thread Zeeshan Lakhani
Good point Vitaly, also possible. Zeeshan Lakhani programmer | software engineer at @basho | org. member/founder of @papers_we_love | paperswelove.org twitter => @zeeshanlakhani > On Feb 10, 2016, at 10:53 AM, Vitaly E <13vitam...@gmail.com> wrote: > > Hi Colin, > > The problem is that in y

Re: Riak Search indexing json

2016-02-10 Thread Vitaly E
Hi Colin, The problem is that in your case JSON is interpreted as a String, as opposed to a Map/POJO with fields. Is there any reason you don't rely on the JSON serialization built into Riak Java client? Regards, Vitaly On Wed, Feb 10, 2016 at 5:40 PM, Colin Walker wrote: > Hello everyone,

Re: Riak Search indexing json

2016-02-10 Thread Zeeshan Lakhani
Hey Colin, Riak Search definitely indexes json documents. My guess is that your json-object keys are not indexed via the schema? We have an example in the docs page (w/ the Java client as well): http://docs.basho.com/riak/latest/dev/using/search/#Indexing-Values

Re: Riak Search 2.0 - CRDT Sets within Maps not returned in search results

2016-01-27 Thread Zeeshan Lakhani
Yep, it was changed in latest versions of 2.0 and 2.1. Zeeshan Lakhani programmer | software engineer at @basho | org. member/founder of @papers_we_love | paperswelove.org twitter => @zeeshanlakhani > On Jan 27, 2016, at 3:19 PM, Weixi Yen wrote: > > Just FYI, I'm actually running 2.1.0 vers

Re: Riak Search 2.0 - CRDT Sets within Maps not returned in search results

2016-01-27 Thread Weixi Yen
Just FYI, I'm actually running 2.1.0 version of Riak KV and the default schema is showing stored=false. *2.1.0-0-g6e88b24* to be specific on ubuntu. On OSX it's the same issue as well for 2.1.1 http://s3.amazonaws.com/downloads.basho.com/riak/2.1/2.1.1/osx/10.8/riak-2.1.1-OSX-x86_64.tar.gz It se

Re: Riak Search 2.0 - CRDT Sets within Maps not returned in search results

2016-01-27 Thread Weixi Yen
Awesome, that's what I was looking for, thank you! On Wed, Jan 27, 2016 at 11:40 AM, Zeeshan Lakhani wrote: > Weixi, > > Are you using 2.0.0 or another 2.0.* version? > > If you look at > https://github.com/basho/yokozuna/blob/2.0.0/priv/default_schema.xml#L104, > sets are not stored in the defa

Re: Riak Search 2.0 - CRDT Sets within Maps not returned in search results

2016-01-27 Thread Zeeshan Lakhani
Weixi, Are you using 2.0.0 or another 2.0.* version? If you look at https://github.com/basho/yokozuna/blob/2.0.0/priv/default_schema.xml#L104 , sets are not stored in the default schema, as they can get large. They’re

Re: Riak Search Pagination

2015-12-21 Thread Zeeshan Lakhani
Yes. Score is the default ordering. For "ties," insertion order is the default. That order could change based on which node is replicated to first and the different coverage plan may showcase that. Zeeshan Lakhani programmer | software engineer at @basho | org. member/founder of @papers_we_l

Re: Riak Search Pagination

2015-12-21 Thread Jorge Garrido
Great!! But can you explain why this issue? On Monday, December 21, 2015, Zeeshan Lakhani wrote: > Best to provide a specific sort ordering on a field if you can. > > Zeeshan Lakhani > programmer | > software engineer at @basho | > org. member/founder of @papers_we_love | > twitter => @zeeshanla

Re: Riak Search Pagination

2015-12-21 Thread Zeeshan Lakhani
Best to provide a specific sort ordering on a field if you can. Zeeshan Lakhani programmer | software engineer at @basho | org. member/founder of @papers_we_love | twitter => @zeeshanlakhani > On Dec 21, 2015, at 21:54, Garrido wrote: > > No, we don’t provide a sort on the query, let us chec

Re: Riak Search Pagination

2015-12-21 Thread Garrido
No, we don’t provide a sort on the query, let us check and we can tell you if its the same score, but, in case of search returns the same score, which one will be the solution? > On Dec 21, 2015, at 8:21 PM, Zeeshan Lakhani wrote: > > The coverage plan can change per query. Are you providing

Re: Riak Search Pagination

2015-12-21 Thread Zeeshan Lakhani
The coverage plan can change per query. Are you providing a sort on the query? If not or if by score, does each item return the same score? Zeeshan Lakhani programmer | software engineer at @basho | org. member/founder of @papers_we_love | twitter => @zeeshanlakhani > On Dec 21, 2015, at 18:3

Re: Riak Search Pagination

2015-12-21 Thread Garrido
M > To: Bryan Hunt > Cc: riak-users@lists.basho.com > Subject: Re: Riak Search Pagination > > Solr (2.x), >> On Dec 21, 2015, at 7:08 PM, Bryan Hunt wrote: >> >> In the context of Solr (2.x), legacy (1.4), or secondary indexes (2i) >> (1.x+)? >> >> &

Re: Riak Search Pagination

2015-12-21 Thread Bryan Hunt
ation ?   Original Message   From: Garrido Sent: Tuesday, December 22, 2015 1:09 AM To: Bryan Hunt Cc: riak-users@lists.basho.com Subject: Re: Riak Search Pagination Solr (2.x), > On Dec 21, 2015, at 7:08 PM, Bryan Hunt wrote: > > In the context of Solr (2.x), legacy (1.4), or secondary ind

Re: Riak Search Pagination

2015-12-21 Thread Garrido
Solr (2.x), > On Dec 21, 2015, at 7:08 PM, Bryan Hunt wrote: > > In the context of Solr (2.x), legacy (1.4), or secondary indexes (2i) (1.x+)? > > > Original Message > From: Garrido > Sent: Monday, December 21, 2015 11:36 PM > To: riak-users@lists.basho.com > Subject: Riak Search Paginati

Re: Riak Search Pagination

2015-12-21 Thread Bryan Hunt
In the context of Solr (2.x), legacy (1.4), or secondary indexes (2i) (1.x+)?    Original Message   From: Garrido Sent: Monday, December 21, 2015 11:36 PM To: riak-users@lists.basho.com Subject: Riak Search Pagination Hello, Recently we migrated our Riak nodes to another network, so we backup

Re: Riak Search in bucket with write_once = true

2015-08-11 Thread Marius Cobzarenco
Hey Zeeshan, Thanks for the clarification. I wasn't sure if it was a bug or intended behaviour, glad to hear it's the former and that it'll be fixed :-) best, Marius On 11 Aug 2015 3:43 am, "Zeeshan Lakhani" wrote: > Hey Marius, > > To put it simply, yes, 2.1.1 does not support write_once with

Re: Riak Search in bucket with write_once = true

2015-08-10 Thread Zeeshan Lakhani
Hey Marius, To put it simply, yes, 2.1.1 does not support write_once with search. Some objects will get indexed, but it will take a very long time and there will be issues with the cluster, etc… There should have been a note about this. Our apologies. We have solved the issue, and it will be s

Re: Riak Search 2.0 & Tagging

2015-06-02 Thread Antonio Teixeira
Hi Zee, Sorry for the extremely late response and I would to say , I'm highly thankful for your time. Antonio 2015-04-07 18:29 GMT+01:00 Zeeshan Lakhani : > Hello Antonio, > > Firstly, please always reply to the list and not via personal email. > > In regards to your question, I wrote a test th

Re: Riak Search 2.0 & Tagging

2015-04-07 Thread Zeeshan Lakhani
Hello Antonio, Firstly, please always reply to the list and not via personal email. In regards to your question, I wrote a test that showcases how to write objects with tags in pb for search: https://github.com/basho/yokozuna/pull/479/files#diff-f9f0e102b2a5208f41b2f304ada0ee5cR306

Re: Riak Search 2.0 & Tagging

2015-04-02 Thread Zeeshan Lakhani
Hello Antonio, You can insert an object and tag in the same operation, and you can query on that tag via Riak Search. Before writing the object, just apply/set the metadata accordingly. Here’s an example in the Erlang client: https://github.com/basho/riak-erlang-client/blob/7487c90275c88dbe8e

Re: riak search java client - sql injection

2015-03-23 Thread Jason W
Thanks. Looks like it is in the Solr ClientUtils.java class. Now need to decide whether to import solr into client code or dup the function. Jason On Mon, Mar 23, 2015 at 2:59 PM, Alexander Sicular wrote: > I'll second what Chris said. Afaik, Solr does not solve this problem for > you. Riak w

Re: riak search java client - sql injection

2015-03-23 Thread Alexander Sicular
I'll second what Chris said. Afaik, Solr does not solve this problem for you. Riak won't either. I just googled for "sanitize solr query inputs in java" and there are quite a few hits. I'd use that as a starting point but I'm a bit surprised there isn't a lib somewhere that makes this a non prob

Re: riak search java client - sql injection

2015-03-23 Thread Jason W
Thanks Chris. I meant the query injection. Was really looking for an api that takes parametrized query in risk java client, do you know whether solr provides that? It would not be a easy task to do a 100% secure santize function, the above query is really just a simple use case. Jason On Mon,

Re: riak search java client - sql injection

2015-03-23 Thread Christopher Meiklejohn
> On Mar 22, 2015, at 7:03 PM, Jason W wrote: > > Hello, > > I try to use the riak search java client, specifically the Search.Builder > class, like the following > > Search search = new Search.Builder("test", "_yz_rb:accounts AND email:" + > [user-email]). > > > > "[user-email]" is what

Re: Riak Search Production Configuration

2015-02-05 Thread Shawn Debnath
o:niravis...@yahoo.com>>; Luc Perkins mailto:lperk...@basho.com>> Cc: "riak-users@lists.basho.com<mailto:riak-users@lists.basho.com>" mailto:riak-users@lists.basho.com>> Sent: Thursday, February 5, 2015 1:49 PM Subject: Re: Riak Search Production Configuration Nira

Re: Riak Search Production Configuration

2015-02-05 Thread Nirav Shah
o.com" Sent: Thursday, February 5, 2015 1:49 PM Subject: Re: Riak Search Production Configuration Nirav, are you using CRDTs or plain old types with Riak? The definition for field names makes a big difference in what gets archived and solr will not complain if it couldn’t find match

Re: Riak Search Production Configuration

2015-02-05 Thread Shawn Debnath
m>> To: Nirav Shah mailto:niravis...@yahoo.com>> Cc: Shawn Debnath mailto:sh...@debnath.net>>; "riak-users@lists.basho.com<mailto:riak-users@lists.basho.com>" mailto:riak-users@lists.basho.com>> Sent: Thursday, February 5, 2015 11:04 AM Subject: Re: Riak

Re: Riak Search Production Configuration

2015-02-05 Thread Nirav Shah
              .withSearchIndex("test_idx")                        .build();        riakClient.execute(sbp);                              Regards,Nirav                                                 From: Luc Perkins To: Nirav Shah Cc: Shawn Debnath ; "riak-users@lists.basho.com" Sent: T

Re: Riak Search Production Configuration

2015-02-05 Thread Luc Perkins
- > *From:* Shawn Debnath > *To:* Nirav Shah ; "riak-users@lists.basho.com" < > riak-users@lists.basho.com> > *Sent:* Thursday, February 5, 2015 9:13 AM > > *Subject:* Re: Riak Search Production Configuration > > Hi Nirav, > > About your last point.

Re: Riak Search Production Configuration

2015-02-05 Thread Nirav Shah
.basho.com" Sent: Thursday, February 5, 2015 9:13 AM Subject: Re: Riak Search Production Configuration Hi Nirav, About your last point. Just yesterday I started playing with Search 2.0 (solr) and riak. Basho did a good job at integrating the solr platform but docs are sometimes

Re: Riak Search Production Configuration

2015-02-05 Thread Shawn Debnath
Hi Nirav, About your last point. Just yesterday I started playing with Search 2.0 (solr) and riak. Basho did a good job at integrating the solr platform but docs are sometimes misleading. One thing I found out was the using the default schema provided by Basho, if you are using CRDTs, your fiel

Re: RIAK Search - Active Anti-Entropy

2015-01-09 Thread Luke Bakken
ement Solr search successfully, we need to make sure > that Solr indexes existing data in current RIAK bucket. > > > Thanks, > Nirav > > > > > From: Luke Bakken > To: Nirav Shah > Cc: "riak-users@lists.basho.com" > S

Re: RIAK Search - Active Anti-Entropy

2015-01-09 Thread Nirav Shah
nt: Friday, January 9, 2015 10:22 AM Subject: Re: RIAK Search - Active Anti-Entropy Hi Nirav, If I'm reading your description correctly - you'd like your secondary index data to be automatically migrated to Riak Search? -- Luke Bakken Engineer lbak...@basho.com On Wed, Jan 7, 2015 at

Re: Riak Search having issues with custom schema

2015-01-09 Thread Santi Kumar
Cool I'll check that. Appreciate your timely help Luke On Jan 9, 2015 11:53 PM, "Luke Bakken" wrote: > Hi Santi, > > This means that the extractor is working. Your next step is to ensure > that the field names returned by the extractor match the field names > in your Solr schema. Also, please che

Re: Riak Search having issues with custom schema

2015-01-09 Thread Luke Bakken
Hi Santi, This means that the extractor is working. Your next step is to ensure that the field names returned by the extractor match the field names in your Solr schema. Also, please check to ensure that your schema has all required _yz_* fields. -- Luke Bakken Engineer lbak...@basho.com On Fri,

Re: RIAK Search - Active Anti-Entropy

2015-01-09 Thread Luke Bakken
Hi Nirav, If I'm reading your description correctly - you'd like your secondary index data to be automatically migrated to Riak Search? -- Luke Bakken Engineer lbak...@basho.com On Wed, Jan 7, 2015 at 10:36 PM, Nirav Shah wrote: > Hi Luke, > Can you please advice. ? > > "I have a production dat

Re: Riak Search having issues with custom schema

2015-01-09 Thread Santi Kumar
I ran the command as shown below but I was getting wierd errors. In the place of @object.json, I used the actual json content. Output was curl -XPUT http://localhost:8098/search/extract -H 'Content-Type: application/json' --data-binary @{"id":null,"tenantId":"eb0a1917-9762-3dd3-a48f-a681d3061212

Re: Riak Search having issues with custom schema

2015-01-09 Thread Luke Bakken
Please run your JSON document through the extractor to ensure that it's being parsed correctly: http://docs.basho.com/riak/latest/dev/advanced/search/#Extractors curl -XPUT http://localhost:8098/search/extract \ -H 'Content-Type: application/json' \ --data-binary @object.json If that w

Re: Riak Search having issues with custom schema

2015-01-09 Thread Santi Kumar
Luke It's application/json Here is the curl command and output dump with content-type in bold curl -v http://127.0.0.1:8098/buckets/junit_MASTER-Policies/keys/2d29e759-8e30-499a-8ecc-98eb09eeaa9f * About to connect() to 127.0.0.1 port 8098 (#0) * Trying 127.0.0.1... * Adding handle: conn: 0x

Re: Riak Search having issues with custom schema

2015-01-09 Thread Luke Bakken
Can you retrieve the object using "curl" and let me know what the "Content-Type" header is when returned? -- Luke Bakken Engineer lbak...@basho.com On Fri, Jan 9, 2015 at 8:44 AM, Santi Kumar wrote: > No content type is specified explicitly. Directly object is passed to > StoreValue.Builder(). S

Re: Riak Search having issues with custom schema

2015-01-09 Thread Santi Kumar
No content type is specified explicitly. Directly object is passed to StoreValue.Builder(). Some where I read that pojo is extracted as json. Am I missing something? . Here is the code. Location user_locaiton = new Location(nameSpace, key); StoreValue storeUserOp = new StoreValue.Builder(

Re: Riak Search having issues with custom schema

2015-01-09 Thread Luke Bakken
How are you storing these objects? What "Content-Type" is being used? -- Luke Bakken Engineer lbak...@basho.com On Fri, Jan 9, 2015 at 7:04 AM, Santi Kumar wrote: > Hi, > We are having issues with Riak Search custom schema. Application has > multiple POJO's and we are using Java client to write

Re: RIAK Search - Active Anti-Entropy

2015-01-07 Thread Nirav Shah
ho.com" Sent: Tuesday, January 6, 2015 10:12 PM Subject: Re: RIAK Search - Active Anti-Entropy Hi guys,Can someone please help answer below? Regards,Nirav  From: Nirav Shah To: "riak-users@lists.basho.com" Sent: Friday, January 2, 2015 10:05 AM Subject: RIA

Re: RIAK Search - Active Anti-Entropy

2015-01-06 Thread Nirav Shah
Hi guys,Can someone please help answer below? Regards,Nirav  From: Nirav Shah To: "riak-users@lists.basho.com" Sent: Friday, January 2, 2015 10:05 AM Subject: RIAK Search - Active Anti-Entropy Hello,I have a production database which is fairly large and uses Secondary Indexes. I

Re: Riak Search: 'Failed to index docs' error when inserting a document from tutorial

2014-11-24 Thread Stanislav Nazarenko
Hi Luke, I’ve been messing with my Riak cluster since our last communication and when I ran your command, I got the following response with siblings: = Siblings: 5VLG9CV4KsvrqGYeDhs5fK xwAMA6aDXvOgBoGItBRA0 5IIcpzXLMtn24may8JIyQ9 = (see liono.json attache

Re: Riak Search: 'Failed to index docs' error when inserting a document from tutorial

2014-11-24 Thread Luke Bakken
Hi Stanislav, Could you please run the following command and attach the output file in your reply? curl -o liono.json -XGET localhost:10018/types/animals/buckets/cats/keys/liono -- Luke Bakken Engineer / CSE lbak...@basho.com On Wed, Nov 12, 2014 at 11:54 AM, Stanislav Nazarenko wrote: > Luke

Re: Riak Search queries

2014-11-24 Thread Eric Redmond
Don't use that. It's internal to Riak. Never never use /internal_solr. Use the /solr interface exposed by Riak, and defined in the documentation. Take care, Eric On Nov 24, 2014 9:35 AM, "Jason Ryan" wrote: Hi Eric, I'm using the internal_solr web front end right now, port 8093 On this particu

Re: Riak Search queries

2014-11-24 Thread Jason Ryan
Hi Eric, I don't get multiple siblings on a Riak GET for the key. My buckets currently have allow_mult: false and last_write_wins: true The n_val is the default 3 When I search, an example return is as follows, I can see the _yz_id has a unique number on the end alright though? Thanks for the h

Re: Riak Search queries

2014-11-22 Thread Eric Redmond
You can check if your object has siblings by performing a key get, and see if two values return. If not, then it may be the index. Can you paste the response where you get two values? Thanks, Eric On Nov 13, 2014, at 9:46 AM, Jason Ryan wrote: > Thanks Eric - I don't see the _yz_vtag returne

Re: Riak Search queries

2014-11-13 Thread Jason Ryan
Thanks Eric - I don't see the _yz_vtag returned in the search result set - so not sure how to tell that? [image: photo] *Jason Ryan* VP Engineering Trustev Real Time, Online Identity Verification email: jason.r...@trustev.com skype: jason_j_ryan web: www.trustev.com Trustev Ltd, 2100 Cork Air

Re: Riak Search: 'Failed to index docs' error when inserting a document from tutorial

2014-11-12 Thread Stanislav Nazarenko
Luke, Thanks for your reply. 1) I'm using a fresh checkout from https://github.com/basho/riak-python-client. Maybe I should be using the latest official release, 2.1.0? 2) Here's what I got after running curl: * Adding handle: conn: 0x7f9c03804400 * Adding handle: send: 0 * Adding handle: recv

Re: Riak Search queries

2014-11-12 Thread Eric Redmond
On Nov 11, 2014, at 3:55 AM, Jason Ryan wrote: > Hi all, > > I have some quick (hopefully!) questions around Riak search. > > 1. I'm getting multiple documents returned in the search results for a query > - which I assume is based on the n_val of my bucket as I tried to change the > search i

Re: Riak Search: 'Failed to index docs' error when inserting a document from tutorial

2014-11-12 Thread Luke Bakken
Hi Stanislav, * Which version of the Python client are you using? * Could you please attempt to insert the "liono" document using curl? curl -vvv -H'Content-type: application/json' -XPUT localhost:10018/types/animals/buckets/cats/keys/liono -d '{"name_s":"Lion-o","age_i":30,"leader_b":true}' --

Re: Riak Search Schema Question

2014-10-27 Thread Andrew Zeneski
I know this might sound strange, but what if the data was formatted like so: {"id": 1, stats: [ {"stat1": {"name":"stat1", "group": "x", "value": 1}}, {"stat2": {"name": "stat2", "group": "x", "value": 5}} ] } Would the default extractor flatten this to : stats.stat1.name = stat1, stats.stat1.gr

Re: Riak Search Schema Question

2014-10-26 Thread Andrew Zeneski
That would be ideal I know, but would require a huge effort and is something I am saving as a last resort. A custom extractor should allow me to massage the value into a more index friendly format before sending to Solr but allowing the value to remain in its current form. I have no experience wit

Re: Riak Search Schema Question

2014-10-26 Thread Alexander Sicular
That might happen. Could you rearrange your data to look like Id: ... , stats: { Stat1: [ ... ], Stat2: [ ... ], ... } Then you could do a stats_stat1 > 1 query. It's also more space efficient. Derived vs explicit naming. Stat(N) could even be an array of hashes like [{value:..., dates

Re: Riak Search Schema Question

2014-10-26 Thread Andrew Zeneski
Yes right, I was tired when I typed this; stats should be an array: {"id": 1, "stats": [{ "name": "stat1", "value": 1 }, {"name": "stat2", "value": 5}]} {"id": 2, "stats": [{ "name": "stat3", "value": 2 }, {"name": "stat1", "value": 3}]} {"id": 3, "stats": [{ "name": "stat2", "value": 3 }, {"name"

Re: Riak Search Schema Question

2014-10-25 Thread Alexander Sicular
Haven't tried it out but should stats be an array? And the query would be something like Stats_name = stat1 and stats_value > 1 I think the extractor flattens everything and separates with underscores. -Alexander @siculars http://siculars.posthaven.com Sent from my iRotaryPhone > On Oct 2

Re: Riak Search on "Sets" data-types

2014-08-22 Thread Alex De la rosa
Answering my own question, in case somebody has the same need some day, seems that a SET works like a collection of REGISTERS and you can use it as follows: r = client.fulltext_search('ix_images', 'keywords_set:DLSR') Thanks! Alex On Thu, Aug 21, 2014 at 8:32 PM, Alex De la rosa wrote: > Hi th

Re: Riak Search VS other query systems

2014-08-21 Thread Sean Cribbs
We have some prototypes for how to expand Pipe's capabilities thanks to Chris Meiklejohn. We have not exposed it directly and I honestly think it may be the fundamentally wrong level of abstraction to present to users. It could be a way to implement higher-level query/processing features, but that

Re: Riak Search VS other query systems

2014-08-21 Thread Alexander Sicular
Re. Riak pipes. What's the latest regarding accessing the pipe framework? Haven't heard t much about it lately, admittedly haven't been listening t hard either. The thought would be to do "storm"ish stream processing in situ. @siculars http://siculars.posthaven.com Sent from my iRota

Re: Riak Search VS other query systems

2014-08-20 Thread Sargun Dhillon
I second John's opinions. Generally, I would have have one key which is the secondary index, being an observe-remove OR-Set (or a relevant type for your application, be a register, g-set, or a plain old OR-set) pointing to back to the keys. Unfortunately, this mechanism can become quite unwieldy in

Re: Riak Search VS other query systems

2014-08-20 Thread John Daily
I don't have benchmarks to discuss query performance for different tools at different sizes, but I'd like to point out that the ultimate search tool for Riak is to not search at all. Riak Search, 2i, MapReduce are all capable tools, but they don't scale nearly as well as straight key/value request

Re: Riak Search VS other query systems

2014-08-20 Thread Alex De la rosa
Any thoughts about this? One thing it worries me about Riak Search is that if one index has several millions of object to search for maybe it becomes slow? 2i might be faster then? Thanks! Alex On Tue, Aug 19, 2014 at 8:47 AM, Alex De la rosa wrote: > Hi there, > > I had been seeing lately Ri

Re: Riak Search Issue

2014-08-19 Thread Alex De la rosa
Hi Sean, Yeah, I opted to follow that pattern on my latest attempt as I see it more clear that the way in the documentation. Still same issue although with Eric we saw it works fine when index and bucket has the same name. Thanks! Alex On Mon, Aug 18, 2014 at 11:27 PM, Sean Cribbs wrote: > Do

Re: Riak Search Issue

2014-08-19 Thread Alex De la rosa
Hi Eric, You were right on naming the bucket the same as the index... it worked that way: bucket = client.bucket_type('futbolistas').bucket('famoso') results = bucket.search('name_s:Lion*') print results {'num_found': 2, 'max_score': 1.0, 'docs': [{u'age_i': u'30', u'name_s': u'Lionel', u'_yz_rk

Re: Riak Search Issue

2014-08-18 Thread tele
Hi, I had the same issue while playing with the latest python client and riak search 2.0 but i checked the code and sorted it out. In the new documentation fulltext_search() is not mentioned, it uses search() http://basho.github.io/riak-python-client/query.html#fulltext-search If you dig in the c

Re: Riak Search Issue

2014-08-18 Thread Alex De la rosa
Hi Eric, Cool! This new syntax really worked :) even on different bucket names :) It has been driving me crazy all day... haha, glad is finally sorted out. PYTHON: results = client.fulltext_search('famoso', 'name_s:Lio*') print results OUTPUT: {'num_found': 2, 'max_score': 1.0, 'docs': [{u'age_i

Re: Riak Search Issue

2014-08-18 Thread Eric Redmond
Alex, I was mistaken about the bucket search. The documentation is wrong, and the API is weirded for backward compatibility reasons. You should be able to search by index name this way. client.fulltext_search(index, query, **params) We'll update the docs to match. Eric On Aug 18, 2014, at 2

Re: Riak Search Issue

2014-08-18 Thread Sean Cribbs
Don't use bucket with 2 arguments, use client.bucket_type('futbolistas').bucket('fcb'). This makes your intent more clear. The 2-arity version of bucket() was for backwards-compatibility. On Mon, Aug 18, 2014 at 4:10 PM, Eric Redmond wrote: > Alex, > > You may have discovered a legitimate bug in

Re: Riak Search Issue

2014-08-18 Thread Eric Redmond
Your steps seemed to have named the index "famoso". Eric On Aug 18, 2014, at 1:56 PM, Alex De la rosa wrote: > Ok, I found the first error in the documentation, parameters are in reverse > order: > > bucket = client.bucket('animals', 'cats') > > should be: > > bucket = client.bucket('cats'

Re: Riak Search Issue

2014-08-18 Thread Alex De la rosa
Hi Eric, I will try this suggestion, also I will try Luke's suggestion on using GIT's latest version instead of PIP to see if is something already fixed. Once done that, I will tell you guys if is really a bug or if it was fixed already on GIT cloning. Thanks, Alex On Mon, Aug 18, 2014 at 11:1

Re: Riak Search Issue

2014-08-18 Thread Eric Redmond
Alex, You may have discovered a legitimate bug in the python driver. In the meantime, if you give your bucket and index the same name, you can proceed, while we investigate. Thanks, Eric On Aug 18, 2014, at 2:00 PM, Alex De la rosa wrote: > Yes, I did it in purpose, because I did so many te

Re: Riak Search Issue

2014-08-18 Thread Alex De la rosa
Hi Eric, I'm sorry but I followed the documentation that you provided me and still raises issues: STEP 1: Create Index: famoso

Re: Riak Search Issue

2014-08-18 Thread Alex De la rosa
Ok, I found the first error in the documentation, parameters are in reverse order: bucket = client.bucket('animals', 'cats') should be: bucket = client.bucket('cats', 'animals') Now I could save and it found the bucket type: bucket = client.bucket('fcb','futbolistas') VS bucket = client.bucket(

  1   2   3   4   >