Re: Secondary indexes or Riak search ?

2017-02-13 Thread John Daily
> > A quick look at riak_test it seems that the `return_body` parameter is > generally supported for both HTTP and PB now. I wasn’t aware of that. I’m not sure into which releases the feature has made it, but bewarned: if it works at all, return_body only works for system indexes: $bucket and $

Re: Secondary indexes or Riak search ?

2017-02-13 Thread Alex Feng
s to fetch > the object in one time. > > > > > > > > > Our use case, client search DB every 10 seconds by 2i, Riak will > return a list of around 5000 results(Keys), then client will query DB to > fetch value for each key, basically it is around 5000 times, clie

Re: Secondary indexes or Riak search ?

2017-02-13 Thread Russell Brown
of the time. Any suggestion here ? > > > > Many thanks in advance. > > > > Br, > > Alex > > > > 2017-02-06 19:02 GMT+08:00 Alex Feng : > > Hi Russell, > > > > It is really helpful, thank you a lot. > > We are suffering from solr cra

Re: Secondary indexes or Riak search ?

2017-02-13 Thread Alex Feng
anks in advance. > > > > Br, > > Alex > > > > 2017-02-06 19:02 GMT+08:00 Alex Feng : > > Hi Russell, > > > > It is really helpful, thank you a lot. > > We are suffering from solr crash now, are considering to switch to 2i. > > > > Br, &

Re: Secondary indexes or Riak search ?

2017-02-13 Thread Russell Brown
s easy to run into > some issues most of the time. Any suggestion here ? > > Many thanks in advance. > > Br, > Alex > > 2017-02-06 19:02 GMT+08:00 Alex Feng : > Hi Russell, > > It is really helpful, thank you a lot. > We are suffering from solr crash now,

Re: Secondary indexes or Riak search ?

2017-02-12 Thread Alex Feng
16:53 GMT+08:00 Russell Brown : > >> It’s worth noting that secondary indexes (2i) has some other advantages >> over solr search. If you _can_ model your queries in 2i then I'd recommend >> it. >> >> Secondary indexes have a richer API than is currently

Re: Secondary indexes or Riak search ?

2017-02-06 Thread Alex Feng
Hi Russell, It is really helpful, thank you a lot. We are suffering from solr crash now, are considering to switch to 2i. Br, Alex 2017-02-06 16:53 GMT+08:00 Russell Brown : > It’s worth noting that secondary indexes (2i) has some other advantages > over solr search. If you _can_ mode

Re: Secondary indexes or Riak search ?

2017-02-06 Thread Russell Brown
It’s worth noting that secondary indexes (2i) has some other advantages over solr search. If you _can_ model your queries in 2i then I'd recommend it. Secondary indexes have a richer API than is currently documented, if you look at https://docs.basho.com/riak/1.4.7/dev/using/2i/ you’l

Re: Secondary indexes or Riak search ?

2017-02-02 Thread Jason Voegele
Hi Alex, There is some info on this page that can help you decide: http://docs.basho.com/riak/kv/2.2.0/developing/usage/secondary-indexes/ See the sections titled "When to Use Secondary Indexes" and " When Not to Use Secondary Indexes". Sent from my iPad > On Feb 2,

Secondary indexes or Riak search ?

2017-02-02 Thread Alex Feng
Hello Riak-users, I am currently using Riak search to do some queries, since my queries are very simple, it should be fulfilled by secondary indexes as well. So, my question is which one has better performance and less overhead, let's say both can fulfill the query requirement. Many than

Re: secondary indexes

2017-01-17 Thread Russell Brown
On 18 Jan 2017, at 03:07, Andy leu wrote: > thank you guys, that helps a lot. > one more question, do you think solr is a better solution than seconary > indexes? It depends on your use case. There are Riak users who have great success with secondary indexes for their use case, f

Re: secondary indexes

2017-01-17 Thread Andy leu
thank you guys, that helps a lot. one more question, do you think solr is a better solution than seconary indexes? andrew From: Russell Brown Sent: Tuesday, January 17, 2017 3:45:34 PM To: Andy leu Cc: riak-users@lists.basho.com Subject: Re: secondary indexes

Re: secondary indexes

2017-01-16 Thread Russell Brown
Hi, Riak's secondary indexes require a sorted backend, either of the memory or leveldb backends will work, bitcask does not support secondary indexes. More details here  http://docs.basho.com/riak/kv/2.2.0/developing/usage/secondary-indexes/ Cheers Russell On Jan 17, 2017, at 07:13 AM,

secondary indexes

2017-01-16 Thread Andy leu
hi: I ran the code as shown in http://docs.basho.com/riak/kv/2.2.0/developing/getting-started/python/querying/. when I tried the lines about secondary index : october_orders = order_bucket.get_index("order_date_bin", "2013-10-01", "2013-10-31") october_or

Re: Secondary indexes do not work with leveldb and write_once?

2016-01-13 Thread Fred Dushin
with write-once is supported there. -Fred > On Jan 13, 2016, at 12:10 PM, Eugene Shubin wrote: > > Hello, > I am using riak 2.1.3 with leveldb backend. > > Secondary indexes do not return me anything if bucket type has write_once > option set to true. > Record is ac

Secondary indexes do not work with leveldb and write_once?

2016-01-13 Thread Eugene Shubin
Hello, I am using riak 2.1.3 with leveldb backend. Secondary indexes do not return me anything if bucket type has write_once option set to true. Record is accessible buy key and has index in metadata. It works though for other bucket types. Is it bug or undocumented constraint? Best, Eugene

Searching using secondary indexes with PBCclient

2015-11-17 Thread Rohan Kalambekar
Hi, I need to query using secondary indexes. I have PBCclient. I have tried using IRiakClient myPbClient = null; myPbClient = RiakFactory.pbcClient("localhost", 8087); Namespace ns = new Namespace("bucket_name"); BinIndexQuery biq = new BinIndexQuery.Builde

Re: secondary indexes limit

2013-10-21 Thread Louis-Philippe Perron
count over 10 names. thanks! On Mon, Oct 21, 2013 at 10:41 AM, Russell Brown wrote: > Hi Louis-Philippe, > It costs to create secondary indexes. Nothing is free. > > But I'm not sure what "1000 different secondary indexes" means. When you > add secondary indexes

Re: secondary indexes limit

2013-10-21 Thread Russell Brown
Hi Louis-Philippe, It costs to create secondary indexes. Nothing is free. But I'm not sure what "1000 different secondary indexes" means. When you add secondary indexes we store the name of the index and the value it indexes as part of the object metadata and on disk in an index

Re: secondary indexes limit

2013-10-21 Thread Louis-Philippe Perron
I had heard from a possibly unfounded source that creating over 1000 different secondary indexes could place a burden on cluster performance. Can anyone confirm that? L-P On Fri, Oct 18, 2013 at 5:55 PM, Alexander Sicular wrote: > I think that's just a memory limit. > > mo

Re: secondary indexes limit

2013-10-18 Thread Alexander Sicular
I think that's just a memory limit. mo 2i mo problems. @siculars http://siculars.posthaven.com Sent from my iRotaryPhone > On Oct 18, 2013, at 16:44, Louis-Philippe Perron wrote: > > Hi, > this question has probably been answered already, still I can't get to it, so, > > What is the maxim

secondary indexes limit

2013-10-18 Thread Louis-Philippe Perron
Hi, this question has probably been answered already, still I can't get to it, so, What is the maximum number of unique secondary indexe keys a riak cluster can manage before running into trouble? thanks! L-P ___ riak-users mailing list riak-users@list

Re: Storing dates in Secondary Indexes

2013-09-23 Thread Luke Bakken
Hi Matt, I've asked around and there doesn't seem to be much of a performance difference between the two. Unix timestamps were recommended due to the simplicity of doing range queries (like Matthew Dawson suggested) as well as storage size. Just use UTC and you'll be set. -- Luke Bakken CSE lbak..

Re: Storing dates in Secondary Indexes

2013-09-23 Thread Matthew Dawson
On September 23, 2013 12:41:04 PM Matt Black wrote: > Hey list. > > A quick question on best practices really: > >- Should I use a bin index with ISO8601 format? >- Or should I use an Unix timestamp as an integer index? >- Is there likely to be a performance difference? (There will ce

Storing dates in Secondary Indexes

2013-09-22 Thread Matt Black
Hey list. A quick question on best practices really: - Should I use a bin index with ISO8601 format? - Or should I use an Unix timestamp as an integer index? - Is there likely to be a performance difference? (There will certainly be storage size difference). - Has anyone had an spe

Re: Secondary indexes in ruby (using riak-ruby-client)

2013-09-17 Thread Wagner Camarao
lib error is obscuring what's really happening in the > background. > > What backend are you using? > > If it is bitcask then this will not work and you need to switch to one > that supports 2I, like levelDB: > > > https://github.com/basho/riak-ruby-clien

Re: Secondary indexes in ruby (using riak-ruby-client)

2013-09-17 Thread Charl Matthee
:in > `finish' I think the Zlib error is obscuring what's really happening in the background. What backend are you using? If it is bitcask then this will not work and you need to switch to one that supports 2I, like levelDB: https://github.com/basho/riak-ruby-client/wiki/Secondary-Index

Secondary indexes in ruby (using riak-ruby-client)

2013-09-17 Thread Wagner Camarao
Hi, I'm trying to get a hello world example working as follows: require 'riak' client = Riak::Client.new bucket = client.bucket('revisions') object = Riak::RObject.new(bucket, 'foo').tap do |o| o.content_type = 'application/json' o.data = '' end object.indexes[:bars_bin] = %w(foo bar) obje

Re: python map reduce and secondary indexes

2012-12-10 Thread Bryan Fink
? This is a limitation of Riak's secondary indexes: you're only able to query one index at a time. To perform the query you describe, you have two options: create a unified index, or query by one index and filter by the other. To create a unified index, you would add another field, 'coun

python map reduce and secondary indexes

2012-12-07 Thread David Montgomery
Hi, Given that map reduce is the primary way of getting data out of riak, and i use python api, I am hard pressed to find any simple examples. Not even on the officially supported riak python api. Below is how I add a record to riak: id = """%s:%s:%s:%s:%s""" % (str(uuid4()),campaig

Re: Emulating composite index queries with secondary indexes and key filters

2012-08-28 Thread Olav Frengstad
Looking at riak_kv_mapred_json it seems to be the case that you can only do key filter on entire buckets. On the other hand one can still use the riak_kv_mapred_filters, even though it's ugly constructing all the filter manually instead of matching binary patterns: {ok, Pid} = riakc_pb_socket:sta

Re: Emulating composite index queries with secondary indexes and key filters

2012-08-28 Thread Jeremiah Peschka
As best as I can recall, you can't key filter on 2i. You can, however, perform range filtering. You could query where the 2i key is between 20110101T00:00:00Z|a|a and 20110201T00:00:00Z|zzz|zzz Please forgive any typos. I'm using a phone. On Tuesday, August 28, 2012, Olav Frengstad wrote: > Hey,

Emulating composite index queries with secondary indexes and key filters

2012-08-28 Thread Olav Frengstad
Hey, I'm looking to use riak to store time series. So naturaly i'm in the processes of validating all possible methods this query. A object has a id, origin, timestamp and type. The query in question is to select all object within a time range that originated from "origin" and has a certain "type"

Re: Inconsistent results with secondary indexes and spaces

2012-08-02 Thread Paul Gross
I upgraded riak on the vagrant image, and now I see consistent results with spaces. I will follow up with Travis CI to upgrade their images. Thanks, Paul www.pgrs.net On 7/27/12 1:26 PM, Paul Gross wrote: It's Ubuntu 11.10. I'm using the Travis Vagrant image, so you can download that and try i

Re: Inconsistent results with secondary indexes and spaces

2012-07-27 Thread Paul Gross
It's Ubuntu 11.10. I'm using the Travis Vagrant image, so you can download that and try it if you like: http://files.travis-ci.org/boxes/provisioned/travis-standard.box The rough steps I did were: gem install vagrant vagrant box add travis-standard http://files.travis-ci.org/boxes/provisioned

Re: Inconsistent results with secondary indexes and spaces

2012-07-27 Thread Kelly McLaughlin
Paul, I just tried on OS X and Ubuntu 11.10 and got the expected results on both so I'm not sure what could be going on. What version of Ubuntu were you trying? Kelly On Jul 20, 2012, at 6:12 PM, Paul Gross wrote: > I'm seeing different results when performing a 2i query with spaces on > di

Re: Inconsistent results with secondary indexes and spaces

2012-07-26 Thread Paul Gross
Has anyone taken a look at this? I'm concerned that spaces and special characters in secondary indexes are inconsistent. Thanks, Paul On 7/20/12 5:12 PM, Paul Gross wrote: I'm seeing different results when performing a 2i query with spaces on different platforms. On OS X, I find

Inconsistent results with secondary indexes and spaces

2012-07-20 Thread Paul Gross
I'm seeing different results when performing a 2i query with spaces on different platforms. On OS X, I find the object. On an ubuntu vagrant image used by Travis CI, I do not. For example, here is my test script: require 'riak' client = Riak::Client.new bucket = client.bucket("test")

Re: Secondary indexes on Multi Backend

2012-05-28 Thread Kresten Krab Thorup
It'll only work if the backend behind multi is eleveldb. That may be your issue. Kresten On 28/05/2012, at 03.21, "Matt Black" mailto:matt.bl...@jbadigital.com>> wrote: Hey list, Can someone confirm if 2i will work with multi backend please? I get this error when running an index phase in map

Secondary indexes on Multi Backend

2012-05-27 Thread Matt Black
Hey list, Can someone confirm if 2i will work with multi backend please? I get this error when running an index phase in map reduce: "indexes_not_supported,riak_kv_multi_backend". Yet, the following pull request suggests that this would work: https://github.com/basho/riak_kv/pull/258/commits An

Re: Link or Secondary Indexes?

2012-03-29 Thread Buri Arslon
gt;>>> other query methods: search, a general MapReduce, etc. But links would be >>>> an extremely poor choice. >>>> >>>> Does this help? This page might also be applicable to your question: >>>> >>>> http://wiki.basho.

Re: Link or Secondary Indexes?

2012-03-29 Thread Buri Arslon
other query methods: search, a general MapReduce, etc. But links would be >>>> an extremely poor choice. >>>> >>>> Does this help? This page might also be applicable to your question: >>>> >>>> http://wiki.basho.com/MapR

Re: Link or Secondary Indexes?

2012-03-29 Thread Buri Arslon
://wiki.basho.com/MapReduce-Search-2i-Comparison.html >> >> If you plan on just doing MapReduce queries without 2i, and don't care >> about link walking, then just storing a typical JSON object and not using >> either is perfectly fine as well. >> >> -- >&g

Re: Link or Secondary Indexes?

2012-03-29 Thread Alexander Sicular
; >> http://wiki.basho.com/MapReduce-Search-2i-Comparison.html >> >> If you plan on just doing MapReduce queries without 2i, and don't care >> about link walking, then just storing a typical JSON object and not using >> either is perfectly fine as well. >

Re: Link or Secondary Indexes?

2012-03-29 Thread Jeremiah Peschka
pReduce-Search-2i-Comparison.html > > If you plan on just doing MapReduce queries without 2i, and don't care about > link walking, then just storing a typical JSON object and not using either is > perfectly fine as well. > > -- > Jeffrey Massung > Software Engineer >

Re: Link or Secondary Indexes?

2012-03-29 Thread Buri Arslon
ell. > > -- > Jeffrey Massung > Software Engineer > j...@basho.com > > On Mar 29, 2012, at 8:29 AM, Buri Arslon wrote: > > Hi, > > While developing my pet project few questions came to my mind and I > decided to consult with you. > > Which of them are mor

Re: Link or Secondary Indexes?

2012-03-29 Thread Jeffrey Massung
On Mar 29, 2012, at 8:29 AM, Buri Arslon wrote: > Hi, > > While developing my pet project few questions came to my mind and I decided > to consult with you. > > Which of them are more effective for recording relationships: Link or > Secondary Indexes? > > 1.

Re: Link or Secondary Indexes?

2012-03-29 Thread Kresten Krab Thorup
" wrote: > Hi, > > While developing my pet project few questions came to my mind and I decided > to consult with you. > > Which of them are more effective for recording relationships: Link or > Secondary Indexes? > > 1. Friend relationships: like Facebook fr

Link or Secondary Indexes?

2012-03-29 Thread Buri Arslon
Hi, While developing my pet project few questions came to my mind and I decided to consult with you. Which of them are more effective for recording relationships: Link or Secondary Indexes? 1. Friend relationships: like Facebook friends? 2. Followed/follower relationships like in Twitter? 3

Re: Open end range query in secondary indexes?

2012-03-17 Thread Daniil Churikov
e, map_object_value}, none, true}]) -- View this message in context: http://riak-users.197444.n3.nabble.com/Open-end-range-query-in-secondary-indexes-tp3833684p3834708.html Sent from the Riak Users mailing list archive at Nabble.com. _

Open end range query in secondary indexes?

2012-03-16 Thread Eric Fong
Hi Can we search "All keys before XX" or "All keys after YY" instead range search like "things between XX and YY" ? -- Best Regards, Eric Fong ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_li

Re: Can't find docs/tutorial on secondary indexes for riak-erlang-client

2012-03-13 Thread Mark Phillips
not an Erlang expert, or even something remotely resembling >>>>> competent with Erlang, however, I believe I have tracked down what you're >>>>> looking for. >>>>> >>>>> You can use one of the riakc_pb_socket:get_index functions to p

Re: Can't find docs/tutorial on secondary indexes for riak-erlang-client

2012-03-13 Thread Daniil Churikov
But now i got stuck wtih how to give this keys as input to map phase? -- View this message in context: http://riak-users.197444.n3.nabble.com/Can-t-find-docs-tutorial-on-secondary-indexes-for-riak-erlang-client-tp3817052p3822853.html Sent from the Riak Users mailing list archive at Nabble.com

Re: Can't find docs/tutorial on secondary indexes for riak-erlang-client

2012-03-12 Thread Daniil Churikov
t;"k7">>, <<"k6">>, <<"k5">>, <<"k4">>, <<"k3">>, <<"k2">>, > <<"k1">>]} where <<"$key">> is a special value ofr key index. I tes

Fwd: Can't find docs/tutorial on secondary indexes for riak-erlang-client

2012-03-11 Thread Buri Arslon
-- Forwarded message -- From: Buri Arslon Date: Sun, Mar 11, 2012 at 11:47 PM Subject: Re: Can't find docs/tutorial on secondary indexes for riak-erlang-client To: Mark Phillips No problem, Mark. I've submitted a new issue. https://github.com/basho/riak_wiki/issues/2

Re: Can't find docs/tutorial on secondary indexes for riak-erlang-client

2012-03-11 Thread Mark Phillips
ld be wrong on that one. > > If I'm wrong, hopefully someone on the list will correct my Erlang-y > ignorance. > > get_index/4 [1] > get_index/5 [3] > get_index/6 [2] > get_index/7 [4] > > > > [1]: > https://github.com/basho/riak-erlang-client/blob/maste

Re: Can't find docs/tutorial on secondary indexes for riak-erlang-client

2012-03-11 Thread Buri Arslon
pers around a MapReduce call. As far as setting the >>> values... I think you'll have to make a call to riakc_obj:update_metadata >>> and add the index metadata in by hand, but I could be wrong on that one. >>> >>> If I'm wrong, hopefully someone o

Re: Can't find docs/tutorial on secondary indexes for riak-erlang-client

2012-03-11 Thread Buri Arslon
gt;> get_index/4 [1] >> get_index/5 [3] >> get_index/6 [2] >> get_index/7 [4] >> >> >> >> [1]: >> https://github.com/basho/riak-erlang-client/blob/master/src/riakc_pb_socket.erl#L677 >> [2]: >> https://github.com/basho/riak-

Re: Can't find docs/tutorial on secondary indexes for riak-erlang-client

2012-03-11 Thread Buri Arslon
/riak-erlang-client/blob/master/src/riakc_pb_socket.erl#L732 > --- > Jeremiah Peschka - Managing Director, Brent Ozar PLF, LLC > Microsoft SQL Server MVP > > On Mar 11, 2012, at 11:06 AM, Buri Arslon wrote: > > > Hi everybody, > > > > I can't find any tutori

Re: Can't find docs/tutorial on secondary indexes for riak-erlang-client

2012-03-11 Thread Jeremiah Peschka
6 AM, Buri Arslon wrote: > Hi everybody, > > I can't find any tutorial or docs on secondary indexes. Here > (http://lists.basho.com/pipermail/riak-users_lists.basho.com/2011-October/005952.html) > it was stated that the docs would be updated but I can't find it. >

Can't find docs/tutorial on secondary indexes for riak-erlang-client

2012-03-11 Thread Buri Arslon
Hi everybody, I can't find any tutorial or docs on secondary indexes. Here ( http://lists.basho.com/pipermail/riak-users_lists.basho.com/2011-October/005952.html) it was stated that the docs would be updated but I can't find it. I just wanted a doc which explains how to use seconda

Re: secondary indexes for timestamp

2012-03-01 Thread Norman Khine
OK, i got it, i did not enable in the conf file the backend ☺ curl http://localhost:8098/buckets/mybucket/index/field1_bin/val1 {"keys":["mykey1"]}% ☺ curl http://localhost:8098/buckets/mybucket/index/field2_int/1001 {"keys":["mykey1"]}%

Re: secondary indexes for timestamp

2012-03-01 Thread Norman Khine
Hi Ryan, Thanks for the reply. I will need to go an learn more before i take up any more of your time. On Thu, Mar 1, 2012 at 1:44 PM, Ryan Zezeski wrote: > Hi Norman, > > I see a couple of things potentially confusing you here.  The first thing to > understand is that Riak currently provides tw

Re: secondary indexes for timestamp

2012-03-01 Thread Ryan Zezeski
Hi Norman, I see a couple of things potentially confusing you here. The first thing to understand is that Riak currently provides two methods for indexing/querying your data: Search and secondary indices (2i). They are not the same and are not compatible with each other. I'm going to assume you

secondary indexes for timestamp

2012-03-01 Thread Norman Khine
Hello again, I am trying to figure out how to return my search results from this code, i am using the riak-js client: var time = +new Date(); var origin; db.enableIndex('users');

Re: Secondary Indexes with ProtoBuff

2012-01-19 Thread Gal Barnea
Hi Russel Thanks for the quick response and detailed explanation I am using 1.0.2, so I will give it a try soon Thanks Gal On Thu, Jan 19, 2012 at 6:01 PM, Russell Brown wrote: > Hi Gal, > Which version of the client are you using? > > On 19 Jan 2012, at 08:19, Gal Barnea wrote: > > > Hi > > Is

Re: Secondary Indexes with ProtoBuff

2012-01-19 Thread Russell Brown
Hi Gal, Which version of the client are you using? On 19 Jan 2012, at 08:19, Gal Barnea wrote: > Hi > Is there a way to insert 2i fields using the PB Java client? Yes, if you're using the current 1.0.x version. The way to do it is to add the indexes to the object you're storing. So if you're st

Secondary Indexes with ProtoBuff

2012-01-19 Thread Gal Barnea
Hi Is there a way to insert 2i fields using the PB Java client? It seems that this is not possible, so I'm wondering what kind of workarounds exists Is this something that can be done in a Post-Commit hook? if so, will inserts still be faster than the HTTP interface? Thanks Gal __

Re: Secondary Indexes - using auto-generated $key index

2012-01-14 Thread Gal Barnea
2012 at 12:52 PM, Gal Barnea wrote: >> >> Hi all >> I've been doing some work with Secondary Indexes and noticed this on >> the web site: >> "The $key index field is a special field that is implicitly indexed on >> all objects when Secondary Indexes is

Re: Secondary Indexes - using auto-generated $key index

2012-01-14 Thread Alin Popa
Hi Gal, Here is one of the examples that I've found useful in the past for exactly this purpose: http://comments.gmane.org/gmane.comp.db.riak.user/5995 HTH, Alin On Sat, Jan 14, 2012 at 12:52 PM, Gal Barnea wrote: > Hi all > I've been doing some work with Secondary Indexes and

Secondary Indexes - using auto-generated $key index

2012-01-14 Thread Gal Barnea
Hi all I've been doing some work with Secondary Indexes and noticed this on the web site: "The $key index field is a special field that is implicitly indexed on all objects when Secondary Indexes is enabled. The value of this field is the object's key, so this field allows an

Re: Inequality support in Riak Secondary indexes

2012-01-11 Thread Sreejith K
anging from 0 to 27. > > Yes, currently 2i only works with LevelDB. Theoretically other backends > can support it, but the feature has not been implemented on them yet. > > On Wed, Jan 11, 2012 at 12:37 PM, Sreejith K wrote: > >> Hi everyone, >> >> Its was a grea

Re: Inequality support in Riak Secondary indexes

2012-01-11 Thread Sean Cribbs
eoretically other backends can support it, but the feature has not been implemented on them yet. On Wed, Jan 11, 2012 at 12:37 PM, Sreejith K wrote: > Hi everyone, > > Its was a great news to know about Riak's support for secondary indexes. > That was a great work indeed! > > A

Inequality support in Riak Secondary indexes

2012-01-11 Thread Sreejith K
Hi everyone, Its was a great news to know about Riak's support for secondary indexes. That was a great work indeed! AFAIK, one will be able to index equality queries (property:value) and range queries (property:[red TO rum]) as described in Riak website. But I have some queries with inequ

Re: Attempting to use secondary indexes

2012-01-09 Thread Daniel Rathbone
e months would we be better advised to use riak search? It seems >> as though it's functionality is a superset of secondary indexing, though >> more painful to implement. >> >> --Craig >> >> >> >> On Wed, Aug 3, 2011 at 9:48 PM, Jeremiah Peschka &

Re: Attempting to use secondary indexes

2012-01-09 Thread Russell Brown
believe 1.0 is scheduled for November. > > --- > Jeremiah Peschka > Founder, Brent Ozar PLF, LLC > > On Aug 3, 2011, at 9:47 PM, Antonio Rohman Fernandez wrote: > > > Another question... the old problem of querying smaller buckets with > > MapReduce is resolved with

Re: Attempting to use secondary indexes

2012-01-09 Thread Daniel Rathbone
;> On Aug 3, 2011, at 9:47 PM, Antonio Rohman Fernandez wrote: >> >> > Another question... the old problem of querying smaller buckets with >> MapReduce is resolved with secondary indexes? >> > following this pattern => curl >> http://127.0.0.1:8098/buckets/lo

Re: Secondary Indexes - Feedback?

2011-12-01 Thread Mike Oxford
I's document-based partitioning makes single-term queries more > expensive (coverage set) but should allow AND queries to scale. But 2i only > supports single-term queries! > > -- > Greg > Clipboard > > On Monday, November 21, 2011 at 10:18 PM, Fyodor Yarochkin wrote: &

Re: Secondary Indexes - Feedback?

2011-12-01 Thread Elias Levy
On Thu, Dec 1, 2011 at 10:50 AM, Greg Pascale wrote: > I think your logic is flawed. Each node has fewer *keys to return*, but > that doesn't mean it has that much less work. Whether you're returning 1 > key or 100, you still have to go to disk to read from the index, and I have > to imagine that

Re: Secondary Indexes - Feedback?

2011-12-01 Thread Greg Pascale
> That's a concern, but you gain parallelism, compared to Search's single term > index. > > > > While they are more expensive in the sense that they require more nodes to > participate, they split the load between the nodes, thus overall, the work > should be about the same, and unless the n

Re: Secondary Indexes - Feedback?

2011-11-30 Thread Elias Levy
On Wed, Nov 30, 2011 at 1:32 PM, wrote: > Here at Clipboard, we make very heavy use of Riak Search and a couple of > manual indices here and there. I've wanted to use 2i a few times but have > decided against it for a few reasons: > > 1) Apprehension about the coverage set query, as Matt articula

Re: Secondary Indexes - Feedback?

2011-11-30 Thread Greg Pascale
On Monday, November 21, 2011 at 10:18 PM, Fyodor Yarochkin wrote: > > Have you tried Secondary Indexes? > > Does the feature help solve your problems? If not, why not? Any concerns? > > What is your wish list for the future of Secondary Indexes? > > yup. I think secondary indexes

Re: Secondary Indexes - Feedback?

2011-11-21 Thread Fyodor Yarochkin
> Have you tried Secondary Indexes? > Does the feature help solve your problems? If not, why not? Any concerns? > What is your wish list for the future of Secondary Indexes? > yup. I think secondary indexes is probably one of the most-wanted options for this release. It does impact

Re: Secondary Indexes - Feedback?

2011-11-21 Thread Matt Ranney
The 2i features are certainly more convenient than building secondary indexes manually, which is the only alternative until now. I'm a little concerned about the performance of the coverage queries as our cluster grows. Building a secondary index manually does scale very nicely as new node

Re: Distributed reduce phases via pre-reduce [Was "Secondary Indexes - Feedback?"]

2011-11-18 Thread Gordon Tillman
Bryan thanks very much for the info. I am going to investigate this over the weekend. What I am trying to achieve is the ability to sort a potentially very large dataset in the most efficient way possible. Regards, --g On Nov 18, 2011, at 10:12 , Bryan Fink wrote: > On Thu, Nov 17, 2011 a

Distributed reduce phases via pre-reduce [Was "Secondary Indexes - Feedback?"]

2011-11-18 Thread Bryan Fink
On Thu, Nov 17, 2011 at 9:45 AM, Gordon Tillman wrote: > I'm really interested in being able to implement distributed > reduce phases (specifically to do a partial sort)  and then have that output > handle by a final reduce phase that could perform an efficient merge sort >  and stream results bac

Re: Secondary Indexes - Feedback?

2011-11-17 Thread Jim Adler
haus Date: Wed, 16 Nov 2011 12:57:48 -0500 To: "riak-users@lists.basho.com" Subject: Secondary Indexes - Feedback? Hello Riak Users, The Basho team recently released Riak 1.0 which introduced a new feature called Secondary Indexes. This feature allows you to tag Riak objects with addi

Fwd: Secondary Indexes - Feedback?

2011-11-17 Thread Gordon Tillman
I forgot to CC the mailing list with this response. --g From: Gordon Tillman Subject: Re: Secondary Indexes - Feedback? Date: November 16, 2011 14:55:00 CST To: Rusty Klophaus On Nov 16, 2011, at 13:53 , Rusty Klophaus wrote: > Hi Gordon, > > Thanks for your feedback! Some

Re: Secondary Indexes - Feedback?

2011-11-16 Thread Elias Levy
On Wed, Nov 16, 2011 at 12:20 PM, wrote: > From: Paul Gross > > Alternatively, riak could be more generic and take a function that would > run in riak and update the documents without having to return them all > to the client. > You should already be able to do this, but it requires writting a m

Re: Secondary Indexes - Feedback?

2011-11-16 Thread Nate Lawson
On Nov 16, 2011, at 11:41 AM, Rusty Klophaus wrote: >> 2. We need a guaranteed order of inputs from a 2I query. If we select on a >> range, each key we get on a given node in the M-R job should be ordered >> according to the 2I values. Of course we understand that keys won't be >> ordered acros

Re: Secondary Indexes - Feedback?

2011-11-16 Thread Paul Gross
. But as far as riak storage is concerned there is no real difference between meta data and "value". Couldn't riak add a feature where I can pass a javascript function to riak? This function knows how I store my data, so it can parse the value in place, add new secondary indexes, and s

Re: Secondary Indexes - Feedback?

2011-11-16 Thread Alexander Sicular
s no real difference between meta data and "value". Well either way, for the record, I like you idea, Paul, and second it. -Alexander Sicular @siculars http://siculars.posterous.com On Nov 16, 2011, at 3:12 PM, Paul Gross wrote: > >>- What is your wish list for the futur

Re: Secondary Indexes - Feedback?

2011-11-16 Thread Paul Gross
- What is your wish list for the future of Secondary Indexes? One thing that I would like to see is the ability to add secondary indexes after the fact to existing objects. The use case I'm thinking of is: 1. I have a bucket of users, where the key is generated and the value is a

Re: Secondary Indexes - Feedback?

2011-11-16 Thread Rusty Klophaus
r). > > So that would get fed to map-reduce where additional processing (think > filtering, sorting, pagination) is done. > > I can do the same thing with secondary indexes but would have to move some > of that into map. > > So in this case I would use secondary indexes to

Re: Secondary Indexes - Feedback?

2011-11-16 Thread Rusty Klophaus
Hi Nate, Thank you for your feedback, this is good stuff. Some follow up questions inline below: > 2. We need a guaranteed order of inputs from a 2I query. If we select on a > range, each key we get on a given node in the M-R job should be ordered > according to the 2I values. Of course we under

Re: Secondary Indexes - Feedback?

2011-11-16 Thread Gordon Tillman
On Nov 16, 2011, at 11:57 , Rusty Klophaus wrote: > Now that you've had a few weeks to investigate and experiment with > Secondary Indexes, I'm hoping to hear about your experiences to help > us focus future development efforts most effectively: > Have you tried Seconda

Re: Secondary Indexes - Feedback?

2011-11-16 Thread Nate Lawson
On Nov 16, 2011, at 9:57 AM, Rusty Klophaus wrote: > Now that you've had a few weeks to investigate and experiment with > Secondary Indexes, I'm hoping to hear about your experiences to help > us focus future development efforts most effectively: > • Have you t

Secondary Indexes - Feedback?

2011-11-16 Thread Rusty Klophaus
Hello Riak Users, The Basho team recently released Riak 1.0 which introduced a new feature called Secondary Indexes. This feature allows you to tag Riak objects with additional metadata, and then later query the indexed metadata to retrieve the objects. (See http://wiki.basho.com/Secondary

Re: Riak 1.x with Secondary Indexes

2011-10-29 Thread Sean Cribbs
uce phase of riak_kv_mapreduce:reduce_identity if you want the equivalent > of the http query. This is what the Erlang client does. > > Ew. That's not very friendly. > > Why did you not just extend the protocol buffer to have another set of > fields for the (optional) secondary indexes...? > >

Re: Riak 1.x with Secondary Indexes

2011-10-29 Thread Jeremiah Peschka
e:t if you want the equivalent of the http >> query. This is what the Erlang client does. > > Ew. That's not very friendly. > > Why did you not just extend the protocol buffer to have another set of > fields for the (optional) secondary indexes...? >

  1   2   >