Re: 2i query, weird null results, java pbclient

2011-10-26 Thread Russell Brown
On 25 Oct 2011, at 20:31, Alexander Robbins wrote: > Those methods both work with the RawClient and give good results. Thanks for > the help! It was a bug (you're original issue.) Thanks for the find, sorry for the inconvenience. The problem was an incorrect encoding of the reduce phase argum

Re: question about a new node join

2011-10-28 Thread Russell Brown
On 28 Oct 2011, at 12:55, chuang wrote: > I read the source in riak-0.4.12. > > When a new node join the cluster,it sends reconcile_ring message in > riak_core_gossip,then in riak_core_claim.erl reconcile the ring in the > cluster. > In all the join-cluster process,the core function is > riak

Re: Importing data to Riak

2011-11-14 Thread Russell Brown
On 14 Nov 2011, at 11:47, Nitish Sharma wrote: > Hi, > This is more sort of a discussion than a question. I am just trying to see > the trend in how users import their data to Riak. > For the data I am using, I was able to achieve almost 150 records/second with > PHP library, and 400 records/s

Re: riak java client

2011-11-16 Thread Russell Brown
And too the list this time :$ Hi Sergey, On 16 Nov 2011, at 10:48, sergey wrote: > Hi! > How to set content type for store operation for java-pcb client? > b.store("key", "{"field":"value"}") - set content as text/plain, how set > content type as application/json? That is just a conveni

Re: riak java client

2011-11-16 Thread Russell Brown
On 16 Nov 2011, at 16:13, sergey wrote: > Thanks Russell, > ok, > I useDefaultRiakClient ( userName = "user1", userInfo = > "{"email":"em...@email.com","pass":"123123"}" ): > riakObject = RiakObjectBuilder.newBuilder("users", > userName).withContentType("application/json").withValue(userInfo).b

Re: Listen to Put Event in Riak

2011-11-16 Thread Russell Brown
On 17 Nov 2011, at 02:59, Eric Fong wrote: > Hi > > I have Riak servers A, B and C. > As I know, assume I put my data into Riak server A via HTTP interface, > I will hashed and determined to be stored in some other servers. May be > finally stored into B and C. > > What I want is listen to t

Re: riak java client

2011-11-17 Thread Russell Brown
On 17 Nov 2011, at 10:20, sergey wrote: > Thanks Russell! > I use raw client: > > rawClient = new RiakClient("127.0.0.1") > pbcClient = new PBClientAdapter(rawClient) > riakObject = RiakObjectBuilder.newBuilder("users", > userName).withContentType("application/json").withValue(userInfo).build >

Re: riak java client

2011-11-17 Thread Russell Brown
On 17 Nov 2011, at 16:03, sergey wrote: > Ok, > If I do curl -X PUT -H "Content-Type: application/json;charset=utf-8", Riak > index for search and search work right. > I use Riak 1.0.1-1 (riak_1.0.1-1_amd64.deb on Ubuntu). > I use utf-8 java string. Yes. We have a bug. Sorry. https://issues.bas

Re: key filters

2011-11-23 Thread Russell Brown
On 23 Nov 2011, at 08:04, Ben Aviram wrote: > Hi all, > > We’re working on analytics system based on Riak(1.0.2). > > I’m storing my data in this structure: > Key = “userid_date” > Value = daily report values > > So if I want for example to query last year’s data I’m using key-filter like

RJC 1.0.2 released

2011-11-25 Thread Russell Brown
Hi, I just pushed the release button for riak-java-client 1.0.2. It is on oss.sonatype and will find its way to maven when they sync. It is just a small bug fix release. Bugs fixed are: Incoming post commit hooks added to the pre-commit list (thanks to Bob Baker from Sharecare for that fix!)[1

Re: Clarifying "Read-before-Write"

2011-11-26 Thread Russell Brown
On 26 Nov 2011, at 01:14, Andres Jaan Tack wrote: > So I was just reading and thinking about this, and I don't understand the > advice offered under "Read-before-Write" at > http://wiki.basho.com/Client-Implementation-Guide.html. > > "Riak will return an encoded vector clock with every "fetch"

Re: Multiple keys to fetch in a Java client

2011-11-28 Thread Russell Brown
On 28 Nov 2011, at 20:16, suresh chandran wrote: > May be I can make my statement clear :) I store my devices values in buckets > named after OS (say windows/ linux) with the device id's as keys. I want to > get the devices for a list of device ids . From what I see, the fetch API > signatur

Re: Multiple keys to fetch in a Java client

2011-11-29 Thread Russell Brown
ome more detailed documentation and tutorials (ha, actually, _no_, I wouldn't, but I really *should*!) Hopefully that helps, and if you get me that stack trace I'll try and figure out what is going on with the map/reduce error. Cheers Russell > > Suresh C Nair > > F

Re: Multiple keys to fetch in a Java client

2011-11-29 Thread Russell Brown
][11/29/11 9:42 AM] [akka:event-driven:dispatcher:global-9] > [GetMaster] Error getting data in TEST // ** TEST is the bucket name > that I use.*** > at com.basho.riak.client.query.MapReduce.execute(MapReduce.java:81) > at com.persistence.RiakConnector.fetchAll(RiakConnector.java:125)// *

Re: Multiple keys to fetch in a Java client

2011-11-29 Thread Russell Brown
Re-sending to list, since I sent to just Suresh in error. Hi Suresh, Thanks for the further information. So you don't add a map or reduce phase. It is a bug[1] that the client allows you to execute that job since it is not valid. Thanks for finding it. So 1st I need to fix that. I'll also loo

Re: Last modified date

2011-12-02 Thread Russell Brown
On 1 Dec 2011, at 19:25, Sajithkumar Kizhakkiniyil wrote: > Hello > I have couple of question regarding the last modified information fetching > form Riak PB client > 1. The last modified is split into to two parts lastModified and > lastModifiedUsec. How to combine these to make atypical

Re: Last modified date

2011-12-02 Thread Russell Brown
Ooops, sorry, forgot to add that ticket number for you: https://issues.basho.com/show_bug.cgi?id=1299 On 2 Dec 2011, at 10:23, Russell Brown wrote: > > On 1 Dec 2011, at 19:25, Sajithkumar Kizhakkiniyil wrote: > >> Hello >> I have couple of question regarding the last

Re: How to specify write consistency level in riak java client 0.14 version

2011-12-05 Thread Russell Brown
Hi Vijayakumar, Firstly, sorry for the slow response, this one slipped past. On 17 Nov 2011, at 13:23, vijayakumar wrote: > Hi, > I am using riak java client 0.14 version to insert records, but I am not > able to locate any method or options to specify write consistency level. > Store method

Riak Java Client

2011-12-05 Thread Russell Brown
Hi, For Java developers who don't use maven, I've added a download[1] to the RJC's GitHub repo. This is a build of the RJC with all dependencies in the jars `lib/` directory. It has been pointed out that the RJC is very maven focussed, hopefully this will help redress that balance somewhat. The

Re: Riak-java-client through a HTTP proxy

2011-12-16 Thread Russell Brown
Hi, On 16 Dec 2011, at 08:58, Olivier Rossel wrote: > [I hope I am posting on the correct list.] > > I am using riak-java-client behind a http proxy. > I have set the properties like this: > System.setProperty("http.proxyHost", "webcache.mydomain.com"); > System.setPropery("http.proxyPort", "8080

Re: Riak-java-client through a HTTP proxy

2011-12-16 Thread Russell Brown
On 16 Dec 2011, at 09:13, Russell Brown wrote: > Hi, > On 16 Dec 2011, at 08:58, Olivier Rossel wrote: > >> … >> >> Is there a special way to declare proxies in riak-java-client ? > Yes. Can you let me know which version of the RJC you are using, please? OK, f

Re: Does the name in vm.args need to be the same at all times?

2011-12-27 Thread Russell Brown
On 27 Dec 2011, at 16:03, Jeffrey Eliasen wrote: > Does the name in vm.args provided for a node in the cluster matter from one > run of the service to the next? It does matter, it is stored in the ring. > In other words, could I: > name the node 'x' in vm.args > start the service > stop the se

Re: Map Reduce behavior when key not found

2012-01-08 Thread Russell Brown
On 8 Jan 2012, at 11:03, Yehuda Zargrov wrote: > Hi, > > I’m adding a range of keys to a MapReduce object, knowing that some of them > do not exist. > When running map & reduce functions, I’ve noticed a strange behavior like > adding ‘not_found’ records to the input of the reduce. Is there a

Re: Attempting to use secondary indexes

2012-01-09 Thread Russell Brown
Hi Daniel, On 9 Jan 2012, at 08:22, Daniel Rathbone wrote: > I'm trying out 2i, and I'm having a little trouble similar to this old > thread. I don't see any keys returned when I try and query a secondary index. > > My storage_backend is set to riak_kv_eleveldb_backend. I seem to have added

Re: Keep Crashing

2012-01-12 Thread Russell Brown
Hi, This line in your log suggests that your hitting the limit for open file handles. > 2012-01-13 02:33:18.706 [error] <0.1953.0>@riak_kv_vnode:init:245 Failed to > start riak_kv_bitcask_backend Reason: {{badmatch,{error,emfile}} This knowledge base article [1] and this wiki page [2] should

Re: Secondary Indexes with ProtoBuff

2012-01-19 Thread Russell Brown
Hi Gal, Which version of the client are you using? On 19 Jan 2012, at 08:19, Gal Barnea wrote: > Hi > Is there a way to insert 2i fields using the PB Java client? Yes, if you're using the current 1.0.x version. The way to do it is to add the indexes to the object you're storing. So if you're st

Re: efficient fetching of values falling in a key range

2012-01-30 Thread Russell Brown
On 30 Jan 2012, at 18:12, Dietrich Featherston wrote: > I'm using a leveldb-backed riak 1.0.2 and looking for some suggestions to > fetch a block of data by key range. I have control over the keys and all > reads out of this setup will involve at minimum a key range. It seems that if > leveldb

Re: efficient fetching of values falling in a key range

2012-01-30 Thread Russell Brown
; No, no there isn't. [1] https://github.com/basho/riak-java-client/commit/8398f902c3db285b4217ad267800dc93f9ec96c7 > > On Mon, Jan 30, 2012 at 11:54 AM, Russell Brown wrote: > Hi Dietrich, > I'm actually doing it now. If you had a look at it you'll see it is a bit of

Re: Announcing Riak 1.1 release candidate 2

2012-02-10 Thread Russell Brown
On 10 Feb 2012, at 03:04, Jeremiah Peschka wrote: > Are there any protocol changes for client developers to be aware of, or are > we safe? Not strictly a protocol change, but It is possible to run a MapReduce job *without* phases now. If your client previously disallowed this it should change

Open source projects using the Riak Java Client?

2012-02-21 Thread Russell Brown
Hi, Are you using the Riak Java Client in an an Opensource project Or do you know of such a project? If so, please let me know. Cheers Russell ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lis

Re: IndexQuery

2012-02-22 Thread Russell Brown
Hi Rajat, Answers inline below. On 22 Feb 2012, at 16:44, Rajat Mathur wrote: > I am running following IndexQuery : > > > IntIndex intIndex=IntIndex.named("points"); > > IndexQuery iQuery = new IntRangeQuery(intIndex,"fkUsers",1100,1300); > > MapReduceResult > resultIn

Re: Faster way to store a lot of small data?

2012-02-23 Thread Russell Brown
Hi Eric, On 23 Feb 2012, at 08:45, Eric Fong wrote: > Hi > > Help. I want to store few thousands of small png (each of them will just be > 10K) into riak. > But I find that is really slow (1 to 2 second for one png). > > Currently, I use a bash script to find and loop the directory > And curl

Re: Faster way to store a lot of small data?

2012-02-23 Thread Russell Brown
t something to check the times that Eric mentioned, please don't think it is like a working script or anything. Cheers Russell > --- > Jeremiah Peschka > Managing Director, Brent Ozar PLF, LLC > > > On Thu, Feb 23, 2012 at 2:02 AM, Russell Brown wrote: > Hi Eric, >

resolving siblings

2012-02-27 Thread Russell Brown
Hi, I'm preparing a talk on conflict/sibling resolution, and I was hoping to gather some real world examples. Most people know the shopping cart example from the dynamo paper, but not *all* Riak apps are shopping carts. If you can provide any information about how you resolve siblings, and what

Re: Error: HTTP error 500: Error:

2012-03-01 Thread Russell Brown
On 1 Mar 2012, at 07:52, Norman Khine wrote: > I hade created a bucket 'users', which i then deleted through the > 'recon' interface (well i deleted all the keys within that bucket), > but now every time i try to push a new key, i get this error: > > { [Error: HTTP error 500: Error: > {precommit

Re: Slow performance on getting via 2i

2012-03-13 Thread Russell Brown
Hi Daniel, Sorry for the slow reply. On 12 Mar 2012, at 11:36, ivenhov wrote: > Excuse my doubel-posting and replying to my own thread. > I found this in PBClientAdapter class in fetchIndex method > >final MapReduce mr = new IndexMapReduce(this, indexQuery); > >mr.addReducePhase

Re: conditional gets from java client?

2012-03-14 Thread Russell Brown
Hi Sam, Sorry for the slow reply, this sort of flew past me and I only just caught up now. On 14 Mar 2012, at 02:44, Sam Perman wrote: > Hello > > I'm just starting my exploration of riak and was wondering if it is possible > to use the java client to issue a conditional get based on etag ( >

Re: riak-python-client2, a rewrite of the official client

2012-03-15 Thread Russell Brown
Hi Shuhao, On 15 Mar 2012, at 00:30, Shuhao Wu wrote: > That would be most appreciated. > > I just completed a very bare minimum higher level API that's similar to the > current Python client. However, there's still a lot of work to be done. Once > again, I'm just one lone student working in

Re: Slow performance on getting via 2i

2012-03-19 Thread Russell Brown
On 19 Mar 2012, at 10:34, ivenhov wrote: > Hi Russell > > Thanks for reply. > I tried to use your example but I could not find class BinIndexQuery in riak > client (I'm using 1.0.4, is there any newer version?) No, you are correct, I replied from memory rather than checking the API first, sorry

Re: Storing JS functions in bucket/keys

2012-03-26 Thread Russell Brown
Hi Jonathan, On 26 Mar 2012, at 21:53, Jonathan Langevin wrote: > It was mentioned in an old webinar recap, that custom JS functions could be > stored in Riak as a objects in a bucket, and then executed via mapreduce. > While this was mentioned as possible, no example was provided, and Google is

Re: Using PBClusterConfig with RiakClient

2012-04-11 Thread Russell Brown
Hi Ahmed, On 11 Apr 2012, at 19:45, Ahmed Bashir wrote: > Thanks for the link; this is precisely what led me to believe that > PBClusterConfig only supports IRiakClient, so I thought I'd ask around PBClusterConfig is used to produce a RawClient. IRiakClient is just a wrapper around RawClient. T

Re: Using PBClusterConfig with RiakClient

2012-04-11 Thread Russell Brown
layers that you can use, one building on the other. Please feel free to ask away if I can clear it up any more, Cheers Russell > On Wed, Apr 11, 2012 at 12:09 PM, Russell Brown wrote: >> Hi Ahmed, >> >> On 11 Apr 2012, at 19:45, Ahmed Bashir wrote: >> >>

Re: Using PBClusterConfig with RiakClient

2012-04-11 Thread Russell Brown
011/07/14/The-All-New-Riak-Java-Client/ ) with some history. Cheers Russell > > On Wed, Apr 11, 2012 at 1:39 PM, Russell Brown wrote: >> >> On 11 Apr 2012, at 21:20, Ahmed Bashir wrote: >> >>> Thanks Russell! >>> >>> Any benefit to using

Re: Can I share Riak KV between Riak S2 and direct Riak KV access?

2015-09-14 Thread Russell Brown
On 14 Sep 2015, at 05:26, mtakahashi-ivi wrote: > Thanks all, > > The problem is not only namespace but also competing system resources, > right? > Does it mean competing system resources occurs even if I separate > namespaces? Yes. > > > > > -- > View this message in context: > http://r

Re: Default values vs non-existing keys for CRDTs

2015-09-19 Thread Russell Brown
> On 20 Aug 2015, at 18:54, Timur Fayruzov wrote: > > Forgot to include the list in the initial response. > > On Thu, Aug 20, 2015 at 12:31 AM, Russell Brown wrote: > It’s a tricky one Timur. CRDTs are based on Join Semi-Lattices, and they have > the concept of a botto

Re: Problem with Vector Clocks - inconsistencies encountered in cluster with shifted real local clocks

2015-10-01 Thread Russell Brown
I need more time to examine the diagram, but this all looks as expected so far. If a client sends no context then it’s write will be a sibling of whatever is stored at the coordinator, as you rightly point out riak treats an incoming clock that is less than a local clock as a sibling. If the coo

Re: Problem with Vector Clocks - inconsistencies encountered in cluster with shifted real local clocks

2015-10-01 Thread Russell Brown
ed? > > Thanks, > Zuzana > > On 1 October 2015 at 14:18, Russell Brown wrote: > I need more time to examine the diagram, but this all looks as expected so > far. > > If a client sends no context then it’s write will be a sibling of whatever is > stored at the coor

Re: Problem with Vector Clocks - inconsistencies encountered in cluster with shifted real local clocks

2015-10-01 Thread Russell Brown
.edu/~mph/HerlihyW90/p463-herlihy.pdf) > > or in other words if a user sends read request, the value obtained should be > at least that of the last write acknowledged to any other user (or later > write request) before the read request was sent to database. > > > > On 1 Oct

Re: riak 2.1.1 : Erlang crash dump

2015-10-04 Thread Russell Brown
I doubt it is sibling explosion as 2.1.1 has DVV by default, and the config has 100 max siblings declared. But it may be, I guess. Can you send me crash logs, or even the crash dump so I can get a better idea? I mean, it surely looks like a memory leak of some kind. Do you use the “write once”

Re: Sudden frequent node crashes

2015-10-08 Thread Russell Brown
Hi Allen, What version of erlang are you running, please? Cheers Russell > On 8 Oct 2015, at 19:58, Allen Landsidel wrote: > > Background: > Riak 2.1.1 > FreeBSD 9.1. > Servers are all virtualized on VMWare ESX 5.5. Each node is given ~300G of > storage, 4G of RAM, and 2 core SMP. > Storage

Re: Sudden frequent node crashes

2015-10-08 Thread Russell Brown
Erlang 17 from ports; erlang-runtime17-17.5.6.3 > > > > On 10/8/2015 15:28, Russell Brown wrote: >> Hi Allen, >> What version of erlang are you running, please? >> >> Cheers >> >> Russell >> >>> On 8 Oct 2015, at 19:58, Allen Landsid

Re: Sudden frequent node crashes

2015-10-08 Thread Russell Brown
also new and is the custom erlang from basho. > > I'll give the new port a see if that takes care of things. Should have > looked to see if there was an 'official' port before posting. :) > > We don't store any mission critical data in it (yet) so just cl

Re: counter crdt in riak

2015-10-20 Thread Russell Brown
On 21 Oct 2015, at 04:56, David Byron wrote: > Apologies if this is basic question, or one that's already been answered. > I've done a fair amount of digging (e.g. > http://thread.gmane.org/gmane.comp.db.riak.user/12808/focus=12816), but I'm > still confused about the documentation regarding

Re: Using Bucket Data Types slowed insert performance

2015-10-21 Thread Russell Brown
Honestly, right now we need to work on optimising the Map. We do have a smaller/faster map in a branch that we’re working on shipping soon, as well as other optimisation planned. Does your use case have you adding and removing registers, or is this basically a set schema of registers per key? I

Re: Counters and secondary index

2015-11-04 Thread Russell Brown
On 27 Oct 2015, at 13:02, Łukasz Biedrycki wrote: > Hey, > > I need a secondary index with my counter, but I found an information that > ​"​Counters have no support for Secondary Indexes (2i), Links or Custom HTTP > Metadata​" (http://docs.basho.com/riak/latest/dev/references/http/counters/).

Open source users of Riak DT?

2015-11-04 Thread Russell Brown
Hi, I know that Project FiFo[1] does (or did?) use Riak DT[2]. I was wondering if there are any other open source applications/products out there that use Riak DT? Many thanks in advance Russell [1] Project FiFo - https://project-fifo.net [2] Riak DT - https://github.com/basho/riak_dt

Re: Connection multiplexing in the Erlang client

2015-12-31 Thread Russell Brown
Hi Paulo, Riak-erlang-client does not support multiplexing. In fact I believe there would be some work needed on the riak protocol buffers server code to support multiplexing. Riak-erlang-clinet does not use a pool (like poolboy) either. Cheers Russell On 31 Dec 2015, at 01:59, Bryan Hunt wr

Re: Connection multiplexing in the Erlang client

2015-12-31 Thread Russell Brown
Hi Paulo, You’ll need more than client work. If you’re interested in exploring the server side code riak_api (https://github.com/basho/riak_api) is probably where you want to look. I’m happy to help/advise on this if you want to get stuck in :D Cheers Russell On 31 Dec 2015, at 08:47, Paulo A

Re: CRDT appending

2016-01-13 Thread Russell Brown
If you just send the add operation the client doesn’t need to fetch the value first, no. But riak, inside the vnode, will still do a local read at the coordinating vnode. On 13 Jan 2016, at 12:54, Eugene Shubin wrote: > With CRDT it's not possible to append a value to map or set without fetchi

Re: Reliability quastion

2016-01-14 Thread Russell Brown
On 14 Jan 2016, at 07:05, j.halif...@seznam.cz wrote: > Hi All, > > > > I am a member of the community for about a year to understand reliability of > Riak. > > What I can see here is that there are some problems which could prevent using > > it in a project which require high reliability.

Re: Reliability quastion

2016-01-14 Thread Russell Brown
2016, at 08:30, Joshua Muzaaya wrote: > I suggest u test out CouchBase or Cloudant or CouchDB as well. Riak can be > problematic when things go wrong. > > On Thu, Jan 14, 2016 at 4:07 PM, Russell Brown wrote: > > > On 14 Jan 2016, at 07:05, j.halif...@seznam.c

Re: Reliability questions

2016-01-14 Thread Russell Brown
The paid version has multi-datacenter replication, so yes, more reliable in that you can lose a datacenter and stay available. The OS riak is in no-way crippled on unreliable, it just doesn’t have MDC replication. Another huge benefit of paying is access to our support team, who are frankly ama

Re: Get all keys from an bucket

2016-01-25 Thread Russell Brown
Hi Markus, Are you using leveldb backend? Russell On 22 Jan 2016, at 19:05, Markus Geck wrote: > Hello, > > is there any way to get all keys from an bucket? > > I've already tried this guide: > http://www.paperplanes.de/2011/12/13/list-all-of-the-riak-keys.html But riak > always wents unres

Re: Re[2]: Get all keys from an bucket

2016-01-29 Thread Russell Brown
mention that. > > > Monday, January 25, 2016 10:10 AM UTC from Russell Brown > : > > Hi Markus, > Are you using leveldb backend? > > Russell > > On 22 Jan 2016, at 19:05, Markus Geck wrote: > > > Hello, > > > > is there any way to get a

Re: Java Client - Maps - fetch only one entry

2016-02-25 Thread Russell Brown
Not yet. I think that would be cool too. Right now, a map is just a riak object. I guess with Riak Search indexing though, you could get something similar, maybe? On 25 Feb 2016, at 19:40, Cosmin Marginean wrote: > On 25 Feb 2016, at 19:26, Cosmin Marginean wrote: > > Hi, > > I couldn’t fi

Re: Get all keys from an bucket

2016-02-29 Thread Russell Brown
> > > Friday, January 29, 2016 2:06 PM UTC from Russell Brown > : > > With leveldb you can use the special $bucket index. You can also stream the > keys, and paginate them, meaning you can get them in smaller lumps, hopefully > this will appear faster and avoid the

Re: Continuous HTTP POSTs to Riak

2016-03-05 Thread Russell Brown
On 5 Mar 2016, at 18:43, Qiang Cao wrote: > Just curious. The POSTs are sent out sequentially and a quorum is set up on > Riak. I wonder how would it happen that Riak still considers the POST > requests concurrent? Did you read the result of POST 1 before sending POST 2? If not, and you don’t

Re: Continuous HTTP POSTs to Riak

2016-03-05 Thread Russell Brown
stion? On 5 Mar 2016, at 19:04, Qiang Cao wrote: > Thanks, Russell! I do a GET immediately after a POST is done. I use apache > httpclient, which handles requests synchronously. On the client, POSTs and > GETs are sent out sequentially. > > On Sat, Mar 5, 2016 at 1:57 PM,

Re: 2i indexes and keys request inconsistencies

2016-03-09 Thread Russell Brown
I wonder if you have some keys that are hanging around on one of the N partitions but are deleted elsewhere (and the tombstones reaped?). 2i uses coverage which is essentially r=1 on a covering set of vnodes. But you think read-repair/AAE would bring convergence, so it is perplexing. I wonder if

Re: Using $bucket index for listing keys

2016-03-11 Thread Russell Brown
That seems very wrong. Can you do me a favour and try with a larger max_results. I remember a bug with small results set, I thought it was fixed, I’m looking into the past issues, but can you try “max_results=1000” or something, and let me know what you see? On 11 Mar 2016, at 13:03, Oleksiy Kr

Re: Using $bucket index for listing keys

2016-03-11 Thread Russell Brown
7;ll try to > replicate this with a bigger bucket. > On Fri, Mar 11, 2016 at 15:21 Russell Brown wrote: > That seems very wrong. Can you do me a favour and try with a larger > max_results. I remember a bug with small results set, I thought it was fixed, > I’m looking into the pa

Re: Using $bucket index for listing keys

2016-03-11 Thread Russell Brown
e keys (once only) of all > buckets. Either with 2i or with Yokozuna. > On Fri, Mar 11, 2016 at 15:32 Russell Brown wrote: > Not the answer, by why pagination for 200 keys? Why the cost of doing the > query 20 times vs once? > > On 11 Mar 2016, at 13:28, Oleksiy Krivoshey wro

Re: Using $bucket index for listing keys

2016-03-11 Thread Russell Brown
no logging > so when I enabled debugging this was the first bucket to replicate the > problem. I have a lot of buckets of the same type, some have many thousands > keys some are small. My task is to iterate the keys (once only) of all > buckets. Either with 2i or with Yokozuna. > On F

Re: Using $bucket index for listing keys

2016-03-11 Thread Russell Brown
thought $bucket index is some kind of special internal index? > > On 11 March 2016 at 18:28, Russell Brown wrote: > You can’t…can you? I mean, 2i requires level. It requires ordered keys. Which > explains your problem, but you should have failed a lot earlier. > > On 11 Mar 2016,

Riak DT refresh

2016-04-28 Thread Russell Brown
Hi, Riak DT[1] is in need of some love. I know that some of you on this list (Sargun, are you here? Heinz?) have expressed opinions on the work that needs doing. Here is my short list, I would love to hear opinions on priority, and any additions to this list: 1. merger smaller map branch 2. del

Re: How to increase Riak write performance for sequential alpha-numeric keys

2016-05-05 Thread Russell Brown
CRDTs are all about mutation, why would you use a CRDT for immutable data? I think write-once is what you need. On 5 May 2016, at 14:14, Sanket Agrawal wrote: > Two questions about write-once bucket: > - is it useful from performance-perspective for immutable CRDTs as well? > - If the objects

Re: How to increase Riak write performance for sequential alpha-numeric keys

2016-05-05 Thread Russell Brown
On 5 May 2016, at 14:42, Sanket Agrawal wrote: > > On Thu, May 5, 2016 at 9:28 AM, Russell Brown wrote: > CRDTs are all about mutation, why would you use a CRDT for immutable data? I > think write-once is what you need. > > No particular reason - most likely ignorance o

Re: How to increase Riak write performance for sequential alpha-numeric keys

2016-05-05 Thread Russell Brown
On 5 May 2016, at 15:11, alexc155 wrote: > Hi, > > Thanks for your reply. > > I don't think that write_once is going to work for us as we have to > periodically update the data (although if we remove the data before > re-inserting it, would that work?) > > Why does read-before-write slow down

Re: Riak DT refresh

2016-05-07 Thread Russell Brown
opy algorithm would allow our system to scale from 1000s of > > keys to 100ks of keys. > > > > Nonetheless, Riak_dt is an awesome library, and we're probably > > planning on contributing back to it soonish, especially if any of the > > other comments on this t

Re: Riak DT refresh

2016-05-17 Thread Russell Brown
actor entries (1000s). > > On Thu, Apr 28, 2016 at 12:55 AM, Russell Brown wrote: >> Hi, >> Riak DT[1] is in need of some love. I know that some of you on this list >> (Sargun, are you here? Heinz?) have expressed opinions on the work that >> needs doing. Here is

Re: Riak DT refresh

2016-05-17 Thread Russell Brown
On 17 May 2016, at 09:19, Benoit Chesneau wrote: > > > On Tue, May 17, 2016 at 10:15 AM Russell Brown wrote: > There’ll still be the need of a version vector, yes. Any advice/contribution > on optimisations there greatly appreciated, thanks. > > maybe moving to SWC?

Re: Put failure: too many siblings

2016-06-16 Thread Russell Brown
What version of riak_kv is behind this riak_cs install, please? Is it really 2.1.3 as stated below? This looks and sounds like sibling explosion, which is fixed in riak 2.0 and above. Are you sure that you are using the DVV enabled setting for riak_cs bucket properties? Can you post your bucket

Re: How to best store arbitrarily large Java objects

2016-07-22 Thread Russell Brown
On 22 Jul 2016, at 09:12, Henning Verbeek wrote: > Alex, > thanks for the very quick response. > > On Thu, Jul 21, 2016 at 5:36 PM, Alex Moore wrote: >>> I'm beginning to think that I'll need to remodel my data and use CRDTs >>> for individual fields such as the `TreeMap`. Would that be a bett

Re: Detecting Hinted Handoff

2016-07-25 Thread Russell Brown
But I still don’t understand _why_? What is the aim, ‘cos I’m not sure it’s possible. For quorum reads on indexes then Sargun’s “roll your own” idea is the better answer at the moment. On 25 Jul 2016, at 11:25, DeadZen wrote: > Hinted handoff from adding a node, removing a node or failing a n

Re: List all keys on a small bucket

2016-12-08 Thread Russell Brown
Depends on what backend you are running, no? If leveldb then this list keys operation can be pretty cheap. It’s a coverage query, but if it’s leveldb at least you will seek to the start of the bucket and iterate over only the keys in that bucket. Cheers Russell On 8 Dec 2016, at 21:19, John D

Re: secondary indexes

2017-01-16 Thread Russell Brown
Hi, Riak's secondary indexes require a sorted backend, either of the memory or leveldb backends will work, bitcask does not support secondary indexes. More details here  http://docs.basho.com/riak/kv/2.2.0/developing/usage/secondary-indexes/ Cheers Russell On Jan 17, 2017, at 07:13 AM, Andy l

Re: secondary indexes

2017-01-17 Thread Russell Brown
or others solr makes more sense. I personally disagree with the statement at the top of http://docs.basho.com/riak/kv/2.2.0/developing/usage/secondary-indexes/ Cheers Russell > > andrew > > From: Russell Brown > Sent: Tuesday, January 17, 2017 3:45:34 PM > To: Andy leu >

Re: Efficient way to fetch all records from a bucket

2017-01-28 Thread Russell Brown
IF you use leveldb, there is a function in the riak-erlang-client that gets all objects in a bucket, I don’t know if it has been implemented in the java client as it was written specifically for riak-cs. https://github.com/basho/riak-erlang-client/blob/develop/src/riakc_pb_socket.erl#L1130 Chee

Re: Efficient way to fetch all records from a bucket

2017-01-28 Thread Russell Brown
tion. > > 2017-01-28 13:33 GMT+03:00 Russell Brown : > IF you use leveldb, there is a function in the riak-erlang-client that gets > all objects in a bucket, I don’t know if it has been implemented in the java > client as it was written specifically for riak-cs. > > https:/

Re: Efficient way to fetch all records from a bucket

2017-01-30 Thread Russell Brown
tion. > > 2017-01-28 13:33 GMT+03:00 Russell Brown : > IF you use leveldb, there is a function in the riak-erlang-client that gets > all objects in a bucket, I don’t know if it has been implemented in the java > client as it was written specifically for riak-cs. > > https:/

Re: Efficient way to fetch all records from a bucket

2017-01-30 Thread Russell Brown
IF you use leveldb, there is a function in the riak-erlang-client that gets all objects in a bucket, I don’t know if it has been implemented in the java client as it was written specifically for riak-cs. https://github.com/basho/riak-erlang-client/blob/develop/src/riakc_pb_socket.erl#L1130 Chee

Re: Secondary indexes or Riak search ?

2017-02-06 Thread Russell Brown
It’s worth noting that secondary indexes (2i) has some other advantages over solr search. If you _can_ model your queries in 2i then I'd recommend it. Secondary indexes have a richer API than is currently documented, if you look at https://docs.basho.com/riak/1.4.7/dev/using/2i/ you’ll see that

Re: [Basho Riak] Fail To Update Document Repeatly With Cluster of 5 Nodes

2017-02-06 Thread Russell Brown
What operation are you performing? It looks like the map is a single level map of last-write-wins registers. Are you updating a value? Is there a chance that the time on the node handling the update is behind the value in the lww-register? Have you tried using the `modify_type` operation in ria

Re: [Basho Riak] Fail To Update Document Repeatly With Cluster of 5 Nodes

2017-02-07 Thread Russell Brown
On 7 Feb 2017, at 08:17, my hue wrote: > Dear John and Russell Brown, > > * How fast is your turnaround time between an update and a fetch? > > The turnaround time between an update and a fetch about 1 second. > During my team and I debug, we adjusted haproxy with the

Re: [Basho Riak] Fail To Update Document Repeatly With Cluster of 5 Nodes

2017-02-07 Thread Russell Brown
id">>,register},{register,<<>>,<<"rest848e042b3a0488640981c8a6dc4a8281">>}},{{<<"restaurant_status_id">>,register},{register,<<>>,<<"inactive">>}},{{<<"start_time">>,register},{r

Re: [Basho Riak] Fail To Update Document Repeatly With Cluster of 5 Nodes

2017-02-07 Thread Russell Brown
,register},{assign,<<"false">>}}, > {update,{<<"id">>,register}, > {assign,<<"menufe89488afa948875cab6b0b18d579f21">>}}, > {update,{<<"end_time">>,register},{assign,<<"dont_use">>}},{update,{<<"currency">>,register},{assign,<<"cad">>

Re: [Basho Riak] Fail To Update Document Repeatly With Cluster of 5 Nodes

2017-02-07 Thread Russell Brown
ble thing and that still fails, it helps. IMO the simplest possible thing is to start with a new, empty key and use modify_type to update a single register. Many thanks Russell > > > On Tue, Feb 7, 2017 at 5:18 PM, Russell Brown wrote: > So in you’re updating all those regist

Re: Secondary indexes or Riak search ?

2017-02-13 Thread Russell Brown
s easy to run into > some issues most of the time. Any suggestion here ? > > Many thanks in advance. > > Br, > Alex > > 2017-02-06 19:02 GMT+08:00 Alex Feng : > Hi Russell, > > It is really helpful, thank you a lot. > We are suffering from solr crash now,

Re: Secondary indexes or Riak search ?

2017-02-13 Thread Russell Brown
m()} > secret function, do not use, or I come to your house and keeel you. > > cs_opt() = {timeout, timeout()} | {continuation, binary()} | {max_results, > non_neg_integer() | all} | {start_key, binary()} | {start_incl, boolean()} | > {end_key, binary()} | {end_incl, boolean()} >

Re: Updating particular version of CRDT

2017-02-22 Thread Russell Brown
Hi Andrey, The register inside a map is a LWW-register. Long story: When we added CRDTs to Riak we did it for those users who wanted to avoid writing custom sibling resolution code, following on from that decision we decided not to add the MVRegister type. Riak’s default object is an MVRegister

<    1   2   3   4   >