Re: Core Claim and Property-Based Tests

2017-05-18 Thread Jon Meredith
2, n3, n4, n5, n6, n7, n8, n4, n3, n2, n1, n8, n7, n6, > n5], 4). > 61.71428571428584 > > Neither can I think of a way of bettering this by improving claim v2. > However as mentioned in the long read, one of the issues with claim v3 > might be that rings with bad properties (such

Re: Core Claim and Property-Based Tests

2017-05-17 Thread Jon Meredith
Thanks for the excellent writeup. I have a few notes on your writeup and then a little history to help explain the motivation for the v3 work. The Claiming Problem One other property of the broader claim algorithm + claimant + handoff manager group of processes that's worth mentioning is saf

Re: Riak pre-commit hook crashing unexpectedly

2015-12-07 Thread Jon Meredith
Does your signed_pb:decode_sign(Msg) function expect the binary to be in external term format? I would guess you probably want the direct value there without the term to binary - it should already be a binary. Is your hook expected to work with allow_mult=true, if so the get_metadata and get_val

Re: Pre-commit hook debug

2015-12-01 Thread Jon Meredith
Hi Geoff, Looks like the WM endpoint isn't handling that crash well. As for your precommit hook, the hook runs inside the server context so you'll need to use the riak_object module instead. riakc_obj is a cut-down version for use in the Erlang client. Jon On Tue, Dec 1, 2015 at 11:53 AM Geoff

Re: Ownership handoff timed out

2015-10-27 Thread Jon Meredith
t;{data_root, "/var/lib/riak/leveldb"} >]}, >{be_blocks, riak_kv_bitcask_backend, [ >{data_root, "/var/lib/riak/bitcask"} >]} >]}, > > And for hosts with leveldb-only backend: > > {ri

Re: Ownership handoff timed out

2015-10-26 Thread Jon Meredith
Hi, I suspect your {error,enotconn} messages are unrelated - that's likely to be caused by an HTTP client closing the connection while Riak looks up some networking information about the requestor. The max_concurrency message you are seeing is related to the handoff transfer limit - it should be

Re: Node join not committed

2015-10-09 Thread Jon Meredith
Hi Daniel, It's perfectly safe to issue the cluster plan/commit steps. Joining the node gives it information about where data is located in the rest of the cluster and it will happily coordinate gets, but the new node will always forward put requests and will not store any data until you go throu

Re: "Accumulator" convergent data type

2015-10-07 Thread Jon Meredith
Conceptually I think it should work - the same PN counter design could handle floats as well as integers. You'd have to make sure the P and N values only grew by handling the sign - if you want to add a negative float you would do N += abs(V). There are also concerns around error bounds and all th

Re: riak 2.1.1 : Erlang crash dump

2015-10-01 Thread Jon Meredith
It looks like Riak was unable to allocate 4Gb of memory. You may have to reduce the amount of memory allocated for leveldb from the default 70%, try setting this in your /etc/riak/riak.conf file leveldb.maximum_memory.percent = 50 The memory footprint for Riak should stabilize after a few hours

Re: Using SASL with Riak

2015-09-22 Thread Jon Meredith
Hi, Riak uses a logging library called lager that traps the output from SASL logging, so you should not need to set anything up. You can either apply the lager parse transform to your commit hook code and then you should be able to use lager:error/2, lager:warning/2, lager:info/2 to write to the

Re: Monitoring protobuffs and CPU usage on a Riak KV cluster

2015-08-08 Thread Jon Meredith
Hi Sean, Thank you for the info. I had exchanged a couple of emails with Russell Brown (who implemented the maps/sets) and he was interested how enabled/disabling compression affected your results. The shipping implementation keeps a fair bit of metadata around which we compress to try and impro

Re: riak source build error.

2015-05-21 Thread Jon Meredith
/man/man1/gem.1.gz file is present and is a valid file >>>> (meaning not an empty file, inaccessible file etc.) >>>> >>>> I have no idea how to get around this error. Any help is highly >>>> appreciated. >>>> >>>> Thanks, >>>> Atul. >>>> >>>> ___ >>>> riak-users mailing list >>>> riak-users@lists.basho.com >>>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com >>>> >>>> >>> >>> >>> -- >>> Clay Price >>> 571-732-2502 >>> www.basho.com >>> >> >> > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- Jon Meredith Chief Architect Basho Technologies, Inc. jmered...@basho.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Loopback Address as Handoff IP/Interface

2015-05-03 Thread Jon Meredith
t; ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- Jon Meredith Chief Architect Basho Technologies, Inc. jmered...@basho.com

Re: scaling up vertically upgrading HD

2015-04-23 Thread Jon Meredith
ode 4: 1TB > Node 5: 1TB > > How can you rebalance the cluster in the way their partitions grow to fit > this new setup? (using Riak 2.1) > > Thanks, > Alex > > ___ > riak-users mailing list > riak-users@lists.basho.com

Re: Need help getting riak started

2015-04-15 Thread Jon Meredith
iak_kv_entropy_manager:perhaps_log_throttle_change:853 Changing > AAE throttle from undefined -> 0 msec/key, based on maximum vnode mailbox > size 0 from 'riak...@riak.prod.pryvy.com' > 2015-04-15 22:17:19.672 [info] <0.352.0>@riak_core:wait_for_service:483 > Wait comp

Re: RiakCS node crash +90% disk i/o

2014-12-03 Thread Jon Meredith
limit and everything crashed. > > [image: Bonfire Logo] *Alex Millar*, CTO > Office: 1-800-354-8010 ext. 704 <+18003548010> > Mobile: 519-729-2539 <+15197292539> > *GoBonfire*.com <http://GoBonfire.com> > > On December 3, 2014 at 9:31:22 AM, Jon Meredith (j

Re: RiakCS node crash +90% disk i/o

2014-12-03 Thread Jon Meredith
Hi Alex. It looks like you exceeded the files ulimit. Information on how to fix is here http://docs.basho.com/riak/latest/ops/tuning/open-files-limit/#Changing-the-limit Jon > On Dec 3, 2014, at 7:15 AM, Alex Millar wrote: > > Good morning Riak-Users > > Last night one of the nodes in my 5

Re: API for Creation of Bucket Types

2014-10-14 Thread Jon Meredith
ypes-tp4031932.html > > Sent from the Riak Users mailing list archive at Nabble.com. > > > > ___ > > riak-users mailing list > > riak-users@lists.basho.com > > http://lists.basho.

Re: Wierd hanging problem

2014-03-27 Thread Jon Meredith
here the problem is located? > > Doesn't this indicate a problem with the way that Riak implements the > server timeout? Shouldn't some supervisor be killing and restarting a child > process or subtree when this occurs? > -- > Micha

Re: Do you wait for hinted handoffs when doing backups?

2013-10-30 Thread Jon Meredith
doing-backups-tp4028966p4029645.html > Sent from the Riak Users mailing list archive at Nabble.com. > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com &

Re: C++ Not Found

2013-10-18 Thread Jon Meredith
gt; - Peace > Dave > > > > _______ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- Jon Meredith VP, Engineering Basho Technologies, Inc. jmered...@basho.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: User Space Install of Riak on Suse EL 11 SP2?

2013-10-11 Thread Jon Meredith
without access to sudo or > root. Any ideas? > > - Peace > Dave > > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- Jon Mere

Re: riak 1.2.0-1 / Failed to merge

2013-10-10 Thread Jon Meredith
eys witch are in this files. To trigger > a read. We have over 25.000.000 Million records in riak an it's would be > grat to receive the richt ones. Not all. > > Thanks in advanced. > > Best regards > Sebastian > > > On 10/10/2013 04:09 PM, Jon Meredith wrote: &g

Re: riak 1.2.0-1 / Failed to merge

2013-10-10 Thread Jon Meredith
ber of files is much higher (2821 files) than in other directorys (30 > files). > > Does anyone has a solution or a hint. > > Thanks a lot an best regards > Sebastian > > _______ > riak-users mailing list

Re: 2i Index Durability/Resilience

2013-10-07 Thread Jon Meredith
___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- Jon Meredith VP, Engineering Basho Technologies, Inc. jmered...@basho.com ___ ria

Re: Riak listens on strange port

2013-09-25 Thread Jon Meredith
c > root@gruppuco:/usr/local/riak/etc# grep 50588 * > > > Does anybody know what is this port used for ? > > Thanks, > > Jorge > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailma

Re: Riak cluster all nodes down

2013-09-20 Thread Jon Meredith
t;> curl -v -XPUT http://dat7:8098/riak/visitors -H "Content-Type: >> application/json" -d '{"props":{"n_val":"3"}}' >> >> How can I update the n_val of an already existing bucket, while the >> instance is down? >> >>

Re: Riak cluster all nodes down

2013-09-20 Thread Jon Meredith
Looks like the nval is set to a binary <<"3">> rather than an integer. Have you changed it recently and how? On Sep 20, 2013, at 8:25 AM, Edgar Veiga wrote: > Hello everyone, > > Please lend me a hand here... I'm running a riak cluster of 6 machines > (version 1.4.1). > > Suddenly all the no

Re: Riak-CS , S3cmd and A single Node outage on a 3 node cluster

2013-08-21 Thread Jon Meredith
greater the 1 ) >> Isn't a 3 Node Cluster with n_val =>2 supposed to withstand a single node >> failure ? >> Have I missed something in configuring Riak-CS ? >> >> Any help will be appreciated , this is really the final missing piece of >> our RiAK puzzle :) >> >> Regards, >> >> Idan Shinberg >> >> >> System Architect >> >> Idomoo Ltd. >> >> >> >> Mob +972.54.562.2072 >> >> email idan.shinb...@idomoo.com >> >> web www.idomoo.com >> >> [image: Description: >> cid:FC66336E-E750-4C2D-B6E3-985D5A06B5BE@idomoo.co.il] >> > > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- Jon Meredith VP, Engineering Basho Technologies, Inc. jmered...@basho.com <>___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: 2i, search or something else for most efficient "range" lookup

2013-08-19 Thread Jon Meredith
interested in > getting back a single object... but there doesn't see to be any other way > to do this. > > Would 2i or search be the most efficient / least impactful way to perform > this type of search? > > Thanks. > > > ___

Re: Secondary index reverse sort

2013-07-31 Thread Jon Meredith
avoid >> MapReduce if at all possible. >> > >> > >> > ___ >> > riak-users mailing list >> > riak-users@lists.basho.com >> > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com >> >> > >

Re: [ANNC] Riak 1.4.0 RC1

2013-06-27 Thread Jon Meredith
t it? > > Best Regards. > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- Jon Meredith VP, Enginee

Re: LMDB Backend for Riak

2013-05-03 Thread Jon Meredith
1884 > > Any chances of Basho guys supporting lmdb as an leveldb alternative to > Riak? It would be awesome! :D > > -- > Brian(Sung-jin) Hong > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.b

Re: Secondary index maintenance

2013-02-20 Thread Jon Meredith
To expand on that answer a little. The two functions you mention just work on the client side riak object you've retrieved over the PB API. You still have to store the updated object. There aren't specific calls over the PB interface to adjust 2I metadata. Which http API are you referring t

Re: Riak fails to start

2013-01-21 Thread Jon Meredith
k_ >>> core_app,start,[normal,[]]}}}) >>> >>> >>> Which suggest that something happened to ring files? >>> >>> Any idea what and why it happened? >>> >>> Dump file available at: >>> http://www.filedropper.com/erlcrash >>> >>> Regards >>> Daniel >>> >>> >>> >> ___ >> riak-users mailing list >> riak-users@lists.basho.com >> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com >> >> > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- Jon Meredith VP, Engineering Basho Technologies, Inc. jmered...@basho.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Riak fails to start

2013-01-21 Thread Jon Meredith
Thanks for reporting the issue and sorry you got bitten by it. We have committed a fix to master a couple of months ago and it will appear in the 1.3 release. Jon On Jan 21, 2013, at 3:58 AM, Daniel Iwan wrote: > THe issue was that one of the ring snapshot files had size 0 > > user@node1:~

Re: Security risk of clients having access to vector clocks

2013-01-18 Thread Jon Meredith
There is no equivalent of an SQL injection attack on the vector clock. If the client is able to tamper with it the only three issues I can think of are 1) deliberately corrupting it so that the put operation crashes which would end up with a timeout. If the application required the store and di

Re: What ever happened to delete support for post-commit hooks?

2012-09-17 Thread Jon Meredith
> riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- Jon Meredith Platform Engineering Manager Basho Technologies, Inc. jmered...@basho.com __

Re: Node shutdown error

2012-09-12 Thread Jon Meredith
first installed server. We have joined other > ones to this server. This also serves Riak control. > s2 - 10.10.0.22 - > s3 - 10.10.0.23 - > s4 - 10.10.0.24 - This server also serves Riak control. > > This servers randomly shutdown. Yesterday s4 was shutdown. &g

Re: Upgrading 0.14.2 cluster to 1.2

2012-08-08 Thread Jon Meredith
there any special reasons for your recommendation? > > On 08.08.2012, at 19:38, Jon Meredith wrote: > > > I would recommend going 0.14.2 -> 1.1.4 -> 1.2, making sure you follow > the pre-1.0 upgrade instructions on > http://wiki.basho.com/Rolling-Upgrades.html > > >

Re: Upgrading 0.14.2 cluster to 1.2

2012-08-08 Thread Jon Meredith
> > > -- > Sean Cribbs > Software Engineer > Basho Technologies, Inc. > http://basho.com/ > > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.bas

Riak 1.2.0 RC3

2012-07-26 Thread Jon Meredith
(by proxy, Ed.) -- Jon Meredith Platform Engineering Manager Basho Technologies, Inc. jmered...@basho.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Riak 1.2.0 RC3

2012-07-26 Thread Jon Meredith
26, 2012 at 10:47 AM, Jon Meredith wrote: > Riak Users, > > We have built and uploaded Riak 1.2.0 release candidate 3 for your use, > testing, and abuse. > > You can download RC3 from our downloads page: > http://basho.com/resources/downloads/ > > The changes for RC3

Re: vnodeid uniqueness

2012-05-16 Thread Jon Meredith
ect the vclock algorithm. > > YAMAMOTO Takashi > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > -- Jon Meredith Platform En

Re: Reip(ing) riak node created two copies in the cluster

2012-05-02 Thread Jon Meredith
> "member_status" says that node 3 owns 0% of the ring and 0% are pending. > We have a lot of data - each node serves around 200 million documents. > Riak cluster is running 1.1.2. > Any suggestions? > > Cheers > Nitish > On May 2, 2012, at 5:31 PM, Jon Meredit

Re: Reip(ing) riak node created two copies in the cluster

2012-05-02 Thread Jon Meredith
hats an elegant way to > recover from this mess? Would shutting off all the nodes, deleting the ring > directory, and again forming the cluster work? > > Cheers > Nitish > ___ > riak-users mailing list > riak-users@lists.basho.com &

Re: Issue with 2i

2012-05-01 Thread Jon Meredith
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- Jon Meredith Platform Engineering Manager Basho Technologies, Inc. jmered...@basho.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: preflist_exhausted with map-reduce and riak-js

2012-04-04 Thread Jon Meredith
an extreme case as it was impossible to start any JS VMs as mapred_builtins.js is a required file that was missing from the system. Jon On Tue, Apr 3, 2012 at 5:56 PM, Jon Meredith wrote: > That's very interesting, you don't have any Javascript VMs running. Here's > an exa

Re: Alternative to Post-Commit in EDS

2012-04-04 Thread Jon Meredith
-- > > Anthony Molinaro > > > > ___ > > riak-users mailing list > > riak-users@lists.basho.com > > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- > ----

Re: preflist_exhausted with map-reduce and riak-js

2012-04-03 Thread Jon Meredith
ulticall(riak_kv_js_manager,pool_size,[riak_kv_js_reduce]). > {[0,0,0],[]} > > -Matthew > > > > On Tue, Apr 3, 2012 at 14:00, Jon Meredith wrote: > >> Hi Matthew, >> >> Thanks for the logs. Do you know how many map/reduce jobs you run >> conc

Re: preflist_exhausted with map-reduce and riak-js

2012-04-03 Thread Jon Meredith
t: false > status: running > heap_size: 987 > stack_size: 24 > reductions: 251 > neighbours: > 2012-04-02 15:16:56 =SUPERVISOR REPORT > Supervisor: {local,riak_pipe_builder_sup} > Context:child_terminated > Reason: {sink_died,shutdown

Re: preflist_exhausted with map-reduce and riak-js

2012-04-02 Thread Jon Meredith
ap_js_vm_count' and > 'reduce_js_vm_count' > on the cluster to the values you suggested 24/18 and even larger ones 32/24 > and 128/128, but with no success - I still get the same error in the > console log of the node. > > What are we missing?! > > -Matthe

Re: preflist_exhausted with map-reduce and riak-js

2012-03-30 Thread Jon Meredith
== >> 2012-03-13 18:24:44.645 [error] <0.20949.24> CRASH REPORT Process >> <0.20949.24> with 0 neighbours crashed with reason: {sink_died,shutdown} >> 2012-03-13 18:24:44.652 [error] <0.175.0> Supervisor >> riak_pipe_builder_sup had child undefined star

Re: Possible handoff stalls

2012-03-20 Thread Jon Meredith
gs for the last time this occurred in my original email. >> >> I'll try to capture this information if the problem occurs again. >> Thanks. >> >> Best Regards, >> >> Armon Dadgar >> >> On Mar 19, 2012, at 11:36 AM, Jon Meredith wrote: >> >>

Re: Possible handoff stalls

2012-03-19 Thread Jon Meredith
e contents of our console.log, erlang.log, error.log and > crash.log > from the relevant times if that is useful. > > Best Regards, > > Armon Dadgar > > > > _______ > riak-users mailing list > riak-use

Re: preflist_exhausted with map-reduce and riak-js

2012-03-13 Thread Jon Meredith
gt; > in the console. I haven't tried restarting riak, just because i'd rather > find out what's happening than it going away and coming back later when i > don't expect it. > > Any suggestions on how to troubleshoot this? I can still access items > individually and i can even list the keys via ?keys=true, i

Re: Issues with MapReduce in Riak 1.1.0

2012-02-27 Thread Jon Meredith
ons wrote: > I think I know the answer to this but would using a mix of 1.0.X and 1.1.0 > together cause the same MapReduce issue? > > On Fri, Feb 24, 2012 at 4:56 PM, Jon Meredith wrote: > >> Issues have been reported by users and customers with the MapReduce >> sub

Issues with MapReduce in Riak 1.1.0

2012-02-24 Thread Jon Meredith
e to 1.1.0 if I am not using MapReduce? Yes. Issue Tracker https://github.com/basho/riak_kv/issues/293 -- Jon Meredith Platform Engineering Manager Basho Technologies, Inc. jmered...@basho.com ___ riak-users mailing list riak-users@lists.bash

Re: Avoiding false concurrency in Riak

2012-02-21 Thread Jon Meredith
s Victor Fonte - Carlos Baquero HASLab / INESC TEC, Universidade do Minho, Portugal c...@di.uminho.pt http://gsd.di.uminho.pt/cbm ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com -- Jon Meredith Platform Engineering Manager Basho Technologies, Inc. jmered...@basho.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Absolute consistency

2012-01-10 Thread Jon Meredith
ed https://issues.basho.com/show_bug.cgi?id=1318 to track this. > > I don't have a workaround that I can think of offhand, unfortunately. > > Andrew > > ___ > riak-users mailing list > riak-users@lists.basho.com > http:

Re: some really weird stuff with python client's delete...

2011-12-15 Thread Jon Meredith
ot bucket.get(key).exists()) print "Deleted %d keys!" % len(keys) On Thu, Dec 15, 2011 at 8:06 AM, Shuhao Wu wrote: > I'm trying to delete all the keys from the users bucket and the blog > bucket because they are all created by my doctests. I don't want these in >

Re: some really weird stuff with python client's delete...

2011-12-15 Thread Jon Meredith
it and always show the > exact same output... but if i open a separate python console and delete one > of these keys via the same method (create a client, get a bucket, get the > object via key, delete the object...), this will go down to 9 keys... > > What's wrong? I'm

Re: List keys and multiple buckets

2011-11-15 Thread Jon Meredith
ies > for these buckets. > > Kresten > > > Kind regards, > Izhar. > > _______ > riak-users mailing list > riak-users@lists.basho.com<mailto:riak-users@lists.basho.com > > > http://lists.basho.com/mailman/listinfo/r

Re: Riak crash on node restarts

2011-11-15 Thread Jon Meredith
uot;} > > If I manually restart the node, things go back to normal. Any ideas on > what's going on? I've attached the error log. > > -- > Jeremy > > ___ > riak-users mailing list > riak-users@lists.basho.com > http

Re: Durable writes and parallel reads

2011-11-03 Thread Jon Meredith
s, there will be some > parallellity even with serialized reads within each bitcask. > > Regards, > Erik Søe Sørensen > > > __**_ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/**mailman/listinfo/ri

Re: 1.0.2 soon?

2011-11-03 Thread Jon Meredith
--- > Anthony Molinaro > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > -- Jon Meredith Pl

Details on new delete_mode setting introduced in 1.0.0

2011-10-12 Thread Jon Meredith
lete_mode, keep}, {delete_mode, immediate} or {delete_mode, DelayMsecs} to the riak_kv section of app.config (in /etc/riak, /opt/riak or etc/ depending on your platform). Jon Meredith Senior Software Engineer Basho Technologies ___ riak-users mailing l

Re: empty sibling after a DELETE then PUT

2011-10-06 Thread Jon Meredith
for empty bodies at the moment. I think it should be more explicit so I've filed a bug https://issues.basho.com/show_bug.cgi?id=1239 Best Regards, Jon Meredith Basho Technologies On Thu, Oct 6, 2011 at 1:14 PM, Eric Moritz wrote: > It seems to me that occasional tombstone siblings may

Re: empty sibling after a DELETE then PUT

2011-10-05 Thread Jon Meredith
immediate} to the riak_kv section of your app.config Jon Meredith Basho Technologies. On Wed, Oct 5, 2011 at 1:13 PM, Eric Moritz wrote: > If I enabled allow_multi on a bucket and do I DELETE followed by a PUT > I am getting a 300 response with one sibling having the body of the > PUT a

Re: Delete takes 5 seconds in riak 1.0 ???

2011-10-03 Thread Jon Meredith
{error, notfound} when it has gone. If you wish to rewrite the key, you can use the returned vclock on a new object O = riakc_obj:set_vclock(riakc_obj:new(<<"b">>,<<<"k">>,<,"v">>), VClock) and it will overwrite the tombstone for y

Re: Keys out of sync

2011-09-27 Thread Jon Meredith
Hi Greg, What version of riak did you experience this with? Were the keys being created and deleted in cycles or were they one off create/deletes? Cheers, Jon Meredith Basho Technologies. On Tue, Sep 27, 2011 at 4:56 PM, Greg Pascale wrote: > Hi, > > I've got my riak ring in

Re: Performance Issues with LevelDB Backend on 1.0.0RC1

2011-09-26 Thread Jon Meredith
c/riak/defaults and writes actually slowed down a little bit > (~10 less writes per second). Shouldn't the max_open_files setting keep the > total amount of fd's pretty low? Maybe I'm misunderstanding what that option > is used for. > > Patrick > > On Sep 26, 2011, at 2

Re: Performance Issues with LevelDB Backend on 1.0.0RC1

2011-09-26 Thread Jon Meredith
ed to leveldb in there. Jon Meredith Basho Technologies. On Mon, Sep 26, 2011 at 12:37 PM, JB Smith wrote: > We are seeing similar issues using levelDB with 1.0.0RC1 > > We run a 6 way cluster on EC2 64bit micro instances. > > Initially we had assumed that there may be some iss

Re: Performance Issues with LevelDB Backend on 1.0.0RC1

2011-09-26 Thread Jon Meredith
Hi Patrick, You may be running out of ports which erlang uses for TCP sockets - try increasing ERL_MAX_PORTS in etc/vm.args Cheers, Jon Basho Technologies. On Mon, Sep 26, 2011 at 12:17 PM, Patrick Van Stee wrote: > We're running a small, 2 node riak cluster (on 2 m1.large boxes) using the > Le

Re: System Limit Question

2011-09-20 Thread Jon Meredith
need to up the limit in vm.args. Cheers, Jon Meredith Basho Technologies. On Tue, Sep 20, 2011 at 2:13 PM, TJ Ninneman wrote: > On our RHEL servers I've been noticing a lot of: > > Failed to merge ... > {{badmatch,{error,system_limit}},[{bitcask,scan_key_files,3},{bitcask,&

Re: Riak Search Precommit Hook in 1.0

2011-09-20 Thread Jon Meredith
Hi Greg, This is a consequence of the changes we made to bucket properties to try and simplify a few configuration issues. I've filed a bug for it. https://issues.basho.com/show_bug.cgi?id=1216 Why does your hook need to go after the search hook? Cheers, Jon. On Mon, Sep 19, 2011 at 6:37 PM,

Re: Precommit Hook Difficulties

2011-09-19 Thread Jon Meredith
I had a quick play with this. Mochijson2:encode returns an erlang I/O list. You can convert back to a proper binary with iolist_to_binary(). precommit_json_identity(Obj) -> Values = riak_object:get_values(Obj), {struct, TermList} = mochijson2:decode(hd(Values)), riak_object:apply_upda

Re: Locking

2011-08-02 Thread Jon Meredith
because it exists for > update on only one shard (that shard's master.) To try to get transactional > syntax across multipel objects is going to take a > multi-phase locking protocol that you implement yourself. > > > On Tue, Aug 2, 2011 at 11:28 AM, Jon Meredith wrote: &g

Re: Locking

2011-08-02 Thread Jon Meredith
shards, only one shard has > a given piece of data. But that shard can be replicated in a master/slave > ,manner for failover. > > See: > > http://www.mongodb.org/display/DOCS/Sharding+Introduction#ShardingIntroduction-ShardinginaNutshell > > > On Tue, Aug 2, 2011 at 10:50

Re: Locking

2011-08-02 Thread Jon Meredith
Hi Jeffrey, Do you know if Mongo provides locks that can be used on clusters of machines and in the presence of network partitions/failures? Riak could probably get close if you created a cluster with a single node and performed all accesses with N=R=W=1 as updating a single vnode is atomic, it's

Re: Locking

2011-08-01 Thread Jon Meredith
lt;"client2 lock">>] Client2: get(<<"b">>, <<"lock">>) returns sibings [<<"client1 lock">>, <<"client2 lock">>] In this case neither client gets the lock. Notice that client2 gets the same value as

Proposed changes to backends

2011-07-15 Thread Jon Meredith
As we work towards the next release we're planning to refactor the riak_kv backend interface and drivers. To ensure a smooth upgrade path we would like to know if: 1) Has anybody written *and deployed* custom backends using the riak_kv_backend behavior for their production deployments (those writ

Re: Node crash badmatch enoent

2011-07-08 Thread Jon Meredith
Hi Carlo, >From the error report it looks like riak was having problems opening a file in the /tmp/riak/slide-data directory. Do you have any processes that clean up temporary files / dirs while riak is running? BR, Jon. On Thu, Jul 7, 2011 at 2:32 AM, Carlo Bertoldi wrote: > Hello everybody,

Re: Large ring_creation_size

2011-04-20 Thread Jon Meredith
wondering how much of an impact it had to disable stats and stop > os_mon? > > Greg > > On Tuesday, April 19, 2011 at 8:24 AM, Jon Meredith wrote: > > Hi Greg, > > I had a chance to play around a little over the weekend. I was able to get > a couple of nodes to join a

Re: Large ring_creation_size

2011-04-19 Thread Jon Meredith
handles using that. Once you have a large number of physical nodes then the per-node file handle requirements will drop, but you need to system to stay up long enough to get to that point. Good luck, Jon Meredith Basho Technologies. On Thu, Apr 14, 2011 at 12:00 PM, Jon Meredith wrote: > Hi

Re: Large ring_creation_size

2011-04-14 Thread Jon Meredith
ults. > > Thanks for digging in, > > Dave > > On Wed, Apr 13, 2011 at 5:11 PM, Greg Nelson wrote: > > Ok, how about in this case I described? It runs out of memory with a > single pair of nodes... > > (Or did you mean there's a connection between each pair

Re: Large ring_creation_size

2011-04-13 Thread Jon Meredith
27;ll be pushing the known limits. Basho will do our very best to help overcome any obstacles as you encounter them. Jon Meredith Basho Technologies. On Wed, Apr 13, 2011 at 1:41 PM, Greg Nelson wrote: > The largest known riak cluster != the largest possible riak cluster. ;-) > > The in

Re: When's the PBC API going to be brought up to snuff?

2011-04-06 Thread Jon Meredith
improving bucket properties over PBC which is another pain point. Hopefully the work will take place soon, barring any significant distractions. Jon Meredith Basho Technologies. On Wed, Apr 6, 2011 at 6:45 AM, Jon Brisbin wrote: > > On Apr 5, 2011, at 5:41 PM, Bryan O'Sullivan wrote: &

Re: update objects in precommit hooks

2011-04-01 Thread Jon Meredith
Hi Damian, The put FSM is being overhauled at the moment. The current 0.14.1 code does not apply the updated values in precommit hooks. In my testing it worked ok, but I think that is probably because there were already values present in Riak and the changes were included at the vnode level. Yo

Re: riak-search build assumes access to github using 'git' protocol

2011-02-17 Thread Jon Meredith
Did you try downloading the tarball from riak_search-0.14.0-1.tar.gz and running make? If that fails you could try running ./rebar compile ./rebar rel And that should build the release in rel/riak BR, Jon. On T

Re: Riak Cluster Setup on EC2

2011-02-02 Thread Jon Meredith
etting "pang" as a reply. > > But is this a network issue? > As I said before I can telnet on to the machines on the Riak ports. > > What can be the issues? > > Again ,Thanks for all the quick help > > -Abhishek Kona > > > On 02/02/11 10:33 PM, Jon Mere

Re: Riak Cluster Setup on EC2

2011-02-02 Thread Jon Meredith
Hi Abhishek, It looks like distributed erlang isn't working between the nodes so the join fails. You can test it by bringing the nodes up in console mode and executing $ riak console [some logging status messages] Eshell V5.7.5 (abort with ^G) (dev2@127.0.0.1)1> net_adm:ping('dev1@127.0.0.1').

Re: Short read error on .store() with protobufs using Python client

2011-01-27 Thread Jon Meredith
lines in pbc.py where the check >>>> and error message occur. Basically this is a known issue and the >>>> check should not be there. >>>> >>>> -- GWF >>>> >>>> (sent from my cell phone.) >>>> >>>> >

Re: Short read error on .store() with protobufs using Python client

2011-01-21 Thread Jon Meredith
ent it out as suggested in the comments, but we should really check that len(self._inbuf) == msglen before returning from the function. Cheers, Jon. On Fri, Jan 21, 2011 at 3:30 PM, Jon Meredith wrote: > Hi Bob, > > That sounds like a tricky one. Does it depend on the data you alr

Re: Short read error on .store() with protobufs using Python client

2011-01-21 Thread Jon Meredith
ggestion, Jon. This is occurring every time I try to do > .store() via protobuf transport in the Python client (so yes, it is > reproducible); however, there is no output in logs or riak console. > > - Bob > > > On 1/21/2011 1:02 PM, Jon Meredith wrote: > >> Hi Bob, >

Re: Short read error on .store() with protobufs using Python client

2011-01-21 Thread Jon Meredith
Hi Bob, That sounds like the connection got closed as the client was readying. Have you checked through the server logs to verify that no processes died or no other nodes went down? Or if it's reproducible you should be able to start the server with 'riak console' and see what gets printed. Che

Re: skerl dependency error

2011-01-09 Thread Jon Meredith
t; make: *** [rel] Error 1 > > Is there a fix for this or should I use the pre-compiled tarball for my > platform? > > Jeremiah Peschka > Microsoft SQL Server MVP > MCITP: Database Developer, DBA > > > On Sun, Jan 9, 2011 at 5:26 PM, Jon Meredith wrote: > >> H

Re: skerl dependency error

2011-01-09 Thread Jon Meredith
Hi Jeremiah, Unfortunately the dependencies in riak_search/deps/luwak/rebar.config were set to pull the most recent version of skerl rather than a tagged one so it is getting 1.0.0 of skerl when it is expecting 0.1. Until we can get it fixed, you can use the 0.13.0 release tarball from http://dow

Re: riak-erlang-client install error

2010-09-28 Thread Jon Meredith
Hi Tetsuya, Rebar requires version 1.1 or higher of Mercurial. What version do you have installed? You can find out using 'hg --version' jons-macpro:riak jmeredith$ hg --version Mercurial Distributed SCM (version 1.5.1) If you are below 1.1 you will need to upgrade. --Jon. On 9/28/10 6:2

Re: riak-erlang-client: riakc_pb_socket.erl:72: type ctx() undefined

2010-09-08 Thread Jon Meredith
Hi Matteo, The tip (fd76e53acac2) compiles for me under R13B04 - what version of erlang are you using so I can investigate? Jon On 9/8/10 7:53 AM, matteo.redae...@libero.it wrote: HEllo to all, I'm using riak for my erlang web crawler ebot (http://www.redaelli.org/matteo- blog/projects/ebo

  1   2   >