Re: vnodeid uniqueness

2012-05-16 Thread Jon Meredith
ect the vclock algorithm. > > YAMAMOTO Takashi > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > -- Jon Meredith Platform En

Re: Riak 1.2.0 RC3

2012-07-26 Thread Jon Meredith
26, 2012 at 10:47 AM, Jon Meredith wrote: > Riak Users, > > We have built and uploaded Riak 1.2.0 release candidate 3 for your use, > testing, and abuse. > > You can download RC3 from our downloads page: > http://basho.com/resources/downloads/ > > The changes for RC3

Riak 1.2.0 RC3

2012-07-26 Thread Jon Meredith
(by proxy, Ed.) -- Jon Meredith Platform Engineering Manager Basho Technologies, Inc. jmered...@basho.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Upgrading 0.14.2 cluster to 1.2

2012-08-08 Thread Jon Meredith
> > > -- > Sean Cribbs > Software Engineer > Basho Technologies, Inc. > http://basho.com/ > > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.bas

Re: Upgrading 0.14.2 cluster to 1.2

2012-08-08 Thread Jon Meredith
there any special reasons for your recommendation? > > On 08.08.2012, at 19:38, Jon Meredith wrote: > > > I would recommend going 0.14.2 -> 1.1.4 -> 1.2, making sure you follow > the pre-1.0 upgrade instructions on > http://wiki.basho.com/Rolling-Upgrades.html > > >

Re: Node shutdown error

2012-09-12 Thread Jon Meredith
first installed server. We have joined other > ones to this server. This also serves Riak control. > s2 - 10.10.0.22 - > s3 - 10.10.0.23 - > s4 - 10.10.0.24 - This server also serves Riak control. > > This servers randomly shutdown. Yesterday s4 was shutdown. &g

Re: What ever happened to delete support for post-commit hooks?

2012-09-17 Thread Jon Meredith
> riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- Jon Meredith Platform Engineering Manager Basho Technologies, Inc. jmered...@basho.com __

Re: Security risk of clients having access to vector clocks

2013-01-18 Thread Jon Meredith
There is no equivalent of an SQL injection attack on the vector clock. If the client is able to tamper with it the only three issues I can think of are 1) deliberately corrupting it so that the put operation crashes which would end up with a timeout. If the application required the store and di

Re: Riak fails to start

2013-01-21 Thread Jon Meredith
Thanks for reporting the issue and sorry you got bitten by it. We have committed a fix to master a couple of months ago and it will appear in the 1.3 release. Jon On Jan 21, 2013, at 3:58 AM, Daniel Iwan wrote: > THe issue was that one of the ring snapshot files had size 0 > > user@node1:~

Re: Riak fails to start

2013-01-21 Thread Jon Meredith
k_ >>> core_app,start,[normal,[]]}}}) >>> >>> >>> Which suggest that something happened to ring files? >>> >>> Any idea what and why it happened? >>> >>> Dump file available at: >>> http://www.filedropper.com/erlcrash >>> >>> Regards >>> Daniel >>> >>> >>> >> ___ >> riak-users mailing list >> riak-users@lists.basho.com >> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com >> >> > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- Jon Meredith VP, Engineering Basho Technologies, Inc. jmered...@basho.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Secondary index maintenance

2013-02-20 Thread Jon Meredith
To expand on that answer a little. The two functions you mention just work on the client side riak object you've retrieved over the PB API. You still have to store the updated object. There aren't specific calls over the PB interface to adjust 2I metadata. Which http API are you referring t

Re: LMDB Backend for Riak

2013-05-03 Thread Jon Meredith
1884 > > Any chances of Basho guys supporting lmdb as an leveldb alternative to > Riak? It would be awesome! :D > > -- > Brian(Sung-jin) Hong > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.b

Re: [ANNC] Riak 1.4.0 RC1

2013-06-27 Thread Jon Meredith
t it? > > Best Regards. > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- Jon Meredith VP, Enginee

Re: Secondary index reverse sort

2013-07-31 Thread Jon Meredith
avoid >> MapReduce if at all possible. >> > >> > >> > ___ >> > riak-users mailing list >> > riak-users@lists.basho.com >> > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com >> >> > >

Re: 2i, search or something else for most efficient "range" lookup

2013-08-19 Thread Jon Meredith
interested in > getting back a single object... but there doesn't see to be any other way > to do this. > > Would 2i or search be the most efficient / least impactful way to perform > this type of search? > > Thanks. > > > ___

Re: Riak-CS , S3cmd and A single Node outage on a 3 node cluster

2013-08-21 Thread Jon Meredith
greater the 1 ) >> Isn't a 3 Node Cluster with n_val =>2 supposed to withstand a single node >> failure ? >> Have I missed something in configuring Riak-CS ? >> >> Any help will be appreciated , this is really the final missing piece of >> our RiAK puzzle :) >> >> Regards, >> >> Idan Shinberg >> >> >> System Architect >> >> Idomoo Ltd. >> >> >> >> Mob +972.54.562.2072 >> >> email idan.shinb...@idomoo.com >> >> web www.idomoo.com >> >> [image: Description: >> cid:FC66336E-E750-4C2D-B6E3-985D5A06B5BE@idomoo.co.il] >> > > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- Jon Meredith VP, Engineering Basho Technologies, Inc. jmered...@basho.com <>___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Riak cluster all nodes down

2013-09-20 Thread Jon Meredith
Looks like the nval is set to a binary <<"3">> rather than an integer. Have you changed it recently and how? On Sep 20, 2013, at 8:25 AM, Edgar Veiga wrote: > Hello everyone, > > Please lend me a hand here... I'm running a riak cluster of 6 machines > (version 1.4.1). > > Suddenly all the no

Re: Riak cluster all nodes down

2013-09-20 Thread Jon Meredith
t;> curl -v -XPUT http://dat7:8098/riak/visitors -H "Content-Type: >> application/json" -d '{"props":{"n_val":"3"}}' >> >> How can I update the n_val of an already existing bucket, while the >> instance is down? >> >>

Re: Riak listens on strange port

2013-09-25 Thread Jon Meredith
c > root@gruppuco:/usr/local/riak/etc# grep 50588 * > > > Does anybody know what is this port used for ? > > Thanks, > > Jorge > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailma

Re: 2i Index Durability/Resilience

2013-10-07 Thread Jon Meredith
___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- Jon Meredith VP, Engineering Basho Technologies, Inc. jmered...@basho.com ___ ria

Re: riak 1.2.0-1 / Failed to merge

2013-10-10 Thread Jon Meredith
ber of files is much higher (2821 files) than in other directorys (30 > files). > > Does anyone has a solution or a hint. > > Thanks a lot an best regards > Sebastian > > _______ > riak-users mailing list

Re: riak 1.2.0-1 / Failed to merge

2013-10-10 Thread Jon Meredith
eys witch are in this files. To trigger > a read. We have over 25.000.000 Million records in riak an it's would be > grat to receive the richt ones. Not all. > > Thanks in advanced. > > Best regards > Sebastian > > > On 10/10/2013 04:09 PM, Jon Meredith wrote: &g

Re: User Space Install of Riak on Suse EL 11 SP2?

2013-10-11 Thread Jon Meredith
without access to sudo or > root. Any ideas? > > - Peace > Dave > > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- Jon Mere

Re: C++ Not Found

2013-10-18 Thread Jon Meredith
gt; - Peace > Dave > > > > _______ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- Jon Meredith VP, Engineering Basho Technologies, Inc. jmered...@basho.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Do you wait for hinted handoffs when doing backups?

2013-10-30 Thread Jon Meredith
doing-backups-tp4028966p4029645.html > Sent from the Riak Users mailing list archive at Nabble.com. > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com &

Re: Wierd hanging problem

2014-03-27 Thread Jon Meredith
here the problem is located? > > Doesn't this indicate a problem with the way that Riak implements the > server timeout? Shouldn't some supervisor be killing and restarting a child > process or subtree when this occurs? > -- > Micha

Re: API for Creation of Bucket Types

2014-10-14 Thread Jon Meredith
ypes-tp4031932.html > > Sent from the Riak Users mailing list archive at Nabble.com. > > > > ___ > > riak-users mailing list > > riak-users@lists.basho.com > > http://lists.basho.

Re: RiakCS node crash +90% disk i/o

2014-12-03 Thread Jon Meredith
Hi Alex. It looks like you exceeded the files ulimit. Information on how to fix is here http://docs.basho.com/riak/latest/ops/tuning/open-files-limit/#Changing-the-limit Jon > On Dec 3, 2014, at 7:15 AM, Alex Millar wrote: > > Good morning Riak-Users > > Last night one of the nodes in my 5

Re: RiakCS node crash +90% disk i/o

2014-12-03 Thread Jon Meredith
limit and everything crashed. > > [image: Bonfire Logo] *Alex Millar*, CTO > Office: 1-800-354-8010 ext. 704 <+18003548010> > Mobile: 519-729-2539 <+15197292539> > *GoBonfire*.com <http://GoBonfire.com> > > On December 3, 2014 at 9:31:22 AM, Jon Meredith (j

Re: Need help getting riak started

2015-04-15 Thread Jon Meredith
iak_kv_entropy_manager:perhaps_log_throttle_change:853 Changing > AAE throttle from undefined -> 0 msec/key, based on maximum vnode mailbox > size 0 from 'riak...@riak.prod.pryvy.com' > 2015-04-15 22:17:19.672 [info] <0.352.0>@riak_core:wait_for_service:483 > Wait comp

Re: scaling up vertically upgrading HD

2015-04-23 Thread Jon Meredith
ode 4: 1TB > Node 5: 1TB > > How can you rebalance the cluster in the way their partitions grow to fit > this new setup? (using Riak 2.1) > > Thanks, > Alex > > ___ > riak-users mailing list > riak-users@lists.basho.com

Re: Loopback Address as Handoff IP/Interface

2015-05-03 Thread Jon Meredith
t; ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- Jon Meredith Chief Architect Basho Technologies, Inc. jmered...@basho.com

Re: riak source build error.

2015-05-21 Thread Jon Meredith
/man/man1/gem.1.gz file is present and is a valid file >>>> (meaning not an empty file, inaccessible file etc.) >>>> >>>> I have no idea how to get around this error. Any help is highly >>>> appreciated. >>>> >>>> Thanks, >>>> Atul. >>>> >>>> ___ >>>> riak-users mailing list >>>> riak-users@lists.basho.com >>>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com >>>> >>>> >>> >>> >>> -- >>> Clay Price >>> 571-732-2502 >>> www.basho.com >>> >> >> > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- Jon Meredith Chief Architect Basho Technologies, Inc. jmered...@basho.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Monitoring protobuffs and CPU usage on a Riak KV cluster

2015-08-08 Thread Jon Meredith
Hi Sean, Thank you for the info. I had exchanged a couple of emails with Russell Brown (who implemented the maps/sets) and he was interested how enabled/disabling compression affected your results. The shipping implementation keeps a fair bit of metadata around which we compress to try and impro

Re: riak-search build assumes access to github using 'git' protocol

2011-02-17 Thread Jon Meredith
Did you try downloading the tarball from riak_search-0.14.0-1.tar.gz and running make? If that fails you could try running ./rebar compile ./rebar rel And that should build the release in rel/riak BR, Jon. On T

Re: update objects in precommit hooks

2011-04-01 Thread Jon Meredith
Hi Damian, The put FSM is being overhauled at the moment. The current 0.14.1 code does not apply the updated values in precommit hooks. In my testing it worked ok, but I think that is probably because there were already values present in Riak and the changes were included at the vnode level. Yo

Re: When's the PBC API going to be brought up to snuff?

2011-04-06 Thread Jon Meredith
improving bucket properties over PBC which is another pain point. Hopefully the work will take place soon, barring any significant distractions. Jon Meredith Basho Technologies. On Wed, Apr 6, 2011 at 6:45 AM, Jon Brisbin wrote: > > On Apr 5, 2011, at 5:41 PM, Bryan O'Sullivan wrote: &

Re: Large ring_creation_size

2011-04-13 Thread Jon Meredith
27;ll be pushing the known limits. Basho will do our very best to help overcome any obstacles as you encounter them. Jon Meredith Basho Technologies. On Wed, Apr 13, 2011 at 1:41 PM, Greg Nelson wrote: > The largest known riak cluster != the largest possible riak cluster. ;-) > > The in

Re: Large ring_creation_size

2011-04-14 Thread Jon Meredith
ults. > > Thanks for digging in, > > Dave > > On Wed, Apr 13, 2011 at 5:11 PM, Greg Nelson wrote: > > Ok, how about in this case I described? It runs out of memory with a > single pair of nodes... > > (Or did you mean there's a connection between each pair

Re: Large ring_creation_size

2011-04-19 Thread Jon Meredith
handles using that. Once you have a large number of physical nodes then the per-node file handle requirements will drop, but you need to system to stay up long enough to get to that point. Good luck, Jon Meredith Basho Technologies. On Thu, Apr 14, 2011 at 12:00 PM, Jon Meredith wrote: > Hi

Re: Large ring_creation_size

2011-04-20 Thread Jon Meredith
wondering how much of an impact it had to disable stats and stop > os_mon? > > Greg > > On Tuesday, April 19, 2011 at 8:24 AM, Jon Meredith wrote: > > Hi Greg, > > I had a chance to play around a little over the weekend. I was able to get > a couple of nodes to join a

Re: Node crash badmatch enoent

2011-07-08 Thread Jon Meredith
Hi Carlo, >From the error report it looks like riak was having problems opening a file in the /tmp/riak/slide-data directory. Do you have any processes that clean up temporary files / dirs while riak is running? BR, Jon. On Thu, Jul 7, 2011 at 2:32 AM, Carlo Bertoldi wrote: > Hello everybody,

Proposed changes to backends

2011-07-15 Thread Jon Meredith
As we work towards the next release we're planning to refactor the riak_kv backend interface and drivers. To ensure a smooth upgrade path we would like to know if: 1) Has anybody written *and deployed* custom backends using the riak_kv_backend behavior for their production deployments (those writ

Re: Locking

2011-08-01 Thread Jon Meredith
lt;"client2 lock">>] Client2: get(<<"b">>, <<"lock">>) returns sibings [<<"client1 lock">>, <<"client2 lock">>] In this case neither client gets the lock. Notice that client2 gets the same value as

Re: Locking

2011-08-02 Thread Jon Meredith
Hi Jeffrey, Do you know if Mongo provides locks that can be used on clusters of machines and in the presence of network partitions/failures? Riak could probably get close if you created a cluster with a single node and performed all accesses with N=R=W=1 as updating a single vnode is atomic, it's

Re: Locking

2011-08-02 Thread Jon Meredith
shards, only one shard has > a given piece of data. But that shard can be replicated in a master/slave > ,manner for failover. > > See: > > http://www.mongodb.org/display/DOCS/Sharding+Introduction#ShardingIntroduction-ShardinginaNutshell > > > On Tue, Aug 2, 2011 at 10:50

Re: Locking

2011-08-02 Thread Jon Meredith
because it exists for > update on only one shard (that shard's master.) To try to get transactional > syntax across multipel objects is going to take a > multi-phase locking protocol that you implement yourself. > > > On Tue, Aug 2, 2011 at 11:28 AM, Jon Meredith wrote: &g

Re: Precommit Hook Difficulties

2011-09-19 Thread Jon Meredith
I had a quick play with this. Mochijson2:encode returns an erlang I/O list. You can convert back to a proper binary with iolist_to_binary(). precommit_json_identity(Obj) -> Values = riak_object:get_values(Obj), {struct, TermList} = mochijson2:decode(hd(Values)), riak_object:apply_upda

Re: Riak Search Precommit Hook in 1.0

2011-09-20 Thread Jon Meredith
Hi Greg, This is a consequence of the changes we made to bucket properties to try and simplify a few configuration issues. I've filed a bug for it. https://issues.basho.com/show_bug.cgi?id=1216 Why does your hook need to go after the search hook? Cheers, Jon. On Mon, Sep 19, 2011 at 6:37 PM,

Re: System Limit Question

2011-09-20 Thread Jon Meredith
need to up the limit in vm.args. Cheers, Jon Meredith Basho Technologies. On Tue, Sep 20, 2011 at 2:13 PM, TJ Ninneman wrote: > On our RHEL servers I've been noticing a lot of: > > Failed to merge ... > {{badmatch,{error,system_limit}},[{bitcask,scan_key_files,3},{bitcask,&

Re: Performance Issues with LevelDB Backend on 1.0.0RC1

2011-09-26 Thread Jon Meredith
Hi Patrick, You may be running out of ports which erlang uses for TCP sockets - try increasing ERL_MAX_PORTS in etc/vm.args Cheers, Jon Basho Technologies. On Mon, Sep 26, 2011 at 12:17 PM, Patrick Van Stee wrote: > We're running a small, 2 node riak cluster (on 2 m1.large boxes) using the > Le

Re: Performance Issues with LevelDB Backend on 1.0.0RC1

2011-09-26 Thread Jon Meredith
ed to leveldb in there. Jon Meredith Basho Technologies. On Mon, Sep 26, 2011 at 12:37 PM, JB Smith wrote: > We are seeing similar issues using levelDB with 1.0.0RC1 > > We run a 6 way cluster on EC2 64bit micro instances. > > Initially we had assumed that there may be some iss

Re: Performance Issues with LevelDB Backend on 1.0.0RC1

2011-09-26 Thread Jon Meredith
c/riak/defaults and writes actually slowed down a little bit > (~10 less writes per second). Shouldn't the max_open_files setting keep the > total amount of fd's pretty low? Maybe I'm misunderstanding what that option > is used for. > > Patrick > > On Sep 26, 2011, at 2

Re: Keys out of sync

2011-09-27 Thread Jon Meredith
Hi Greg, What version of riak did you experience this with? Were the keys being created and deleted in cycles or were they one off create/deletes? Cheers, Jon Meredith Basho Technologies. On Tue, Sep 27, 2011 at 4:56 PM, Greg Pascale wrote: > Hi, > > I've got my riak ring in

Re: Delete takes 5 seconds in riak 1.0 ???

2011-10-03 Thread Jon Meredith
{error, notfound} when it has gone. If you wish to rewrite the key, you can use the returned vclock on a new object O = riakc_obj:set_vclock(riakc_obj:new(<<"b">>,<<<"k">>,<,"v">>), VClock) and it will overwrite the tombstone for y

Re: empty sibling after a DELETE then PUT

2011-10-05 Thread Jon Meredith
immediate} to the riak_kv section of your app.config Jon Meredith Basho Technologies. On Wed, Oct 5, 2011 at 1:13 PM, Eric Moritz wrote: > If I enabled allow_multi on a bucket and do I DELETE followed by a PUT > I am getting a 300 response with one sibling having the body of the > PUT a

Re: empty sibling after a DELETE then PUT

2011-10-06 Thread Jon Meredith
for empty bodies at the moment. I think it should be more explicit so I've filed a bug https://issues.basho.com/show_bug.cgi?id=1239 Best Regards, Jon Meredith Basho Technologies On Thu, Oct 6, 2011 at 1:14 PM, Eric Moritz wrote: > It seems to me that occasional tombstone siblings may

Details on new delete_mode setting introduced in 1.0.0

2011-10-12 Thread Jon Meredith
lete_mode, keep}, {delete_mode, immediate} or {delete_mode, DelayMsecs} to the riak_kv section of app.config (in /etc/riak, /opt/riak or etc/ depending on your platform). Jon Meredith Senior Software Engineer Basho Technologies ___ riak-users mailing l

Re: 1.0.2 soon?

2011-11-03 Thread Jon Meredith
--- > Anthony Molinaro > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > -- Jon Meredith Pl

Re: Durable writes and parallel reads

2011-11-03 Thread Jon Meredith
s, there will be some > parallellity even with serialized reads within each bitcask. > > Regards, > Erik Søe Sørensen > > > __**_ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/**mailman/listinfo/ri

Re: Riak crash on node restarts

2011-11-15 Thread Jon Meredith
uot;} > > If I manually restart the node, things go back to normal. Any ideas on > what's going on? I've attached the error log. > > -- > Jeremy > > ___ > riak-users mailing list > riak-users@lists.basho.com > http

Re: List keys and multiple buckets

2011-11-15 Thread Jon Meredith
ies > for these buckets. > > Kresten > > > Kind regards, > Izhar. > > _______ > riak-users mailing list > riak-users@lists.basho.com<mailto:riak-users@lists.basho.com > > > http://lists.basho.com/mailman/listinfo/r

Re: some really weird stuff with python client's delete...

2011-12-15 Thread Jon Meredith
it and always show the > exact same output... but if i open a separate python console and delete one > of these keys via the same method (create a client, get a bucket, get the > object via key, delete the object...), this will go down to 9 keys... > > What's wrong? I'm

Re: some really weird stuff with python client's delete...

2011-12-15 Thread Jon Meredith
ot bucket.get(key).exists()) print "Deleted %d keys!" % len(keys) On Thu, Dec 15, 2011 at 8:06 AM, Shuhao Wu wrote: > I'm trying to delete all the keys from the users bucket and the blog > bucket because they are all created by my doctests. I don't want these in >

Re: Absolute consistency

2012-01-10 Thread Jon Meredith
ed https://issues.basho.com/show_bug.cgi?id=1318 to track this. > > I don't have a workaround that I can think of offhand, unfortunately. > > Andrew > > ___ > riak-users mailing list > riak-users@lists.basho.com > http:

Re: Avoiding false concurrency in Riak

2012-02-21 Thread Jon Meredith
s Victor Fonte - Carlos Baquero HASLab / INESC TEC, Universidade do Minho, Portugal c...@di.uminho.pt http://gsd.di.uminho.pt/cbm ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com -- Jon Meredith Platform Engineering Manager Basho Technologies, Inc. jmered...@basho.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Issues with MapReduce in Riak 1.1.0

2012-02-24 Thread Jon Meredith
e to 1.1.0 if I am not using MapReduce? Yes. Issue Tracker https://github.com/basho/riak_kv/issues/293 -- Jon Meredith Platform Engineering Manager Basho Technologies, Inc. jmered...@basho.com ___ riak-users mailing list riak-users@lists.bash

Re: Issues with MapReduce in Riak 1.1.0

2012-02-27 Thread Jon Meredith
ons wrote: > I think I know the answer to this but would using a mix of 1.0.X and 1.1.0 > together cause the same MapReduce issue? > > On Fri, Feb 24, 2012 at 4:56 PM, Jon Meredith wrote: > >> Issues have been reported by users and customers with the MapReduce >> sub

Re: preflist_exhausted with map-reduce and riak-js

2012-03-13 Thread Jon Meredith
gt; > in the console. I haven't tried restarting riak, just because i'd rather > find out what's happening than it going away and coming back later when i > don't expect it. > > Any suggestions on how to troubleshoot this? I can still access items > individually and i can even list the keys via ?keys=true, i

Re: Possible handoff stalls

2012-03-19 Thread Jon Meredith
e contents of our console.log, erlang.log, error.log and > crash.log > from the relevant times if that is useful. > > Best Regards, > > Armon Dadgar > > > > _______ > riak-users mailing list > riak-use

Re: Possible handoff stalls

2012-03-20 Thread Jon Meredith
gs for the last time this occurred in my original email. >> >> I'll try to capture this information if the problem occurs again. >> Thanks. >> >> Best Regards, >> >> Armon Dadgar >> >> On Mar 19, 2012, at 11:36 AM, Jon Meredith wrote: >> >>

Re: preflist_exhausted with map-reduce and riak-js

2012-03-30 Thread Jon Meredith
== >> 2012-03-13 18:24:44.645 [error] <0.20949.24> CRASH REPORT Process >> <0.20949.24> with 0 neighbours crashed with reason: {sink_died,shutdown} >> 2012-03-13 18:24:44.652 [error] <0.175.0> Supervisor >> riak_pipe_builder_sup had child undefined star

Re: preflist_exhausted with map-reduce and riak-js

2012-04-02 Thread Jon Meredith
ap_js_vm_count' and > 'reduce_js_vm_count' > on the cluster to the values you suggested 24/18 and even larger ones 32/24 > and 128/128, but with no success - I still get the same error in the > console log of the node. > > What are we missing?! > > -Matthe

Re: preflist_exhausted with map-reduce and riak-js

2012-04-03 Thread Jon Meredith
t: false > status: running > heap_size: 987 > stack_size: 24 > reductions: 251 > neighbours: > 2012-04-02 15:16:56 =SUPERVISOR REPORT > Supervisor: {local,riak_pipe_builder_sup} > Context:child_terminated > Reason: {sink_died,shutdown

Re: preflist_exhausted with map-reduce and riak-js

2012-04-03 Thread Jon Meredith
ulticall(riak_kv_js_manager,pool_size,[riak_kv_js_reduce]). > {[0,0,0],[]} > > -Matthew > > > > On Tue, Apr 3, 2012 at 14:00, Jon Meredith wrote: > >> Hi Matthew, >> >> Thanks for the logs. Do you know how many map/reduce jobs you run >> conc

Re: Alternative to Post-Commit in EDS

2012-04-04 Thread Jon Meredith
-- > > Anthony Molinaro > > > > ___ > > riak-users mailing list > > riak-users@lists.basho.com > > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- > ----

Re: preflist_exhausted with map-reduce and riak-js

2012-04-04 Thread Jon Meredith
an extreme case as it was impossible to start any JS VMs as mapred_builtins.js is a required file that was missing from the system. Jon On Tue, Apr 3, 2012 at 5:56 PM, Jon Meredith wrote: > That's very interesting, you don't have any Javascript VMs running. Here's > an exa

Re: Issue with 2i

2012-05-01 Thread Jon Meredith
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > -- Jon Meredith Platform Engineering Manager Basho Technologies, Inc. jmered...@basho.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Reip(ing) riak node created two copies in the cluster

2012-05-02 Thread Jon Meredith
hats an elegant way to > recover from this mess? Would shutting off all the nodes, deleting the ring > directory, and again forming the cluster work? > > Cheers > Nitish > ___ > riak-users mailing list > riak-users@lists.basho.com &

Re: Reip(ing) riak node created two copies in the cluster

2012-05-02 Thread Jon Meredith
> "member_status" says that node 3 owns 0% of the ring and 0% are pending. > We have a lot of data - each node serves around 200 million documents. > Riak cluster is running 1.1.2. > Any suggestions? > > Cheers > Nitish > On May 2, 2012, at 5:31 PM, Jon Meredit

Re: Using SASL with Riak

2015-09-22 Thread Jon Meredith
Hi, Riak uses a logging library called lager that traps the output from SASL logging, so you should not need to set anything up. You can either apply the lager parse transform to your commit hook code and then you should be able to use lager:error/2, lager:warning/2, lager:info/2 to write to the

Re: riak 2.1.1 : Erlang crash dump

2015-10-01 Thread Jon Meredith
It looks like Riak was unable to allocate 4Gb of memory. You may have to reduce the amount of memory allocated for leveldb from the default 70%, try setting this in your /etc/riak/riak.conf file leveldb.maximum_memory.percent = 50 The memory footprint for Riak should stabilize after a few hours

Re: "Accumulator" convergent data type

2015-10-07 Thread Jon Meredith
Conceptually I think it should work - the same PN counter design could handle floats as well as integers. You'd have to make sure the P and N values only grew by handling the sign - if you want to add a negative float you would do N += abs(V). There are also concerns around error bounds and all th

Re: Node join not committed

2015-10-09 Thread Jon Meredith
Hi Daniel, It's perfectly safe to issue the cluster plan/commit steps. Joining the node gives it information about where data is located in the rest of the cluster and it will happily coordinate gets, but the new node will always forward put requests and will not store any data until you go throu

Re: Ownership handoff timed out

2015-10-26 Thread Jon Meredith
Hi, I suspect your {error,enotconn} messages are unrelated - that's likely to be caused by an HTTP client closing the connection while Riak looks up some networking information about the requestor. The max_concurrency message you are seeing is related to the handoff transfer limit - it should be

Re: Ownership handoff timed out

2015-10-27 Thread Jon Meredith
t;{data_root, "/var/lib/riak/leveldb"} >]}, >{be_blocks, riak_kv_bitcask_backend, [ >{data_root, "/var/lib/riak/bitcask"} >]} >]}, > > And for hosts with leveldb-only backend: > > {ri

Re: Pre-commit hook debug

2015-12-01 Thread Jon Meredith
Hi Geoff, Looks like the WM endpoint isn't handling that crash well. As for your precommit hook, the hook runs inside the server context so you'll need to use the riak_object module instead. riakc_obj is a cut-down version for use in the Erlang client. Jon On Tue, Dec 1, 2015 at 11:53 AM Geoff

Re: Riak pre-commit hook crashing unexpectedly

2015-12-07 Thread Jon Meredith
Does your signed_pb:decode_sign(Msg) function expect the binary to be in external term format? I would guess you probably want the direct value there without the term to binary - it should already be a binary. Is your hook expected to work with allow_mult=true, if so the get_metadata and get_val

Re: Core Claim and Property-Based Tests

2017-05-17 Thread Jon Meredith
Thanks for the excellent writeup. I have a few notes on your writeup and then a little history to help explain the motivation for the v3 work. The Claiming Problem One other property of the broader claim algorithm + claimant + handoff manager group of processes that's worth mentioning is saf

Re: Core Claim and Property-Based Tests

2017-05-18 Thread Jon Meredith
2, n3, n4, n5, n6, n7, n8, n4, n3, n2, n1, n8, n7, n6, > n5], 4). > 61.71428571428584 > > Neither can I think of a way of bettering this by improving claim v2. > However as mentioned in the long read, one of the issues with claim v3 > might be that rings with bad properties (such

Re: Using protobuf client in Java

2010-04-19 Thread Jon Meredith
Hi Matthew, When you read the serverInfoResp you need to read the header to find the length of the response message. The header is 5-bytes - 4-bytes of length and 1-byte of message code. You should just use the parseFrom calls - not the parseFromDelimited ones. Please excuse my java - I have

Re: Protocol buffer Vs BERT

2010-04-20 Thread Jon Meredith
Hi, For the first part - we used protocol buffers because we had requests for a PB interface from customers and as developers we have more experience using it on other projects. For the second part - I would recommend using the PB interface. It has about the same performance as riak_client

Re: Riak Erlang Client

2010-04-20 Thread Jon Meredith
Hi Dan, You're right - the documentation is woefully lacking. We'll try and improve it soon, the protocol itself has an entry on the wiki, but each of the clients need some too. For now your best best is to look at the unit tests at the end of riakc_pb_socket - that'll show you how you can

Re: Protobufs & HTTP

2010-04-20 Thread Jon Meredith
Hi Eric, For the HTTP interface to work correctly you need to supply a content type when you do your updated - if you add something like request.content.content_type = 'application/json' Then you should be in business. The python client at http://bitbucket.org/basho/riak-python-client i

Re: Help with protobuf (again)

2010-04-21 Thread Jon Meredith
Hi Matthew, The client ids used for get/set client ids are supposed to be opaque - at the moment they're 32-bit integers but I didn't want to tie the interface to that. There were two use cases for the call - if you wanted to keep the same client id across reconnects you could call get client

Re: riak.py has been removed?

2010-04-22 Thread Jon Meredith
Hi Mark, The python client received a significant refactor today thanks to Silas Sewell. It is now more pythonic and can be installed with a setup.py file. riak.py got moved into riak/__init__.py as part of that. I'm not sure what bitbucket is up to, but a clean pull worked for me. Jon On

Re: CAP controls

2010-05-13 Thread Jon Meredith
Hi Jeremy, If it were me I would start off with the simplest set up possible - one riak node per physical machine. It'll be easier to see what is going on and reason about performance if there are less moving parts. For the storage configuration - if you are using innostore then keep one for

Re: Updating metadata with Erlang PBC

2010-05-26 Thread Jon Meredith
Hi Mikl, Thanks for the test case - it's definitely a bug in the PB client. I'll file a bug for you and work on a fix as soon as I have a chance. Jon On 5/26/10 5:45 AM, Mikl Kurkov wrote: Hi! It seems that protobuffers client doesn't allow to update metadata of object. Example: -module

Re: Memory Utilization

2010-05-27 Thread Jon Meredith
Hi Jason/Sean, I'll chime in on this one. Embedded Inno uses exactly the same transactional logging as it does under MySQL so it should recover in the same way without needing any user intervention. The tools Sean mentioned can be used in dire circumstances (e.g. log files got overrun or do

Re: Error Installing Erlang Client

2010-06-07 Thread Jon Meredith
Hi Ted, You should just need the riak-erlang-client/ebin and the protobuffs library. Here's an example on my local machine. I just checked the docs and there's a mistake in there. The module you can test to see if you have it all set up correctly is riakc_pb_socket. jons-macpro:systest jm

  1   2   >