Having trouble setting up riak-cs using s3cmd to test

2019-04-23 Thread Greg Zoller
Any ideas what I'm doing wrong? Thanks, Greg ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Packagecloud.io issue

2015-04-02 Thread Greg Cymbalski
Alex- Turns out that there was an indexing issue with Packagecloud, which should be resolved now. Good news, no need to respin packages :) Thanks, —Greg On Apr 1, 2015, at 11:38 AM, Greg Cymbalski wrote: > Alex- > We’ve managed to reproduce that issue and are researching it n

Re: Packagecloud.io issue

2015-04-01 Thread Greg Cymbalski
Alex- We’ve managed to reproduce that issue and are researching it now. It does appear to be something in the package itself; not sure how that didn’t turn up until now. We’ll keep you updated. Thanks! —Greg On Mar 30, 2015, at 9:00 AM, riak-users-requ...@lists.basho.com wrote: > D

Re: Re: Questions about the Riak Horizontal Scalability

2014-03-11 Thread Greg Burd
d TCP/PB or HTTP/TCP traffic from basho_bench (clients communicating with the cluster), 2) for communication between nodes (disterl messages) and handoff. Also, make sure that the system running basho_bench is not also a Riak node. That'd skew results as well. -greg @gregburd | Basho T

Re: Has Riak 2.0 solved the leveldb delete key free disk space issue?

2013-11-12 Thread Greg Burd
it tested and integrated into the 2.0.0 release. -greg @gregburd | Basho Technologies | Riak | http://basho.com | @basho On Tue, Nov 12, 2013 at 12:21 PM, Matthew Von-Maszewski wrote: > Anita, > > The "aggressive delete" feature should be coded by the end of this week. &

Re: LMDB Backend for Riak

2013-05-21 Thread Greg Burd
t more and see what you think, maybe it could be awesome at some point in the future but there is a lot of hard work between here and there! best, -greg @gregburd | Basho Technologies | Riak | http://basho.com | @basho On Tue, May 21, 2013 at 4:54 AM, Matthew Von-Maszewski wrote: > Greg

Re: How to profile a cluster of Riak nodes

2012-08-09 Thread Greg Burd
thing being stressed and measured and so it should be given as much attention in your paper and in your preparation as anything else. best of luck, -greg On Aug 9, 2012, at 12:12 PM, Ryan Zezeski wrote: > Amir, > > Are you using one node to run basho bench? If so, have you tried ru

Re: How to process batch of events in N seconds after latest

2012-05-19 Thread Greg Burd
Max, This sounds a bit complex, what would need to happen if you didn't process an event (or batch of events) in time? What about using time-based expiry for your events which is supported by the Bitcask backend. You could use Multi-backend to setup a bucket that expires in N seconds. When

Re: erlang-http-client and riak::search

2012-05-11 Thread Greg
for a search/3 invocation instead of the SOLR query interface. > > Anyways, I'm supposed to be on vacation right now and not writing emails. If > you decide to write some pull-requests I'm happy to help with > questions/reviewing. Great, enjoy the remainder of your vac

Re: riak-python-client2, a rewrite of the official client

2012-03-16 Thread Greg Stein
On Thu, Mar 15, 2012 at 14:08, Armon Dadgar wrote: >> Message: 4 >> Date: Thu, 15 Mar 2012 11:13:03 -0400 >> From: Shuhao Wu >> To: "Andrey V. Martyanov" >> Cc: riak-users@lists.basho.com >> Subject: Re: riak-python-client2, a rewrite of the official client >> Message-ID: >>       >> Content-Ty

Re: riak-python-client2, a rewrite of the official client

2012-03-16 Thread Greg Stein
On Thu, Mar 15, 2012 at 11:13, Shuhao Wu wrote: >... > Erlang. In my client, a chunk of the code actually comes from the original > client as they work with a few adaptations. Yes, I noticed that you retain transports/connection.py, but why did you strip out all the comments?! That is definitely

Re: licenses (was Re: riakkit, a python riak object mapper, has hit beta!(

2012-03-04 Thread Greg Stein
Hey Andrey, I've spent well over a decade dealing with licensing issues. One thing that I've learned is that licensing is a personal choice and decision, and it is nearly impossible to alter somebody's philosophy. I find people fall into the GPL camp ("free software"), or the Apache/BSD camp ("per

Re: Python Client Thread Safe?

2012-02-27 Thread Greg Stein
jects to get access to Objects, and keep those per-thread. The underlying transport will manage multiple connections, persistently, in a thread-safe manner. (and I'm unclear on threading issues for the 1.3.0 python client) Cheers, -g On Mon, Feb 27, 2012 at 22:37, Greg Stein wrote: &g

Re: Python Client Thread Safe?

2012-02-27 Thread Greg Stein
IIRC, that error was seen when connecting to Riak 0.14.0. What version of Riak are you connecting to? I might also suggest using the current, unreleased Python client from the master branch on GitHub. It has much better support for threads and persistent connections. Just don't use variant client_

Re: Connection Pooling with the python-riak-client

2012-01-24 Thread Greg Stein
On Tue, Jan 24, 2012 at 12:34, Michael Clemmons wrote: > Greg, > Your amazing thanks.  In my application its failing on the start of the > application, I do not believe while trying to do a request but its possible > let me grok and get back to you with some trace backs. Sounds

Re: Connection Pooling with the python-riak-client

2012-01-23 Thread Greg Stein
On Fri, Jan 20, 2012 at 15:53, Michael Clemmons wrote: >... > I've decided to go back and cleanup that approach and reapply it to the > current master branch.  To my surprise I found that the ConnectionManager > supports multiple connections and has the tools to add and remove them. > Looking at t

Re: basho_bench and custom key and value generators

2012-01-03 Thread Greg Bowyer
Again thanks, that worked like a charm I was able to get everything hooked up today On 03/01/12 11:12, Greg Bowyer wrote: Ah awesome that makes a lot of sense thank you ! On 02/01/12 18:16, Dan Reverri wrote: Hi Greg, I threw together a quick example using a custom function for key and

Re: basho_bench and custom key and value generators

2012-01-03 Thread Greg Bowyer
Ah awesome that makes a lot of sense thank you ! On 02/01/12 18:16, Dan Reverri wrote: Hi Greg, I threw together a quick example using a custom function for key and value generation here: https://gist.github.com/1553109 Let me know if you have any questions. Thanks, Dan Daniel Reverri

basho_bench and custom key and value generators

2011-12-29 Thread Greg Bowyer
-- Greg ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: ad-hoc queries

2011-12-02 Thread Greg Pascale
Hey Francisco, I find myself doing this fairly often - mainly through curl. Definitely room for improvement there... -- Greg Clipboard On Friday, December 2, 2011 at 5:39 AM, francisco treacy wrote: > Hi riak-users, > > I just tweeted this... but here is probably the best pla

Re: Secondary Indexes - Feedback?

2011-12-01 Thread Greg Pascale
it's quite fast. Yes, the results are ordered in the index, but that doesn't matter to the user. The API states result ordering is undefined. -- Greg Clipboard On Wednesday, November 30, 2011 at 3:05 PM, Elias Levy wrote: > On Wed, Nov 30, 2011 at 1:32 PM, (mailto:riak-users-requ...@

Re: Secondary Indexes - Feedback?

2011-11-30 Thread Greg Pascale
ingle-term queries, but creates huge hotspots making many AND queries prohibitively expensive. 2I's document-based partitioning makes single-term queries more expensive (coverage set) but should allow AND queries to scale. But 2i only supports single-term queries! -- Greg Clipboard

Re: Luwak PUT Content-Range

2011-11-29 Thread Greg Stein
On Nov 29, 2011 5:08 AM, "John Axel Eriksson" wrote: > > Is it possible to incrementally add to a file in Luwak using PUT and the Content-Range header. I just assumed that it was but I can't seem to > get the expected results, it just overwrites whatever the key contents were before. The reason I

Re: Problem installing Riak Python client

2011-11-10 Thread Greg Stein
On Nov 10, 2011 4:26 PM, "Nate Lawson" wrote: > > > On Nov 10, 2011, at 4:04 PM, Greg Stein wrote: > > > On Thu, Nov 10, 2011 at 11:51, Nate Lawson wrote: > >> ... > >> BTW, are there any plans for the Riak python client to use the protobuf

Re: Problem installing Riak Python client

2011-11-10 Thread Greg Stein
On Thu, Nov 10, 2011 at 11:51, Nate Lawson wrote: >... > BTW, are there any plans for the Riak python client to use the protobuf C > library directly via ctypes? The pure python implementation of protobuf seems > a little slow. Not that I've seen. I plan to use the HTTP interface because I can

Re: 2i for single-result lookup

2011-11-08 Thread Greg Pascale
e significance of this overhead is what I'm really trying to evaluate. -- Greg Clipboard On Monday, November 7, 2011 at 8:38 PM, Antonio Rohman Fernandez wrote: > Instead of using 2i, you could do the following when saving: > > POST http://{IP}:8098/riak/users/rohman &

Re: 2i for single-result lookup

2011-11-07 Thread Greg Pascale
If one fails, I need to delete the others, etc… It quickly becomes a pain. I don't know what you mean by "some relationship between the keys" -- Greg Clipboard On Monday, November 7, 2011 at 5:59 PM, Nate Lawson wrote: > On Nov 7, 2011, at 5:45 PM, Greg Pascale wrote: >

2i for single-result lookup

2011-11-07 Thread Greg Pascale
n't intuitively feel like the right tool here, but I wonder if it may actually be preferable since it uses term-based partitioning. Thanks, -- Greg Clipboard ___ riak-users mailing list riak-users@lists.basho.com http://lists.b

Re: key garbage collection

2011-11-03 Thread Greg Stein
On Thu, Nov 3, 2011 at 02:39, Justin Karneges wrote: >... > Say you have an operation that requires creating two keys, A and B, and you > succeed in creating A but fail in creating B.  How do you delete A after the > fact?  I have two ideas: > > 1) Run periodic MapReduce operations that do full db

Improved capacity planning for Bitcask deployments

2011-10-20 Thread Greg Burd
A while ago on this list Nico Meyer did an amazingly detailed job of examining the overhead required when storing data in Riak using Bitcask (http://lists.basho.com/pipermail/riak-users_lists.basho.com/2011-May/004292.html). That post inspired me to redo our wiki page, which I just published a

Re: Hey, Python client users

2011-10-20 Thread Greg Stein
On Oct 20, 2011 7:44 AM, "Russell Brown" wrote: >... > I had a chat with Reid Draper about it (he is much more pythonic than me), he concurs. I just need to do a bit more reading through the code, and unless anyone here objects (anyone? class? anyone?), I'll start work at merging your fork into th

Re: Hey, Python client users

2011-10-20 Thread Greg Stein
On Oct 18, 2011 11:12 AM, "Greg Stein" wrote: >... > The short answer: my branch puts connection management into the > transport, and Brett's patches puts that into the client. A decision > needs to be made, and that will determine future work. I've previously &

Re: Hey, Python client users

2011-10-18 Thread Greg Stein
On Tue, Oct 18, 2011 at 10:53, Soren Hansen wrote: > 2011/10/16 Greg Stein : >> Anyhow, enough description. If you're using Python, then I'd highly >> recommend: >>  https://github.com/gstein/riak-python-client/tree/proper >> >> I hope that helps, a

Re: Hey, Python client users

2011-10-18 Thread Greg Stein
On Mon, Oct 17, 2011 at 15:13, Russell Brown wrote: > > On 16 Oct 2011, at 06:18, Greg Stein wrote: > >> Hey all, >> >> The Basho folks have been slow to integrate changes, given their busy >> schedule with the 1.0 release. > > This is true. Sorry. But we ar

Hey, Python client users

2011-10-15 Thread Greg Stein
Hey all, The Basho folks have been slow to integrate changes, given their busy schedule with the 1.0 release. I've had a couple branches hanging out for a while to deal with HTTP problems and to deal with Issue #53. They've been separate for better review/merging by Basho, but it finally created t

Re: Riak Search 1.0 Bug - Inline Fields

2011-10-06 Thread Greg Pascale
Sounds good. Thanks for looking into this, Rusty. -- Greg Clipboard On Thursday, October 6, 2011 at 2:34 PM, Rusty Klophaus wrote: > Hi Greg, > > Did some investigation into this issue. This is indeed a bug introduced in > 1.0. > > Specifically, it affects filtering on

Re: Riak Search 1.0 Bug - Inline Fields

2011-10-06 Thread Greg Pascale
Anybody have any ideas on this one? I was able to deploy a workaround, but it involved some ugly special case logic in my search code. Also, the last example should say "crashes", not "times out". It returned with that error immediately. -- Greg Clipboard On Wednesday

Riak Search 1.0 Bug - Inline Fields

2011-10-05 Thread Greg Pascale
out (should return 1 result) search-cmd search clips 'ctime:(98682333448084)' 'ctime:(98682333448084)' :: Searching for 'ctime:(98682333448084)' / 'ctime:(98682333448084)' in clips... -- :: ERROR: {badarg,[{lists,member,[<<&qu

Re: Have Riak servers in separate cluster behind a load balancer, or on same machines as web server?

2011-10-04 Thread Greg Stein
P > setup/teardown latency at either end of a request. In read-write heavy > apps, protobufs outperforms HTTP in throughput by 2x or more, against > objects of 500-4000 bytes. That's with the ruby client; ymmv. > > --Kyle > > On 10/04/2011 07:18 PM, Greg Stein wrote: >

Re: Have Riak servers in separate cluster behind a load balancer, or on same machines as web server?

2011-10-04 Thread Greg Stein
On Oct 4, 2011 7:01 PM, "Mike Oxford" wrote: > > You'll want to run protobufs if you're looking to optimize your > response time; HTTP sockets (even to localhost) will require much more > overhead and time. Hmm? The protocol seems moot, compared to inter-node comms when r > 1. Protocol parsing ju

Re: Have Riak servers in separate cluster behind a load balancer, or on same machines as web server?

2011-10-04 Thread Greg Stein
On Oct 4, 2011 7:04 PM, "Mike Oxford" wrote: > > On Tue, Oct 4, 2011 at 3:59 PM, Greg Stein wrote: > > Regarding security: it is the same for option A and B and C (you're > > just shifting stuff around, but it is pretty much all the same). Put > > your we

Re: Have Riak servers in separate cluster behind a load balancer, or on same machines as web server?

2011-10-04 Thread Greg Stein
I'm with Kyle on this one. Even better, my 'newhttp' branch on Github enables this kind of multiple-connection and automatic fail-over. That branch does have a basic sketch for automatic addition/removal of Riak nodes as you manipulate your cluster. I'll need it one day, but not "now", so I haven'

Re: Running the python client's test suite

2011-10-03 Thread Greg Stein
Your search/luwak tests are failing, presumably because those options are not enabled in your Riak installation. You can disable them in the test suite by doing: $ SKIP_SEARCH=1 SKIP_LUWAK=1 python setup.py test You also seem to be running into a problem with leftover keys in one of the test buck

Re: Custom Extractor Syntax

2011-10-03 Thread Greg Pascale
Good to know, thanks. Upvote for being able to unset properties over HTTP. We don't deploy erlang in production and rely on curl to set all our properties, so that'd be great for us. -- Greg Clipboard On Sunday, October 2, 2011 at 8:11 PM, Ryan Zezeski wrote: > Greg, >

Re: script erlang contrib function

2011-10-03 Thread Greg Pascale
Hey Francisco, If what you're looking to do is connect to Riak in Erlang without having to run 'riak attach', try this little bit of magic. http://www.clipboard.com/clip/LR04fvr5rXWvT__G The value for "cookie" will be "riak" unless you've changed it.

Custom Extractor Syntax

2011-09-30 Thread Greg Pascale
and module. The old rs_extractfun syntax still seems to work with 1.0, but I'm wondering if I should switch over the new style to stay compatible with future releases. This also brings up an interesting question - how do I unset a bucket property? -- Greg Clip

Re: Keys out of sync

2011-09-28 Thread Greg Pascale
he state I described. Thanks -- Greg Clipboard On Tuesday, September 27, 2011 at 4:12 PM, Jon Meredith wrote: > Hi Greg, > > What version of riak did you experience this with? Were the keys being > created and deleted in cycles or were they one off create/deletes? > &

Keys out of sync

2011-09-27 Thread Greg Pascale
shed some light on how I might have gotten into this state and how I can get out. -- Greg Clipboard ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Anyone going to Surge?

2011-09-25 Thread Greg Stein
I'll be there Wednesday/Thursday. Not attending the conference itself, but "around" (hanging in the hallway or the bar). On Sun, Sep 25, 2011 at 20:00, Mark Phillips wrote: > I mentioned this in Friday's Recap but I figured it was worth asking > again: anyone going to Surge [1] next week? I'll be

Re: Riak Search Precommit Hook in 1.0

2011-09-21 Thread Greg Pascale
Got it. Sounds like what I want to do is set search to true and also explicitly add the riak_search_kv_hook at the end of the precommit list. Thanks for all the help. -- Greg Clipboard On Wednesday, September 21, 2011 at 2:30 PM, Dan Reverri wrote: > One more correction, the "

Re: Riak Search Precommit Hook in 1.0

2011-09-21 Thread Greg Pascale
A few questions 1) Is this fix in the RC1 build that just came out today? 2) How exactly do search-cmd install, the "search" bucket property and the precommit hook fit together now? I'm a bit unclear on what I actually need to do to enable search on a bucket. Thanks. -- Gre

Re: Riak Search Precommit Hook in 1.0

2011-09-20 Thread Greg Pascale
Man, it took a whole day after I complained about this to get it fixed? You guys are such slackers! :) Thanks a bunch! -- Greg Clipboard On Tuesday, September 20, 2011 at 1:47 PM, Andrew Thompson wrote: > On Tue, Sep 20, 2011 at 10:53:28AM -0700, Greg Pascale wrote: > &g

Re: Riak Search Precommit Hook in 1.0

2011-09-20 Thread Greg Pascale
to be the largest part) and has given us substantial perf gains in our tests. -Greg Clipboard On Sep 20, 2011, at 7:54 AM, Jon Meredith wrote: > Hi Greg, > > This is a consequence of the changes we made to bucket properties to try and > simplify a few configuration issues. I

Riak Search Precommit Hook in 1.0

2011-09-19 Thread Greg Pascale
eems to be impossible now. Prior to 1.0, I could just issue the command *curl -X PUT -d '{"props":{"precommit":[{"mod":"riak_search_kv_hook","fun":"precommit"}, {}]}}' * to install the hooks in the right order. -- Greg Clipbo

Re: Precommit Hook Difficulties

2011-09-19 Thread Greg Pascale
Awesome, thanks. -Greg Clipboard On Sep 19, 2011, at 12:53 PM, Jon Meredith wrote: > I had a quick play with this. Mochijson2:encode returns an erlang I/O list. > You can convert back to a proper binary with iolist_to_binary(). > > precommit_json_identity(Obj) -&g

Re: Precommit Hook Difficulties

2011-09-19 Thread Greg Pascale
Thanks, I was able to work around the issue by using regexes to do string replacement, thereby avoiding decoding and encoding JSON, but it would be nice to know what was going wrong here. -Greg Clipboard On Sep 19, 2011, at 11:44 AM, Sean Cribbs wrote: > Greg, > > Your general

Re: Precommit Hook Difficulties

2011-09-19 Thread Greg Pascale
Scratch that - the issue doesn't actually manifest without the decode/encode. On Mon, Sep 19, 2011 at 10:47 AM, Greg Pascale wrote: > Actually it looks like I can remove the JSON decode/encode and I still see > the same issue. Just reading and writing the value is enough, so all I&#x

Re: Precommit Hook Difficulties

2011-09-19 Thread Greg Pascale
_updates(* * riak_object:update_value(RiakObject, Value)).* I'm really baffled here. The only documentation I know of for this code is at http://basho.github.com/riak-erlang-client/riak-erlang-client/riakc_obj.html and it really doesn't say much. -Greg Clipboard On Sat, Sep 17, 2011 at 4:11 PM, G

Precommit Hook Difficulties

2011-09-17 Thread Greg Pascale
= riak_object:get_value(RiakObject),* *{struct, TermList} = mochijson2:decode(Value),* *riak_object:apply_updates(* * riak_object:update_value(RiakObject, * * mochijson2:encode({struct, TermList}))). * Can anybody point out what

Re: [RFC] Python client: move to properties

2011-09-15 Thread Greg Stein
On Wed, Sep 14, 2011 at 10:40, Russell Brown wrote: > > On 14 Sep 2011, at 12:37, Mathias Meyer wrote: > >> The short answer: yes, we can and we should. I had that on my radar for a >> while too, because it felt un-Pythonic. >> >> As for deprecation, there's no specific rule for the Python client

[RFC] Python client: move to properties

2011-09-14 Thread Greg Stein
Hi all, There are some non-Pythonic patterns in riak-python-client that should be pretty easy to switch. Things like client.get_r() and client.set_r() are kinda silly. Python long ago moved past the getter/setter paradigm, with the notion of directly exposing instance attributes. As Guido has said

Question about Content-Type

2011-09-10 Thread Greg Stein
Hey all, I just ran into a questionable situation. On the following doc page: http://wiki.basho.com/HTTP-Store-Object.html It says: " Important headers: Content-Type must be set for the stored object. Set what you expect to receive back when next requesting it. " So I ran the following test v

Re: Python transports

2011-09-10 Thread Greg Stein
Hi all, I've been putting more thought into this problem, particularly in contrast to the "client manages N transport [connections]." I believe that the latter is not very workable given the variance in underlying transports. Not enough information is available to the client to manage the connecti

Re: Python transports

2011-09-08 Thread Greg Stein
o your changes make anything new possible or are they just about cleanup? > > > > On Thu, Sep 8, 2011 at 5:17 AM, Greg Stein wrote: >> Yup, agreed. I can certainly see use-cases where a client may have >> particular knowledge about data/server locality, and wants to open >

Re: Riak 1.0 pre-release series

2011-09-08 Thread Greg Stein
ut the lack of a source package, that was my oversight.   I just > uploaded one to downloads.basho.com. > Thanks for the feedback, > -Jared > On Thu, Sep 8, 2011 at 5:52 AM, Greg Stein wrote: >> >> On Thu, Sep 8, 2011 at 07:47, David Smith wrote: >> > On Thu, Sep

Re: Python transports

2011-09-08 Thread Greg Stein
e ring for > particular operations is the best practice. But it may be necessary to do so > in order to validate and do certain types of testing to prove or disprove > certain access patterns. > -phil > > On Thu, Sep 8, 2011 at 7:31 AM, Greg Stein wrote: >> >> Hey, all

Re: Riak 1.0 pre-release series

2011-09-08 Thread Greg Stein
On Thu, Sep 8, 2011 at 07:47, David Smith wrote: > On Thu, Sep 8, 2011 at 5:41 AM, Greg Stein wrote: > >> I just checked out the link (provided below) and did not find a >> *source* distribution. Could you work that into the distribution? > > Yes, there should be one of

Re: Riak 1.0 pre-release series

2011-09-08 Thread Greg Stein
On Wed, Sep 7, 2011 at 19:24, David Smith wrote: >... > The first stage is "pre-release" (aka PR) builds that represent the > feature-complete Riak 1.0, with minor cleanup and tweaks still > ongoing. You WILL find some rough edges with packaging and the > features -- we're still working through th

Python transports

2011-09-08 Thread Greg Stein
Hey, all... After a couple comments on my recent work, and some archaeology on the Python/Riak work over the past month... I've realized that I might have a very different view of RiakTransport compared to what I'm seeing in the current work. I figured it best to bring that to the forefront and di

Re: Review request: revamped http transport

2011-09-07 Thread Greg Stein
On Wed, Sep 7, 2011 at 20:42, Brett Hoerner wrote: > Greg, can you make a Github pull request from your branch? > > It'd be easier to review the commits together (well, git log is easy) > but more importantly comment in-line. Done: https://github.com/basho/riak-python-client/pul

Review request: revamped http transport

2011-09-07 Thread Greg Stein
Hi all, I've got a rough first cut of a modified RiakHttpTransport class. You can review it here: https://github.com/gstein/riak-python-client/commits/newhttp (note that it includes changes from my 'relax-deps' and 'simplify' branches; just look at the most recent commit(s)) This code has bee

Re: incorrect link, or missing download

2011-09-05 Thread Greg Stein
1 or 0.14.2.   OSX packaging has been added to riak mainline now > though, so all future releases will be built for OSX.   For now, you can > produce your own binaries in the way I mentioned above. > Sorry for the inconvenience and confusion. > -Jared > > On Mon, Sep 5, 2011 at 8

incorrect link, or missing download

2011-09-05 Thread Greg Stein
Hello, I went to download Riak for Mac OS, and started to follow the instructions on: http://wiki.basho.com/Installing-on-Mac-OS-X.html It says to download: http://downloads.basho.com/riak/riak-0.14/riak-0.14.2-osx-i386.tar.gz However, that resource does not exist. There is only 0.14.0: ht

Re: Python client: three issues

2011-09-05 Thread Greg Stein
On Mon, Sep 5, 2011 at 16:14, Mark Phillips wrote: >... > I just wanted to jump in here and reiterate that patches, issues, and > opinions about how the python code works/should work are all > encouraged. Mathias Meyer and Jared Morrow (among others) have been > handling issues, pull requests, rel

Re: more Python client questions

2011-09-05 Thread Greg Stein
ving the static values? > (just curious)* > > <http://www.loomlearning.com/> > Jonathan Langevin > Systems Administrator > Loom Inc. > Wilmington, NC: (910) 241-0433 - jlange...@loomlearning.com - > www.loomlearning.com - Skype: intel352 > * > > > On Mo

more Python client questions

2011-09-05 Thread Greg Stein
I've got a couple more questions: 1. Why is "pycurl" used in the http transport? What benefits does it offer? Based on reading the code, I see no additional functionality, so I don't understand why this complexity exists. I'd like to submit a changeset that just removes it, but would like to under

Re: Python client: three issues

2011-09-05 Thread Greg Stein
On Sun, Sep 4, 2011 at 22:12, Brett Hoerner wrote: > On Sun, Sep 4, 2011 at 7:05 PM, Greg Stein wrote: >> 1. I'd like Riak to generate keys for some of my objects, and I'm >> using the HTTP API. Pretty simple: do a POST, and the Location: header >> will tell me t

Python client: three issues

2011-09-04 Thread Greg Stein
Hi all, I'm digging into Riak, and its Python client. I've discovered several issues and would like to provide feedback and get some input, please. 1. I'd like Riak to generate keys for some of my objects, and I'm using the HTTP API. Pretty simple: do a POST, and the Location: header will tell me

Re: riak_search: custom extractor syntax

2011-07-19 Thread Greg Pascale
invoke_hook,4}, {riak_kv_put_fsm,precommit,2}] -Greg On Mon, Jul 18, 2011 at 6:22 PM, Greg Pascale wrote: > Hi, > > I'm trying to use a custom extractor, but I can't for the life of me seem > to get the syntax right. Even the simplest thing I can think to try won't > wor

riak_search: custom extractor syntax

2011-07-18 Thread Greg Pascale
t;>, [{rs_extractfun, {jsanon, <<"function(){return{'name':'greg', 'login':'gpascale'};}">>}}]). > Client:set_bucket(<<"extractTest">>, [{rs_extractfun, {jsanon, {<<"extractors">>, <&l

Re: riaksearch performace when numFound is high

2011-07-15 Thread Greg Pascale
we are seeing, it's clear that we'll start to hit these limits. We have a lot of #2 type queries because we support full text search, and unfortunately our "text" tends to be a lot longer than 140 characters, so I really don't think inlining it is practical. -- Greg Cl

Re: riaksearch performace when numFound is high

2011-07-14 Thread Greg Pascale
e twitter clone. In my system, tweets have a user, text, date and can be either public or private - so one might look like { username: greg, public: true, text: "I bought a new guitar!", date: 07/14/11 } Let's say that my service is popular - I have 100k users, each of

riaksearch performace when numFound is high

2011-07-06 Thread Greg Pascale
I simply expecting too much of riaksearch here, or is there a way to make this work? If all else fails, I suppose I could divide my data into more buckets, but I'm hoping to avoid that as it would make querying much more complex. Thanks, -Greg

Re: riak-search numFound incorrect

2011-06-30 Thread Greg Pascale
Hi Ryan, 1) I *think *so. 2) Not that I can remember. -Greg On Wed, Jun 22, 2011 at 5:32 PM, Ryan Zezeski wrote: > Hi Greg, > > Two questions: > > 1. Was this count normally correct _before_ upgrading to 14.2? > > 2. Have you performed a direct delete (e.g. via curl) of

Re: Deleting Keys vs. Specifying a Null Value for a Key

2011-06-23 Thread Greg Nelson
Something to keep in mind here -- which I don't think has been mentioned yet -- is the interplay with Bitcask. One may want to *actually* delete the key rather than store application-defined tombstones to keep from accumulating entries in Bitcask's in-memory keydir. On Thursday, June 23, 2011 a

Re: Riak crash on 0.14.2 riak_kv_stat terminating

2011-06-20 Thread Greg Nelson
I see this from time to time on our production 5-node cluster, with no indications of any other problems. And I'm certain it's not a memory or disk issue. On Sunday, June 19, 2011 at 6:01 PM, Jeremy Raymond wrote: > Actually it's a bit later on where I see this: > > = Fri Jun 17 16:26:46 E

Re: Problem with deleting keys

2011-06-16 Thread Greg Nelson
In 0.14, would it be reasonable for the application to write its own special tombstone marker while at the same time setting an expiry time (== now) on the object? (Assuming bitcask backend...) On Thursday, June 16, 2011 at 10:24 AM, Andrew Thompson wrote: > On Thu, Jun 16, 2011 at 09:24:28AM -

Re: Problem with deleting keys

2011-06-16 Thread Greg Nelson
...you shrug, replace it with a new one, and then trigger read-repair on all keys that were on the node, then go about your business. ;-) On Thursday, June 16, 2011 at 10:23 AM, Nico Meyer wrote: > I don't see any reason to only restore one node of your cluster. > That is the whole point of a re

Re: Problem with deleting keys

2011-06-16 Thread Greg Nelson
"A tombstone is put and then an async get is fired off and if the async get finds all the primary nodes in the preflist are up, it does the delete. If not, the next time the key is fetched, it does the same check again and will do the delete then if the downed node is up." What if the key is never

Re: Problem with deleting keys

2011-06-16 Thread Greg Nelson
Well, it is kind of Riak specific. An implementation that treated DELETEs like PUTs (tombstones w/ vector clocks for ordering), then this would not be an issue, right? When no primary nodes are down, the tombstones can be physically deleted on the backend. A logical delete could never reappear i

Re: Problem with deleting keys

2011-06-15 Thread Greg Nelson
describing David *could* very well be a different issue, in which case apologies for the distraction! -Greg On Wednesday, June 15, 2011 at 3:55 PM, David Mitchell wrote: > Erlang: R13B04 > Riak: 0.14.2 > > I have a three node cluster, and while one node was down, I deleted every key > in

riak-search numFound incorrect

2011-06-13 Thread Greg Pascale
, numFound comes back as 114. I thought numFound was supposed to return the number of matched documents, disregarding start and count. Am I misunderstanding something or is this a bug? Thanks -Greg ___ riak-users mailing list riak-users@lists.basho.com

Re: Waiting for 'backend' bucket property to take effect

2011-06-10 Thread Greg Nelson
those buckets don't have properties that accumulate in the ring state, and we avoid the gossip lag problem altogether. What do you think? -Greg On Friday, June 10, 2011 at 6:50 AM, Sean Cribbs wrote: > Greg, > > Yes, it is most likely gossip lag causing that. For your test clus

Waiting for 'backend' bucket property to take effect

2011-06-09 Thread Greg Nelson
subtle. Is there a good way for a client to know when the property has been gossiped to all the nodes? Seems like the only approach is to wait a bit after setting a property before doing a PUT... Also, does this sound right? It's very possible I'm wrong about what's causing this

Re: Store whole database in memory

2011-05-28 Thread Greg Nelson
el McClain wrote: > Thank you, Mike and Greg, for the response. > I've just replied to the list. > In my use case, I need to be able to write 100,000 keys per second. Where the > key is very small (12 bytes). And I always insert 1000 keys at once, in a > bulk insert. I would a

Re: Store whole database in memory

2011-05-27 Thread Greg Nelson
Michael, You might want to check out riak_kv_ets_backend, riak_kv_gb_trees_backend, and riak_kv_cache_backend. http://wiki.basho.com/Configuration-Files.html -Greg On Friday, May 27, 2011 at 10:35 PM, Michael McClain wrote: > Hi, > > Is it possible to store the whole database

Re: riaksearch: using index docs in place of real objects

2011-05-26 Thread Greg Pascale
Eric, I believe the key is the document id, which will be the same as the key of the corresponding object in . -Greg On Thu, May 26, 2011 at 12:41 PM, Eric Moritz wrote: > Out of curiosity what is the key in this URL? > http://riak.host:8098/riak/_rsid_/key > > On Thu, May 26, 201

Re: Riak doesn't use consistent hashing

2011-05-26 Thread Greg Nelson
ur client to tell the difference between a real "not found" and one where r was not satisfied. And a further out release will have a proper fix for this whole issue. Probably involving forwarding of requests to old owners in cases where the handoff hasn't finished. -Greg On Thursda

Re: Riak doesn't use consistent hashing.

2011-05-26 Thread Greg Nelson
Excellent. Let me know what I can do to help. -Greg On Thursday, May 26, 2011 at 7:37 AM, Justin Sheehy wrote: > Hi, Greg. > > Thanks for your thoughtful analysis and the pull request. > > On Thu, May 26, 2011 at 1:54 AM, Greg Nelson wrote: > > > However, the sk

Riak doesn't use consistent hashing

2011-05-25 Thread Greg Nelson
ut I want to make sure there aren't other invariants or considerations I'm leaving out -- besides maintaining target_n_val, keeping optimal partition spread, and minimizing handoff between ring states. -Greg ___ riak-users mai

  1   2   >