Is Riak right for me?

2011-02-11 Thread Mike Stoddart
Riak is very appealing for several reasons; scalability, durability, open-source, performance etc. I'm currently using PostgreSQL for all my storage needs, but I'm investigating nosql (can I use that name?) solutions for scalability and to experiment with map/reduce functionality for statistics and

Re: Is Riak right for me?

2011-02-11 Thread Mike Stoddart
gt; replication factor (N value, default 3). > > Let us know if there's anything else we can help you with. > > Sean Cribbs > Developer Advocate > Basho Technologies, Inc. > http://basho.com/ > > On Feb 11, 2011, at 8:49 AM, Mike Stoddart wrote: > >> Riak is very

Riak compile error on Fedora 12 (32 bit)

2011-02-11 Thread Mike Stoddart
I'm trying to compile Riak on Fedora 12 (32 bit) but I'm getting an error: make rel fatal: Not a git repository (or any of the parent directories): .git ./rebar get-deps fatal: Not a git repository (or any of the parent directories): .git fatal: Not a git repository (or any of the parent directori

Re: Riak compile error on Fedora 12 (32 bit)

2011-02-11 Thread Mike Stoddart
Thanks David, I already had erlang-inets installed. I even tried reinstalling it but it didn't make any difference. Mike On Fri, Feb 11, 2011 at 9:39 PM, David Smith wrote: > On Fri, Feb 11, 2011 at 6:05 PM, Mike Stoddart wrote: >> I'm trying to compile Riak on Fedora

Re: Riak compile error on Fedora 12 (32 bit)

2011-02-12 Thread Mike Stoddart
and build an RPM this evening: http://dl.dropbox.com/u/2596651/riak-0.14.0.18.gce2ab2c-1.fc13.i686.rpm Maybe that works better? Or is at least functional? :) D. On Fri, Feb 11, 2011 at 7:43 PM, Mike Stoddart <sto...@gmail.com> wrote: > Thanks David, I already had erlang

Re: Riak compile error on Fedora 12 (32 bit)

2011-02-12 Thread Mike Stoddart
On Sat, Feb 12, 2011 at 7:33 AM, Mike Stoddart <sto...@gmail.com> wrote: > Thanks. It's an FC13 RPM so I don't know if it will work on FC12 but I'll > try it tomorrow night. > > Thanks > Mike > > > > -- Sent from my Palm Pre > ___

Re: Riak compile error on Fedora 12 (32 bit)

2011-02-12 Thread Mike Stoddart
t, Feb 12, 2011 at 7:33 AM, Mike Stoddart wrote: >> Thanks. It's an FC13 RPM so I don't know if it will work on FC12 but I'll >> try it tomorrow night. >> >> Thanks >> Mike >> >> >> >> -- Sent from my Palm Pre >> __

Python client performance issue

2011-02-14 Thread Mike Stoddart
I added some code to my system to test writing data into Riak. I'm using the Python client library with protocol buffers. I'm writing a snapshot of my current data, which is one json object containing on average 60 individual json sub-objects. Each sub object contains about 22 values.

Re: Python client performance issue

2011-02-14 Thread Mike Stoddart
it could possibly be related to the fact that python protocol buffers > is extraordinarily slow and is well known to be slow. Profile until proven > guilty though. > Tom Burdick > > On Mon, Feb 14, 2011 at 7:09 AM, Mike Stoddart wrote: >> >> I added some code to my system

Riak instead of memcached?

2011-02-16 Thread Mike Stoddart
I was thinking of using memcached for cheap, fast storage to share between servers. I need to store stuff like user preferences, permissions, session etc. But memcached (I think) requires you to define which servers you want to use for storage. Ideally I don't care. I want my core/auth server to wr

Re: Riak instead of memcached?

2011-02-16 Thread Mike Stoddart
> never going to be as fast for caching as an in-memory only store that > doesn't have to do coordination.  That said if your data set is larger > than RAM, Riak will likely be faster as it will scale to handle that > better. > > -J > > On Wed, Feb 16, 2011 at 5:33

Re: Riak instead of memcached?

2011-02-16 Thread Mike Stoddart
b 17, 2011 at 11:33 AM, Mike Stoddart wrote: >> I was thinking of using memcached for cheap, fast storage to share >> between servers. I need to store stuff like user preferences, >> permissions, session etc. But memcached (I think) requires you to >> define which server

riak-search build assumes access to github using 'git' protocol

2011-02-17 Thread Mike Stoddart
I'm trying to build riak-serach at work but our corporate firewall blocks the 'git' protocol. I can only download via http or https. I've tried changing rebar.config to use the URLs for https instead but I get errors: fatal: Not a git repository (or any of the parent directories): .git Any ideas

Re: riak-search build assumes access to github using 'git' protocol

2011-02-17 Thread Mike Stoddart
mpile > ./rebar rel > And that should build the release in rel/riak > BR, Jon. > > On Thu, Feb 17, 2011 at 9:57 AM, Mike Stoddart wrote: >> >> I'm trying to build riak-serach at work but our corporate firewall >> blocks the 'git' protocol. I can on

Re: Riak compile error on Fedora 12 (32 bit)

2011-02-17 Thread Mike Stoddart
day and it _seemed_ to work fine. > But that was hardly a rigorous test... :) > > D. > > On Sat, Feb 12, 2011 at 7:33 AM, Mike Stoddart wrote: >> Thanks. It's an FC13 RPM so I don't know if it will work on FC12 but I'll >> try it tomorrow night. >> >

Re: Python client performance issue

2011-02-17 Thread Mike Stoddart
bruary 15, 2011 at 1:46 AM, Nico Meyer wrote: > > Hi Mike, > > perhaps you can try to upgrade the protocol buffers library to at > least > version 2.3.0. This is from the changelog for that version: > > Python > * 10-25 times faster than 2.2.0, still pure-Python. > &g

Re: Riak compile error on Fedora 12 (32 bit)

2011-02-18 Thread Mike Stoddart
Fedora 32/64 bit builds moving forward. > > D. > > On Thu, Feb 17, 2011 at 12:17 PM, Mike Stoddart wrote: >> David, would you mind building an RPM for Riak Search as well? That >> would be most appreciated. Could you add the FC13 RPMs to the official >> download

Re: Python client performance issue

2011-02-18 Thread Mike Stoddart
Much better - using simplejson and return_body=False reduces CPU usage to 0.5-0.7%. Which is more consistent with other DBs. Thanks for your help! Mike On Mon, Feb 14, 2011 at 8:09 AM, Mike Stoddart wrote: > I added some code to my system to test writing data into Riak. I'm > using

Can't start Riak Search

2011-02-18 Thread Mike Stoddart
I installed the new FC13 Riak Search 64bit RPM (onto FC12) but I'm having issues. I uninstalled Riak and deleted the old database files. I had to manually create the riaksearch user/group as well as the /var/lib/riaksearch/bitcask and /var/lib/riaksearch/ring directories. =INFO REPORT 18-Feb-2

Re: Can't start Riak Search

2011-02-18 Thread Mike Stoddart
<s...@basho.com> Developer Advocate Basho Technologies, Inc. http://basho.com/ On Feb 18, 2011, at 9:38 AM, Mike Stoddart wrote: > I installed the new FC13 Riak Search 64bit RPM (onto FC12) but I'm > having issues. I uninstalled Riak and deleted the old database files. > I

Re: Can't start Riak Search

2011-02-18 Thread Mike Stoddart
g-I'm-gonna-try-and-build-packages > approach. :) When 0.14.1 lands, we should have sorted out these > issues. > > Thanks, > > D. > > On Fri, Feb 18, 2011 at 8:22 AM, Mike Stoddart wrote: >> Riak Search initially complained that the riakuser didn't exist so I cr

Riak Search - querying numerical fields (No JSON object could be decoded)

2011-02-18 Thread Mike Stoddart
My documents are structured like this: { timestamp: '2011-02-02 08:00:00', count: 40, data { } } I want to query all documents where count > 40 so in Python I did: search_query = client.search('bucket', 'count:[40:*]') search_query.run() I got a

Re: Riak Search - querying numerical fields (No JSON object could be decoded)

2011-02-18 Thread Mike Stoddart
My mistake - my query format was wrong, [40 TO 100] works fine. Except run() returns a bunch of lists. Each list contains the bucket name and the timestamp. More reading required. Thanks Mike On Fri, Feb 18, 2011 at 11:51 AM, Mike Stoddart wrote: > My documents are structured like t

Riak search question (Python)

2011-02-18 Thread Mike Stoddart
I'm experimenting with Riak Search; I'm storing tweets and then trying to query them. My code to store a tweet is: tweet = bucket.new(str(uuid.uuid1()), data={ 'name': s.user.name, 'text': s.text,

[no subject]

2011-02-19 Thread Mike Stoddart
The Python client connects to one specific node. The downside to this is that the client has to have knowledge of the node and the node has to be up. If that pre-configured node goes down the client is stuck. What options are there for letting a client connect to the cluster through any node?

Riak search timestamps (date/time)

2011-02-19 Thread Mike Stoddart
Does Riak Search support timestamps? The majority of my data is queried using timestamps; e.g. the last three hours of data or the snapshot from Jan 20th at 08:00:01 etc. Thanks Mike ___ riak-users mailing list riak-users@lists.basho.com http://lists.ba

Re: about riak search

2011-02-22 Thread Mike Stoddart
I found this confusing as well but eventually worked it out. Will the two merge someday? Thanks Mike On Tue, Feb 22, 2011 at 9:08 AM, Sean Cribbs wrote: > Wilson, > > You only need to run one of them. Riak Search includes all of the > functionality of Riak KV. > > Sean Cribbs > Developer Advoc

Riak & Timestamps (Python)

2011-04-02 Thread Mike Stoddart
Just want to quickly clarify how to store timestamps in Riak Search using Python. My code: dt = datetime.datetime.strptime(data['Time(PDT)'], "%b %d, %Y %H:%M:%S") ut = time.mktime(dt.timetuple()) data['Time(PDT)'] = int(ut)

Re: Riak & Timestamps (Python)

2011-04-02 Thread Mike Stoddart
Ah thanks - I thought it was complaining about the value. On Sat, Apr 2, 2011 at 9:23 PM, Rexxe wrote: > Bucket keys are strings and you're passing an int (data['Time(PDT)'] which > you set to int(ut)) > > On Sat, Apr 2, 2011 at 6:13 PM, Mike Stoddart wrote: >>

Riak Search Unicode / String TypeError (Python client)

2011-04-04 Thread Mike Stoddart
I wrote a simple Python client to insert data but when I try to perform a query, I get: Traceback (most recent call last): File "./search.py", line 29, in row = result.get() File "build/bdist.linux-x86_64/egg/riak/mapreduce.py", line 302, in get File "build/bdist.linux-x86_64/egg/riak/b

Re: Riak Search Unicode / String TypeError (Python client)

2011-04-04 Thread Mike Stoddart
1.csv') #~ load_csv2('games', 'game2.csv') Anyone using Riak Search with Python? Thanks Mike On Mon, Apr 4, 2011 at 11:17 AM, Mike Stoddart wrote: > I wrote a simple Python client to insert data but when I try to > perform a query, I get: > > Traceback (most rece

Strange results from numerical range query in Riak Search

2011-04-04 Thread Mike Stoddart
I'm installing the lakes/celtics twitter data linked through Basho's site. I can get some basic text searches to work, but I'm seeing some weird results from numerical range queries: search_query = client.search('stuff', 'followers:[140 TO 150]') Name:Kevin Shpunt Term:lakers Followers:146 Name:C

error: unpacking of archive failed on file /usr/lib64/riak/erts-5.7.5/bin/beam; 4d53dbb2: cpio: Digest mismatch

2011-02-10 Thread Mike Stoddart
I'm trying to install Riak on Fedora 12 using the RPM from Basho's download site. I'm getting a digest mismatch error - does this mean my Fedora is subtly different from the one used to build the original RPM? Thanks Mike yum install --nogpgcheck ~mike//download/downloads.basho.com/riak/CURREN

Re: error: unpacking of archive failed on file /usr/lib64/riak/erts-5.7.5/bin/beam; 4d53dbb2: cpio: Digest mismatch

2011-02-10 Thread Mike Stoddart
I noticed there's another version for Fedora 12: 0.14.0-2. I tried the RPM and it works. Thanks Mike On Thu, Feb 10, 2011 at 9:24 AM, David Smith wrote: > On Thu, Feb 10, 2011 at 5:38 AM, Mike Stoddart wrote: >> I'm trying to install Riak on Fedora 12 using the RPM from