Insecurities with documentations?

2013-11-13 Thread Shuhao Wu
Hi, I just came across the instructions to install Riak again and I think there's some insecurities with the instructions. On this page[1], there is a line that suggests we should do this: curl http://apt.basho.com/gpg/basho.apt.key | sudo apt-key add - This is not https and should be. Addi

Re: Riak 2i http query much faster than python api?

2013-04-10 Thread Shuhao Wu
t this, I want to ask: Does this seem like the > appropriate way to handle this type of operation? And, is there any better > way to do this in the current version of Riak? > > > On Apr 10, 2013, at 6:10 PM, Shuhao Wu wrote: > > There are some inefficiencies in the python client..

Re: store performance

2013-01-08 Thread Shuhao Wu
Can you provide an average time per 1 record? I did some stuff similar recently and it took a while too (I was using the leveldb backend) Shuhao Sent from my phone. On 2013-01-02 3:04 PM, "catchme" wrote: > Hello, > I am trying to store 1543400 records using the memory backend. > I have a ba

Re: vclock, vtag, entity tag

2012-12-27 Thread Shuhao Wu
Then what exactly is etag/vtag. Shuhao On Dec 27, 2012 7:16 PM, "Pavan Venkatesh" wrote: > With 2 siblings, you'll still have 1 vector clock (no matter if its > through http or protobuf). > Each sibling will have the same vector clock. > > Pavan > > From: S

Re: vclock, vtag, entity tag

2012-12-27 Thread Shuhao Wu
Wait. So with 2 siblings, I should get 2 different vclock and 2 etags from http. But the specification from pbc tells me it will only return 1 vclock and 2 vtags Shuhao Sent from my phone. On 2012-12-27 5:19 PM, "Pavan Venkatesh" wrote: > Hi Shuhao, > > Lets say, two clients update the same obj

Asynchronous retrieval?

2012-11-02 Thread Shuhao Wu
Hi, Just as a random question, how important is non-blocking retrieval of object to riak? I don't think it's built in to clients such as the riak-python-client. Is that something that's used or it just doesn't matter when things go bigger? (So for example bucket.get("key") will not return the ob

Re: Luwak Info

2012-08-17 Thread Shuhao Wu
Luwak has been EOL'ed Shuhao On Fri, Aug 17, 2012 at 2:59 PM, Jorge Garrido wrote: > Can any provide some information about how to use luwak from erlang api > (protobuffs) > > Thanks. > > Jorge Garrido - MoreloSoft > ___ > riak-users mailing list > ri

Re: Riak failed to start within 15 seconds,

2012-07-25 Thread Shuhao Wu
uot;Starting up", do > you see the Starting message in your messages log when you call riak start, > or only for riak console? > > From: Shuhao Wu > Date: Wednesday, July 25, 2012 10:55 PM > > To: Joe Caswell > Cc: > Subject: Re: Riak failed to start within 15 se

Re: Riak failed to start within 15 seconds,

2012-07-25 Thread Shuhao Wu
Also try starting with riak console. That works perfectly fine for me. Shuhao Sent from my phone. On Jul 25, 2012 10:51 PM, "Shuhao Wu" wrote: > Yup. /tmp is 777 and /tmp/risk is 755, owned by riak:riak > > Shuhao > Sent from my phone. > On Jul 25, 2012 10:42 PM, &quo

Re: Riak failed to start within 15 seconds,

2012-07-25 Thread Shuhao Wu
s > usually /tmp/riak/, check your riak script to make sure. If the directory > doesn't exist, it will be created with unix perm 755. Verify that the > riak user owns that directory, and has write permission to the parent > directory. > > On 7/25/12 10:19 PM, "Shuhao

Re: Riak failed to start within 15 seconds,

2012-07-25 Thread Shuhao Wu
This seems to be a somewhat common issue nowadays. I have this under one of my server as well, though it's a debian 6 64bit. Cheers, Shuhao On Wed, Jul 25, 2012 at 12:29 PM, David Montgomery wrote: > Hi, > > I am new to riak. > > I followed the instructions for a cluster setup at > https://wiki

Re: Informal survey about Python client API changes

2012-07-25 Thread Shuhao Wu
what about threads vs greenlets? Python people tends to hate Thread, so I'm thinking greenlet maybe better suited for our purposes since it's just an IO call at the end of the day. Shuhao On Tue, Jul 24, 2012 at 6:40 PM, Philipp Borgers wrote: > On Tue, 2012-07-24 at 17:00 -040

Re: Informal survey about Python client API changes

2012-07-24 Thread Shuhao Wu
It's semi broken and I broke the git tree in that one, which is why I never pushed it. I need about a day or two to fix it up for public quality. I have a callback based system. Shuhao On Tue, Jul 24, 2012 at 6:40 PM, Philipp Borgers wrote: > On Tue, 2012-07-24 at 17:00 -0400, Shuhao

Re: Informal survey about Python client API changes

2012-07-24 Thread Shuhao Wu
On Tue, Jul 24, 2012 at 11:27 AM, Jeremy Thurgood wrote: > On 24 July 2012 15:53, Sean Cribbs wrote: > > So, on to my grandiose plans for the future of the Python Riak client. > We're currently using a combination of this client and Riakasaurus, > which is a Twisted-based client library that we

Re: Informal survey about Python client API changes

2012-07-24 Thread Shuhao Wu
Agreed with all of the above. Another thing that could maybe happen is have the transport classes less coupled with RiakObjects, RiakClient, and RiakBucket. Right now the whole thing is very circular and it seems that RiakObject basically is a wrapper of the transports, except in a somewhat weird

Re: riak doesn't start on new Macbook Pro Retina

2012-07-16 Thread Shuhao Wu
I'm also noticing an issue with starting riak. I too cannot start riak regularly, but riak console works just fine. Checked all the permission, they seems to be okay. Shuhao On Mon, Jul 16, 2012 at 3:20 PM, Steve Hull wrote: > So one thing that seems bizarre is that riak has created directory

Re: Difference between Protocol Buffers and HTTP interface

2012-07-06 Thread Shuhao Wu
Protobuf is much much faster as it is a binary protocal. HTTP is simpler for debugging and so on. There are some stuff only available for HTTP, such as setting bucket prop and secure connections. Cheers, Shuhao On Fri, Jul 6, 2012 at 9:58 AM, Alek Morfi wrote: > Hi there, > > What is the diff

Riakkit 0.6.0a (python riak ORM) released: code restructuring, bug fixes, unittesting, and more

2012-07-04 Thread Shuhao Wu
Hi Riak users, It's been a while since I've done a riakkit release, so let me quickly introduce the project (again, for some of you). Riakkit is basically an object mapper for python and riak. It allows for RAD with a lot of automation. Here's a basic example code: class User(Document):

Re: Riak Search turns out results that's deleted?

2012-05-31 Thread Shuhao Wu
solr-like HTTP interface. > > -Z > > On Wed, May 30, 2012 at 10:55 AM, Shuhao Wu wrote: > >> I'm encountering a weird case where it only happens on this specific >> bucket. >> >> >>> import riak >> >>> c = riak.RiakClient() >>

Riak Search turns out results that's deleted?

2012-05-30 Thread Shuhao Wu
I'm encountering a weird case where it only happens on this specific bucket. >>> import riak >>> c = riak.RiakClient() >>> b = c.bucket("test_search") >>> b.get_keys() [] >>> c.search("test_search", "intprop:2").run() [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] >>> b.get(c.s

Re: Riak as Binary File Store

2012-05-29 Thread Shuhao Wu
It'll be interesting if you can write a filesystem on top of Riak. That would be a cool project to see on github :P Shuhao On Tue, May 29, 2012 at 8:36 AM, Praveen Baratam wrote: > Hello Everybody! > > I have read abundantly over the web that Riak is very well suited to store > and retrieve sm

Re: Riak Client Resources, Deleting a Key Doesn't Remove it from bucket.keys

2012-05-23 Thread Shuhao Wu
Riak is eventually consistent. Deleting it doesn't show up immediately. There is an option like delete_immediate Shuhao On May 23, 2012 4:08 PM, "Steve Warren" wrote: > I'm seeing this pretty consistently and have no explanation for it. I > delete a large number of keys (20k to 100k), but when I

Re: Riak / Search via Python Client, no Results from Server

2012-05-23 Thread Shuhao Wu
Yes. You have to do search-cmd install bucketname I believe Shuhao On May 23, 2012 11:20 AM, wrote: > Thanks Sean for the hint .. sure, you right, that wildcard syntax was too > short ! > > Still like this, the main issue remains. The search function is not yet > activated at the server side, ev

Re: Most efficient way to determine if 1000 specific keys exist?

2012-05-09 Thread Shuhao Wu
ep values in Riak that mutate in some > unbounded way due to compaction issues. > > -alexander > > @siculars > http://siculars.posterous.com > > Sent from my rotary phone. > On May 9, 2012 1:13 PM, "Shuhao Wu" wrote: > >> Without reading all the emails.. why

Re: Most efficient way to determine if 1000 specific keys exist?

2012-05-09 Thread Shuhao Wu
Without reading all the emails.. why can't you just cache the keys in an object and maintain that list? The you could check against that list. This way you don't have to go through every object in riak. Shuhao On May 2, 2012 2:47 PM, "Tim Haines" wrote: > Hey guys, > > Still a relative newbie he

Re: Riak Adoption - What can we do better?

2012-04-21 Thread Shuhao Wu
What about a forum? Right now the mailing list is mainly limited to discussions that's pretty technical. A forum would allow newbies to ask intro questions as well as putting up showcase and what not without getting the whole mailing list covered. (Forum is more casual, imo) Shuhao On Thu, Apr

Re: riak-python-client2, a rewrite of the official client

2012-03-16 Thread Shuhao Wu
yet, so I want to continue to explore Shuhao Sent from my phone. On Mar 16, 2012 2:07 PM, "Greg Stein" wrote: > On Thu, Mar 15, 2012 at 11:13, Shuhao Wu wrote: > >... > > Erlang. In my client, a chunk of the code actually comes from the > original > > clien

Re: riak-python-client2, a rewrite of the official client

2012-03-15 Thread Shuhao Wu
at 2:08 PM, Armon Dadgar wrote: >> Message: 4 >> Date: Thu, 15 Mar 2012 11:13:03 -0400 >> From: Shuhao Wu >> To: "Andrey V. Martyanov" >> Cc: riak-users@lists.basho.com >> Subject: Re: riak-python-client2, a rewrite of the official client >> Message

Re: riak-python-client2, a rewrite of the official client

2012-03-15 Thread Shuhao Wu
er company. I'm not sure about dedicated python developer either, but > if it's so it's very bad and the current situation is even worse than I > thought. The stable working library with architecture design flaws is > definitely better than the broken well-designed library. &

Re: riak-python-client2, a rewrite of the official client

2012-03-15 Thread Shuhao Wu
. If there is any more questions/comments, feel free to shoot it my way. Shuhao On Thu, Mar 15, 2012 at 5:30 AM, Andrey V. Martyanov wrote: > > Hi Shuhao, > > What is the reason to create a fork? What is your primary goal? Do you have > any particular plans or roadmap? It would

Re: riak-python-client2, a rewrite of the official client

2012-03-14 Thread Shuhao Wu
at your repo and help where I can. > > Jim > > Sent from my phone. Please forgive the typos. > > On Mar 11, 2012, at 11:25 PM, Shuhao Wu wrote: > > > I'm not too familiar with PBC . I'm looking for individuals to help me as > I'm just a student and only wor

riak-python-client2, a rewrite of the official client

2012-03-11 Thread Shuhao Wu
Hey guys, I've been working with riak and python for the past couple of months, and I'm at the point where I'm ready to completely reimplement riak-python-client. So.. I did/started. The project is hosted on github and under the same apache 2 license as the original client. https://github.com/ult

Re: licenses (was Re: riakkit, a python riak object mapper, has hit beta!(

2012-03-02 Thread Shuhao Wu
It's asking them to use GPL, which is even more restrictive, but a better move for general open source. LGPL is what I feel like the best for this library, as I want a copyleft license. Shuhao On Fri, Mar 2, 2012 at 5:24 AM, Andrey V. Martyanov wrote: > Hi Justin, > > Sorry for the late respon

Re: riakkit, a python riak object mapper, has hit beta!

2012-03-02 Thread Shuhao Wu
Also, what do you mean by conflict resolution? Synchronization or conflicts between references such as deleting references to a document when that document is deleted? Shuhao On Fri, Mar 2, 2012 at 9:56 AM, Shuhao Wu wrote: > Actually it's okay for no pull request for now.. I'm i

Re: riakkit, a python riak object mapper, has hit beta!

2012-03-02 Thread Shuhao Wu
t;>> 2. Generate the JSON Schema [1] based on these fields; >>> 3. Create an instances of our models; >>> 4. Validate against the schema; >>> 5. Generate the optimal sequence of actions we need to do to store the >>> data, based on the meta information of our

Re: riakkit, a python riak object mapper, has hit beta!

2012-03-01 Thread Shuhao Wu
as add_link and remove_link) Shuhao On Thu, Mar 1, 2012 at 10:02 PM, Shuhao Wu wrote: > Hi! > > First off, the code is *LGPL* licensed, not GPL. So you're free to put > this into any code you want, it's just that when you want to modify > riakkit, you have to release you

Re: riakkit, a python riak object mapper, has hit beta!

2012-03-01 Thread Shuhao Wu
ot;: [ > { > "key": "comment1_key", > "text": "comment1" > }, > { > "key": "comment2_key", > "text": "comment2" > }, >

riakkit, a python riak object mapper, has hit beta!

2012-03-01 Thread Shuhao Wu
Hey guys, I started writing riakkit approximately 3 months ago and announced it here. In case you missed that, Riakkit is basically an object mapper for python and riak, which seemed to be lacking in at the time. Now that 3 months has passed and I have developed this project into much more than wh

Re: Is Riak a good solution for this problem?

2012-02-13 Thread Shuhao Wu
What about caching with redis? That seems to be a popular option as well. Shuhao On Sun, Feb 12, 2012 at 3:49 PM, Aphyr wrote: > On 02/12/2012 03:27 AM, Marco Monteiro wrote: > >> I'm considering Riak for the statistics of a site that is approaching >> a billion page views per month. The plan

Re: Connection Pooling with the python-riak-client

2012-01-20 Thread Shuhao Wu
I'm not the people who are building this but I just want to comment on the subject. Riak-python-client is not being updated very frequently.. So I think your best shot right now is fork it as you wish and take a look at some other forks people have made and see what new things/fixes they have inclu

Riak 2i one field multiple values?

2012-01-16 Thread Shuhao Wu
Hi, >From what I can tell through the docs, Riak 2i supports 1 field name with multiple values. Is that correct? Shuhao ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Python-riak links?

2011-12-24 Thread Shuhao Wu
of the object; what you describe > is roughly equivalent except that link traversal can occur without roundtrips > between Riak and your client. > > Justin > > > > On Dec 24, 2011, at 11:38 AM, Shuhao Wu wrote: > >> How are the links implemented? >> >>

Python-riak links?

2011-12-24 Thread Shuhao Wu
How are the links implemented? Would it be faster if I just store the unicode key in the db and look it up or should I use links instead? Thanks, Shuhao ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/ria

Prefix?

2011-12-23 Thread Shuhao Wu
I just noticed a setting named prefix under riak.RiakClient for python. Does this mean we could have conflicting bucket names under different prefixes? Thanks, Shuhao ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailma

Re: Solr interface from python

2011-12-22 Thread Shuhao Wu
that but I don't see it in your code excerpt. > > -Ryan > > On Sun, Dec 18, 2011 at 1:39 PM, Shuhao Wu wrote: >> >> I'm having a bit of trouble working with the solr interface: >> >> >>> import riak >> >>> client = riak.R

Solr interface from python

2011-12-18 Thread Shuhao Wu
I'm having a bit of trouble working with the solr interface: >>> import riak >>> client = riak.RiakClient() >>> bucket = client.bucket("test") >>> bucket.new("key", data={"hello" : "world"}).store() >>> bucket.get("key").exists() True >>> client.solr().search("test", "hello:'world'") {u'responseH

Re: Introducing Riakkit, An(other) riak python (tiny) framework

2011-12-16 Thread Shuhao Wu
gt; > Mark > > [1] > http://wiki.basho.com/Community-Developed-Libraries-and-Projects.html#Client-Libraries-and-Frameworks > > On Thu, Dec 15, 2011 at 6:17 PM, Shuhao Wu wrote: >> Hi guys, >> >> I just created an(other) python framework on top of python-riak at >&g

Introducing Riakkit, An(other) riak python (tiny) framework

2011-12-15 Thread Shuhao Wu
Hi guys, I just created an(other) python framework on top of python-riak at https://github.com/ultimatebuster/riakkit. It's basically an object mapper that maps objects to be stored in riak. Here's a demo: >>> class User(Document): ... bucket_name = "users" ... client = some_

Python Riak documentation error?

2011-12-15 Thread Shuhao Wu
I'm using the same line as in the tutorial, the latest python-riak client from the repository. query.map("function(v) { var data = JSON.parse(v.values[0].data); if(data.is_active == true) { return [[v.key, data]]; } return []; }") Running this query will raise an Exception. Exception: Er

Riak Search?

2011-12-15 Thread Shuhao Wu
I'm trying to use riak search from the python-client, client.search(bucketname, 'name:"mrrow"').run() It's returning [] but there is an entry in the database.. I have enabled_search.. is there something else i have to do? Shuhao ___ riak-users mailin

Re: some really weird stuff with python client's delete...

2011-12-15 Thread Shuhao Wu
>> print "Keys to be cleaned: " + str(keys) >> >> for key in keys: >> print ("Deleting %s..." % key), not bucket.get(key).delete().exists() >> >> for key in keys: >> print "Verifying %s deleted: %s" % (key, not b

Re: some really weird stuff with python client's delete...

2011-12-15 Thread Shuhao Wu
gt; > On Wed, Dec 14, 2011 at 7:54 PM, Shuhao Wu wrote: > >> I'm trying to delete all the keys i've created after running some >> doctests. (I know i should be using the test server.. but it appears that i >> need to be root to run that...) >> >> Here'

some really weird stuff with python client's delete...

2011-12-14 Thread Shuhao Wu
I'm trying to delete all the keys i've created after running some doctests. (I know i should be using the test server.. but it appears that i need to be root to run that...) Here's the script: #!/usr/bin/python if __name__ == "__main__": import doctest print "Running tests" #doctest.tes

Store a list of another document?

2011-12-13 Thread Shuhao Wu
Hi, Is there a way to store an array of key or something to other documents? By that I have a key and that maps to an array that contains references to many other documents/object? Thanks. Shuhao ___ riak-users mailing list riak-users@lists.basho.com h