Re: Insecurities with documentations?

2013-11-16 Thread Shuhao
#x27;s key with someone else's key. The attacker can then plant bad code in the riak package download. A relatively low risk, sure. Still one that makes me nervous especially in the current climate. Cheers, Shuhao On 11/15/2013 01:27 PM, Seth Thomas wrote: Shuhao, Apt keys and packages t

Insecurities with documentations?

2013-11-13 Thread Shuhao Wu
ld be. Additionally, an https version of apt.basho.com does not seem to be available. [1]: http://docs.basho.com/riak/latest/ops/building/installing/debian-ubuntu/ Cheers, Shuhao ___ riak-users mailing list riak-users@lists.basho.com http://lists.bash

Re: Riak 2i http query much faster than python api?

2013-04-11 Thread Shuhao
Evan: Who is working on the streaming interface? Also, it seems that the python API is a bit slow on its own and a lot of time is actually spent in the client as well. Shuhao On 13-04-11 10:18 AM, Evan Vigil-McClanahan wrote: Have you tried streaming the results? Sometimes the

Re: Riak 2i http query much faster than python api?

2013-04-10 Thread Shuhao Wu
Out of curiousity, how are you planning on segmenting the data? Map reduce will execute over the entire data set. Also, how are you setting up your servers? Single nodes? Multiple nodes? Shuhao Sent from my phone. On 2013-04-10 10:25 PM, "Jeff Peck" wrote: > As a follow-up to th

Re: Retrieve all keys of an index?

2013-04-09 Thread Shuhao
The only way I see is get all the object keys, get all the objects, and then merge the secondary index values. Shuhao On 13-04-09 09:54 PM, Jeff Peck wrote: Hello, In Riak, is it possible to retrieve all of the keys of an index? I do not want the object keys in this case, but rather the

Re: Exploring Riak, need to confirm throughput

2013-04-04 Thread Shuhao
Just as a side note, you might want to retry the test with PBC. While I have only did testings with < 10kb documents, my tests indicates that PBC is twice as fast as HTTP in almost all cases. Shuhao On 13-04-04 04:14 PM, Matthew MacClary wrote: Thanks for the feedback. I made two changes

Re: Tune Riak for fast inserts - populate DB

2013-02-13 Thread Shuhao
NoSQL dbs uses about 100% when I just continuous insert. Some DBs even have bulk insert. Maybe this is an issue with Riak itself... I don't really know. Maybe a Riak dev could chip in on the conversation Cheers, Shuhao On 13-02-13 02:37 AM, Bogdan Flueras wrote: Hello all, I've

Re: riak with meteor.js

2013-01-09 Thread Shuhao
Try create one! Shuhao On 13-01-09 07:19 AM, Norman Khine wrote: hi all, just wanted to find out if there are any projects running meteor.js with riak rather then mongodb? thanks ___ riak-users mailing list riak-users@lists.basho.com http

Re: store performance

2013-01-08 Thread Shuhao Wu
Can you provide an average time per 1 record? I did some stuff similar recently and it took a while too (I was using the leveldb backend) Shuhao Sent from my phone. On 2013-01-02 3:04 PM, "catchme" wrote: > Hello, > I am trying to store 1543400 records using the memory bac

Re: vclock, vtag, entity tag

2012-12-30 Thread Shuhao
Does each sibling have an individual vclock or just vclock? I see that riak only returns 1 vclock per get response in PBC. Thanks, Shuhao On 12-12-28 08:33 AM, Sean Cribbs wrote: Let me clarify a bit: 1) There is only one vclock in a response, but at one time prior to you requesting the key

Re: vclock, vtag, entity tag

2012-12-27 Thread Shuhao Wu
Then what exactly is etag/vtag. Shuhao On Dec 27, 2012 7:16 PM, "Pavan Venkatesh" wrote: > With 2 siblings, you'll still have 1 vector clock (no matter if its > through http or protobuf). > Each sibling will have the same vector clock. > > Pavan > > From: S

Re: vclock, vtag, entity tag

2012-12-27 Thread Shuhao Wu
Wait. So with 2 siblings, I should get 2 different vclock and 2 etags from http. But the specification from pbc tells me it will only return 1 vclock and 2 vtags Shuhao Sent from my phone. On 2012-12-27 5:19 PM, "Pavan Venkatesh" wrote: > Hi Shuhao, > > Lets say, two clie

vclock, vtag, entity tag

2012-12-25 Thread Shuhao
m not too sure if my understanding is complete. Thanks, Shuhao ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Riak bugs with indexes?

2012-12-04 Thread Shuhao
key, riak links decoding will fail for the python client as well. Not sure about the behaviours of other clients as I don't use them myself. Shuhao On 12-12-04 05:37 PM, Shuhao wrote: Hi, I'm aware that Riak could handle multiple index values... what I didn't know until th

Riak bugs with indexes?

2012-12-04 Thread Shuhao
world", headers={"Content-Type": "text/plain", "X-Riak-Index-test_bin": "value1, stillvalue1"}) >>> r = requests.get("http://localhost:8098/buckets/test/index/test_bin/value1%2C%20stillvalue1";) >>> r.content '

Asynchronous retrieval?

2012-11-02 Thread Shuhao Wu
key") will not return the object, but you must pass a callback to get it) Cheers, Shuhao ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Luwak Info

2012-08-17 Thread Shuhao Wu
Luwak has been EOL'ed Shuhao On Fri, Aug 17, 2012 at 2:59 PM, Jorge Garrido wrote: > Can any provide some information about how to use luwak from erlang api > (protobuffs) > > Thanks. > > Jorge Garrido - MoreloSoft > ___

Re: Riak failed to start within 15 seconds,

2012-07-25 Thread Shuhao Wu
I literally don't have logs. All the logs are empty. (As this is a new install) Shuhao On Wed, Jul 25, 2012 at 11:01 PM, Joe Caswell wrote: > Riak start make a daemon call to riak console with input and output > redirected. Riak console calls logger -t "$SCRIPT[$$]" &q

Re: Riak failed to start within 15 seconds,

2012-07-25 Thread Shuhao Wu
Also try starting with riak console. That works perfectly fine for me. Shuhao Sent from my phone. On Jul 25, 2012 10:51 PM, "Shuhao Wu" wrote: > Yup. /tmp is 777 and /tmp/risk is 755, owned by riak:riak > > Shuhao > Sent from my phone. > On Jul 25, 2012 10:42 PM, &quo

Re: Riak failed to start within 15 seconds,

2012-07-25 Thread Shuhao Wu
Yup. /tmp is 777 and /tmp/risk is 755, owned by riak:riak Shuhao Sent from my phone. On Jul 25, 2012 10:42 PM, "Joe Caswell" wrote: > We have seen this a couple times. A common cause is the riak user needs > write access to the $PIPE_DIR in order to start properly. PIPE_DIR i

Re: Riak failed to start within 15 seconds,

2012-07-25 Thread Shuhao Wu
This seems to be a somewhat common issue nowadays. I have this under one of my server as well, though it's a debian 6 64bit. Cheers, Shuhao On Wed, Jul 25, 2012 at 12:29 PM, David Montgomery wrote: > Hi, > > I am new to riak. > > I followed the instructions for a clus

Re: Informal survey about Python client API changes

2012-07-25 Thread Shuhao Wu
what about threads vs greenlets? Python people tends to hate Thread, so I'm thinking greenlet maybe better suited for our purposes since it's just an IO call at the end of the day. Shuhao On Tue, Jul 24, 2012 at 6:40 PM, Philipp Borgers wrote: > On Tue, 2012-07-24 at 17:00 -040

Re: Informal survey about Python client API changes

2012-07-24 Thread Shuhao Wu
It's semi broken and I broke the git tree in that one, which is why I never pushed it. I need about a day or two to fix it up for public quality. I have a callback based system. Shuhao On Tue, Jul 24, 2012 at 6:40 PM, Philipp Borgers wrote: > On Tue, 2012-07-24 at 17:00 -0400, Shuhao

Re: Informal survey about Python client API changes

2012-07-24 Thread Shuhao Wu
On Tue, Jul 24, 2012 at 11:27 AM, Jeremy Thurgood wrote: > On 24 July 2012 15:53, Sean Cribbs wrote: > > So, on to my grandiose plans for the future of the Python Riak client. > We're currently using a combination of this client and Riakasaurus, > which is a Twisted-based client library that we

Re: Informal survey about Python client API changes

2012-07-24 Thread Shuhao Wu
manner. Shuhao On Tue, Jul 24, 2012 at 9:53 AM, Sean Cribbs wrote: > Hey riak-users, > > I've begun adding Riak 1.2-related features to the Python client. As I am > doing so, I am reminded about how much technical debt exists in the client, > as discussed at length previousl

Re: riak doesn't start on new Macbook Pro Retina

2012-07-16 Thread Shuhao Wu
I'm also noticing an issue with starting riak. I too cannot start riak regularly, but riak console works just fine. Checked all the permission, they seems to be okay. Shuhao On Mon, Jul 16, 2012 at 3:20 PM, Steve Hull wrote: > So one thing that seems bizarre is that riak has created d

Re: Difference between Protocol Buffers and HTTP interface

2012-07-06 Thread Shuhao Wu
Protobuf is much much faster as it is a binary protocal. HTTP is simpler for debugging and so on. There are some stuff only available for HTTP, such as setting bucket prop and secure connections. Cheers, Shuhao On Fri, Jul 6, 2012 at 9:58 AM, Alek Morfi wrote: > Hi there, > > Wh

Riakkit 0.6.0a (python riak ORM) released: code restructuring, bug fixes, unittesting, and more

2012-07-04 Thread Shuhao Wu
ps://github.com/ultimatebuster/riakkit/issues/1) points out, riakkit is too slow). You can find more information in the git repo if you're interested in using riakkit for your next project or just simply check it out: https://github.com/ultimat

Re: Riak Search turns out results that's deleted?

2012-05-31 Thread Shuhao Wu
Yeah. Only on this bucket, though. Shuhao On Thu, May 31, 2012 at 8:37 PM, Ryan Zezeski wrote: > Shuhao, > > Can you reproduce this every time? I'm not familiar with the Python > client but I'm wondering if this is a divergent index or the Python client > using the

Riak Search turns out results that's deleted?

2012-05-30 Thread Shuhao Wu
n() [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] >>> b.get(c.search("test_search", "intprop:2").run()[0].get_key()).exists() False Note: Previously I have an object with the json document of {"intprop" : 2} Any ideas why this is hap

Re: Riak as Binary File Store

2012-05-29 Thread Shuhao Wu
It'll be interesting if you can write a filesystem on top of Riak. That would be a cool project to see on github :P Shuhao On Tue, May 29, 2012 at 8:36 AM, Praveen Baratam wrote: > Hello Everybody! > > I have read abundantly over the web that Riak is very well suited to store

Re: Riak Client Resources, Deleting a Key Doesn't Remove it from bucket.keys

2012-05-23 Thread Shuhao Wu
Riak is eventually consistent. Deleting it doesn't show up immediately. There is an option like delete_immediate Shuhao On May 23, 2012 4:08 PM, "Steve Warren" wrote: > I'm seeing this pretty consistently and have no explanation for it. I > delete a large number of ke

Re: Riak / Search via Python Client, no Results from Server

2012-05-23 Thread Shuhao Wu
Yes. You have to do search-cmd install bucketname I believe Shuhao On May 23, 2012 11:20 AM, wrote: > Thanks Sean for the hint .. sure, you right, that wildcard syntax was too > short ! > > Still like this, the main issue remains. The search function is not yet > activated at

Re: Most efficient way to determine if 1000 specific keys exist?

2012-05-09 Thread Shuhao Wu
Agreed. If you need something like that, it's time to combine technologies or hack something together for now until you need the efficiency later, then switch to something like redis. Shuhao On Wed, May 9, 2012 at 1:35 PM, Alexander Sicular wrote: > Or just do an exists set operation

Re: Most efficient way to determine if 1000 specific keys exist?

2012-05-09 Thread Shuhao Wu
Without reading all the emails.. why can't you just cache the keys in an object and maintain that list? The you could check against that list. This way you don't have to go through every object in riak. Shuhao On May 2, 2012 2:47 PM, "Tim Haines" wrote: > Hey guys, >

Re: Riak Adoption - What can we do better?

2012-04-21 Thread Shuhao Wu
What about a forum? Right now the mailing list is mainly limited to discussions that's pretty technical. A forum would allow newbies to ask intro questions as well as putting up showcase and what not without getting the whole mailing list covered. (Forum is more casual, imo) Shuhao On Thu

Re: riak-python-client2, a rewrite of the official client

2012-03-16 Thread Shuhao Wu
we are having. I don't have a plan of what will happen with it. I did envision pushing the code back. Right now I'm just trying out different things. Judging from what I have right now, a lot of these changes could be reintergrated. I still haven't explored things like map reduce

Re: riak-python-client2, a rewrite of the official client

2012-03-15 Thread Shuhao Wu
I'm changing it so that the transports and what not could operate *independently* from the rest of the framework. If you have the time, take a look at my current source code and the docstrings. Any suggestions for future work will be appreciated. Cheers, Shuhao On Thu, Mar 15, 2012

Re: riak-python-client2, a rewrite of the official client

2012-03-15 Thread Shuhao Wu
designed newer library. Eventually it will get to a point where it will both be stable and well designed. Shuhao On Mar 15, 2012 12:35 PM, "Andrey V. Martyanov" wrote: > Shuhao, > > It seems reasonable. > > sloccount reported the following: > > Total Physical Source Lines

Re: riak-python-client2, a rewrite of the official client

2012-03-15 Thread Shuhao Wu
he functionalities provided by the current python client, and here's a list of things that Sean would like to see accomplished, which I will work on once I have all the functionalities of the current client complete: https://gist.github.com/1959278 I hope I've answered all the questions

Re: riak-python-client2, a rewrite of the official client

2012-03-14 Thread Shuhao Wu
erything. If we want to bring Python up to speed with the rest of the clients, I'll need more people helping me! Also, I have a general plan of bringing riakkit to riak-python-client2 as well. Shuhao On Mon, Mar 12, 2012 at 12:50 AM, Jim Adler wrote: > I'll certainly take a look

riak-python-client2, a rewrite of the official client

2012-03-11 Thread Shuhao Wu
Made them just variables where possible I'm still taking suggestions for how to reimplement RiakObject (now called RObject). Any feedback will be appreciated. Cheers, Shuhao ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.

Re: licenses (was Re: riakkit, a python riak object mapper, has hit beta!(

2012-03-02 Thread Shuhao Wu
It's asking them to use GPL, which is even more restrictive, but a better move for general open source. LGPL is what I feel like the best for this library, as I want a copyleft license. Shuhao On Fri, Mar 2, 2012 at 5:24 AM, Andrey V. Martyanov wrote: > Hi Justin, > > Sorr

Re: riakkit, a python riak object mapper, has hit beta!

2012-03-02 Thread Shuhao Wu
Also, what do you mean by conflict resolution? Synchronization or conflicts between references such as deleting references to a document when that document is deleted? Shuhao On Fri, Mar 2, 2012 at 9:56 AM, Shuhao Wu wrote: > Actually it's okay for no pull request for now.. I'm i

Re: riakkit, a python riak object mapper, has hit beta!

2012-03-02 Thread Shuhao Wu
Actually it's okay for no pull request for now.. I'm in the process of rethinking the whole framework as well as I'm having some of the issues that Andrey is describing as well. Shuhao On Fri, Mar 2, 2012 at 9:51 AM, Jared Morrow wrote: > Andrey, > > First off, yo

Re: riakkit, a python riak object mapper, has hit beta!

2012-03-01 Thread Shuhao Wu
as add_link and remove_link) Shuhao On Thu, Mar 1, 2012 at 10:02 PM, Shuhao Wu wrote: > Hi! > > First off, the code is *LGPL* licensed, not GPL. So you're free to put > this into any code you want, it's just that when you want to modify > riakkit, you have to release you

Re: riakkit, a python riak object mapper, has hit beta!

2012-03-01 Thread Shuhao Wu
ot;. I'm not sure how you think I should go about approaching this (which right now is a pretty big disaster.. though relatively stable) Cheers, Shuhao P.S. I don't want to go into the whole PEP8 discussion and 4 spaces vs whatever.. I just like the 2 spaces and the style guide tha

riakkit, a python riak object mapper, has hit beta!

2012-03-01 Thread Shuhao Wu
an find the website here: http://ultimatebuster.github.com/riakkit and the code at http://github.com/ultimatebuster/riakkit Cheers! Shuhao ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Is Riak a good solution for this problem?

2012-02-13 Thread Shuhao Wu
What about caching with redis? That seems to be a popular option as well. Shuhao On Sun, Feb 12, 2012 at 3:49 PM, Aphyr wrote: > On 02/12/2012 03:27 AM, Marco Monteiro wrote: > >> I'm considering Riak for the statistics of a site that is approaching >> a billion page vi

Re: Connection Pooling with the python-riak-client

2012-01-20 Thread Shuhao Wu
have included rather than basing yourself against basho's tree. Though, that may diverge the code significantly.. but it's the matter of if you really need that feature right this second or not. Shuhao On Fri, Jan 20, 2012 at 3:53 PM, Michael Clemmons wrote: > Hey All, > FIrst ti

Riak 2i one field multiple values?

2012-01-16 Thread Shuhao Wu
Hi, >From what I can tell through the docs, Riak 2i supports 1 field name with multiple values. Is that correct? Shuhao ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Python-riak links?

2011-12-24 Thread Shuhao Wu
So it is beneficial to store keys into the field? I can see the meta being more useful when you don't want to show the link in the document itself. What's some other uses? Shuhao On Sat, Dec 24, 2011 at 12:18 PM, Justin Sheehy wrote: > They are just stored in the metadata field

Python-riak links?

2011-12-24 Thread Shuhao Wu
How are the links implemented? Would it be faster if I just store the unicode key in the db and look it up or should I use links instead? Thanks, Shuhao ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo

Prefix?

2011-12-23 Thread Shuhao Wu
I just noticed a setting named prefix under riak.RiakClient for python. Does this mean we could have conflicting bucket names under different prefixes? Thanks, Shuhao ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com

Re: Solr interface from python

2011-12-22 Thread Shuhao Wu
I was able to figure it out, and yes, i needed to enable search before i add things to the test bucket. Shuhao On Thu, Dec 22, 2011 at 5:11 PM, Ryan Zezeski wrote: > Shuhao, > > Did you enable search on the 'test' bucket?  I'm not sure what the Python > API is to do

Solr interface from python

2011-12-18 Thread Shuhao Wu
x27;: u'', u'wt': u'json', u'q.op': u'or'}}, u'response': {u'start': 0, u'maxScore': u'0.0', u'numFound': 0, u'docs': []}} >>> As you can see, there's no docs found. The documentation doesn't seem that helpful, either. Am I doing this wrong?... Thanks, Shuhao ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Introducing Riakkit, An(other) riak python (tiny) framework

2011-12-16 Thread Shuhao Wu
Yeah, setup.py is done and the whole package is on pypi. Still quite alpha, but should be stable enough to be used. If there's any problems, file an issue and i'll get to it, mean while I'll try to add more features that I need as well as integration with flask. Shuhao On Fri,

Introducing Riakkit, An(other) riak python (tiny) framework

2011-12-15 Thread Shuhao Wu
te this) they're pretty similar, although there are some differences. Some stuff are inspired by riakalchemy after I saw it, such as the cls.load function. Hopefully you'll be able to check out my new project, and the link again is at: https://github.com/ultimatebuster/riakkit Cheers,

Python Riak documentation error?

2011-12-15 Thread Shuhao Wu
Exception: Error running MapReduce operation. Status: 500 : {"lineno":466,"message":"SyntaxError: syntax error","source":"()"} Another thing is that this shouldn't raise Exception as that would encourage Pokemon exception handling ("y

Riak Search?

2011-12-15 Thread Shuhao Wu
I'm trying to use riak search from the python-client, client.search(bucketname, 'name:"mrrow"').run() It's returning [] but there is an entry in the database.. I have enabled_search.. is there something else i have to do? Shuhao

Re: some really weird stuff with python client's delete...

2011-12-15 Thread Shuhao Wu
Oh yeah, wrong bucket! o.o fml... Shuhao On Thu, Dec 15, 2011 at 10:22 AM, Kostya Rybnikov wrote: > The only problem with solution like this I had is that if you'll have a > lot of keys you'll get python httplib error "response too long" :-( > > > On Thu, De

Re: some really weird stuff with python client's delete...

2011-12-15 Thread Shuhao Wu
I'm trying to delete all the keys from the users bucket and the blog bucket because they are all created by my doctests. I don't want these in my database (they are garbage.. essentially). Shuhao On Thu, Dec 15, 2011 at 9:40 AM, Jon Meredith wrote: > Hi Shuhau, > > Do yo

some really weird stuff with python client's delete...

2011-12-14 Thread Shuhao Wu
i open a separate python console and delete one of these keys via the same method (create a client, get a bucket, get the object via key, delete the object...), this will go down to 9 keys... What's wrong? I'm so confused by this thing.. Shuhao ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Store a list of another document?

2011-12-13 Thread Shuhao Wu
Hi, Is there a way to store an array of key or something to other documents? By that I have a key and that maps to an array that contains references to many other documents/object? Thanks. Shuhao ___ riak-users mailing list riak-users@lists.basho.com