Re: object sizes

2015-04-20 Thread Alex De la rosa
Hi Brett, Yeah, that was my assumption too, an overhead on RAM memory for creating the object structures, etc... that's also why the simple objects (raw binary) gives a pretty accurate measure compared to cURL, but maps/sets/etc... don't. Exactly, I would like to be able to have a way to know how

Re: object sizes

2015-04-20 Thread Brett Hazen
Alex - Looks like Matt created a GitHub issue to track this.  https://github.com/basho/riak-python-client/issues/403 Thanks! It occurs to me that sys.getsizeof() returns the size of the Python Riak Object stored in memory which is most certainly not exactly the same as what curl reports.  Curl

Re: object sizes

2015-04-17 Thread Alex De la rosa
Hi Matthew, I don't have a github account so seems i'm not able to create the ticket for this feature, could you do it? Thanks, Alex On Thu, Apr 16, 2015 at 10:08 PM, Alex De la rosa wrote: > Hi Matthew, > > Thanks for your answer : ) i always have interesting questions : P > > about point [2]

Re: object sizes

2015-04-16 Thread Alex De la rosa
Hi Matthew, Thanks for your answer : ) i always have interesting questions : P about point [2]... if you see my examples, i'm already using sys.getsizeof()... but sizes are not so accurate, also, I believe that is the size they take on RAM when loaded by Python and not the full exact size of the

Re: object sizes

2015-04-16 Thread Matthew Brender
Hi Alex, That is an interesting question! I haven't seen a request like that in our backlog, so feel free to open a new issue [1]. I'm curious: why not use something like sys.getsizeof [2]? [1] https://github.com/basho/riak-python-client/issues [2] http://stackoverflow.com/questions/449560/how-d

Re: object sizes

2015-04-13 Thread Alex De la rosa
Hi Bryan, Thanks for your answer; i don't know how to code in erlang, so all my system relies on Python. Following Ciprian's curl suggestion, I tried to compare it with this python code during the weekend: Map object: curl -I > 1058 bytes print sys.getsizeof(obj.value) > 3352 bytes Standard obj

Re: object sizes

2015-04-13 Thread bryan hunt
Alex, Maps and Sets are stored just like a regular Riak object, but using a particular data structure and object serialization format. As you have observed, there is an overhead, and you want to monitor the growth of these data structures. It is possible to write a MapReduce map function (in

object sizes

2015-04-09 Thread Alex De la rosa
Hi there, I'm using the python client (by the way). obj = RIAK.bucket('my_bucket').get('my_key') Is there any way to know the actual size of an object stored in Riak? to make sure something mutable (like a set) didn't added up to more than 1MB in storage size. Thanks! Alex _