Re: Efficient python 2-d arrays?

2011-01-20 Thread Jake Biesinger
> Thanks for the great suggestions! On a related note, is there no way to efficiently sort a python array? >>> x = array('f', xrange(1000)) >>> x.sort() --- AttributeErrorTraceback (most recen

Re: Efficient python 2-d arrays?

2011-01-18 Thread Jake Biesinger
> Without using third party libraries, no not really. numpy has it > covered so there's not really a lot of demand for it. If your users > are loading 1.5 GB arrays into memory, it's probably not unreasonable > to expect them to have numpy installed. My users are biologists, and I can't expect t

Re: Efficient python 2-d arrays?

2011-01-18 Thread Jake Biesinger
> Since you can't depend on your users installing the dependencies, is > it vital that your users run from source? You could bundle up your > application along with numpy and other dependencies using py2Exe or > similar. This also means you wouldn't have to require users to have > the right (or any

Re: Efficient python 2-d arrays?

2011-01-17 Thread Jake Biesinger
> IIUC (please confirm), you don't need a generic two-dimensional > array, but rather an Nx2 array, where N may be large (but the other > dimension will always have a magnitude of 2). Yes, that's right, Nx2 not NxM. > > Since I want to keep the two elements together during a sort > > I assume (p

Re: Efficient python 2-d arrays?

2011-01-17 Thread Jake Biesinger
On Monday, January 17, 2011 4:12:51 PM UTC-8, OAN wrote: > Hi, > > what about pytables? It's built for big data collections and it doesn't > clog up the memory. I thought PyTables depends on NumPy? Otherwise I would indeed use their carray module. Thanks! -- http://mail.python.org/mailman/li

Efficient python 2-d arrays?

2011-01-17 Thread Jake Biesinger
Hi all, Using numpy, I can create large 2-dimensional arrays quite easily. >>> import numpy >>> mylist = numpy.zeros((1,2), dtype=numpy.int32) Unfortunately, my target audience may not have numpy so I'd prefer not to use it. Similarly, a list-of-tuples using standard python syntax. >>>