Re: creating really big lists

2007-09-11 Thread Bruno Desthuilliers
Dr Mephesto a écrit : > On Sep 8, 8:06 pm, Bruno Desthuilliers > <[EMAIL PROTECTED]> wrote: > >>Dr Mephesto a écrit : >> >> >>>Hi! >> >>>I would like to create a pretty big list of lists; a list 3,000,000 >>>long, each entry containing 5 empty lists. My application will append >>>data each of the

Re: creating really big lists

2007-09-11 Thread Dr Mephesto
On Sep 8, 8:06 pm, Bruno Desthuilliers <[EMAIL PROTECTED]> wrote: > Dr Mephesto a écrit : > > > Hi! > > > I would like to create a pretty big list of lists; a list 3,000,000 > > long, each entry containing 5 empty lists. My application will append > > data each of the 5 sublists, so they will be of

Re: creating really big lists

2007-09-10 Thread Bruno Desthuilliers
Dr Mephesto a écrit : > Hi! > > I would like to create a pretty big list of lists; a list 3,000,000 > long, each entry containing 5 empty lists. My application will append > data each of the 5 sublists, so they will be of varying lengths (so no > arrays!). > > Does anyone know the most efficient

Re: creating really big lists

2007-09-10 Thread Bruno Desthuilliers
Delaney, Timothy (Tim) a écrit : > Hrvoje Niksic wrote: > > >>Dr Mephesto <[EMAIL PROTECTED]> writes: >> >> >>>I would like to create a pretty big list of lists; a list 3,000,000 >>>long, each entry containing 5 empty lists. (snip) > >>If you're building large data structures and don't need to r

Re: creating really big lists

2007-09-08 Thread Paul Rubin
Dr Mephesto <[EMAIL PROTECTED]> writes: > well, I want to (maybe) have a dictionary where the value is a list of > 5 lists. And I want to add a LOT of data to these lists. 10´s of > millions of pieces of data. Will this be a big problem? I can just try > it out in practice on monday too :) Yes, th

Re: creating really big lists

2007-09-08 Thread Ricardo Aráoz
Dr Mephesto wrote: > On Sep 8, 3:33 am, "Gabriel Genellina" <[EMAIL PROTECTED]> wrote: >> En Fri, 07 Sep 2007 16:16:46 -0300, Dr Mephesto <[EMAIL PROTECTED]> >> escribi?: >> >>> hey, that defaultdict thing looks pretty cool... >>> whats the overhead like for using a dictionary in python? >> Diction

Re: creating really big lists

2007-09-08 Thread Dr Mephesto
On Sep 8, 3:33 am, "Gabriel Genellina" <[EMAIL PROTECTED]> wrote: > En Fri, 07 Sep 2007 16:16:46 -0300, Dr Mephesto <[EMAIL PROTECTED]> > escribi?: > > > hey, that defaultdict thing looks pretty cool... > > > whats the overhead like for using a dictionary in python? > > Dictionaries are heavily opt

Re: creating really big lists

2007-09-07 Thread Gabriel Genellina
En Fri, 07 Sep 2007 16:16:46 -0300, Dr Mephesto <[EMAIL PROTECTED]> escribi�: > hey, that defaultdict thing looks pretty cool... > > whats the overhead like for using a dictionary in python? Dictionaries are heavily optimized in Python. Access time is O(1), adding/removing elements is amortiz

Re: creating really big lists

2007-09-07 Thread Dr Mephesto
On 6 Sep., 09:30, Paul McGuire <[EMAIL PROTECTED]> wrote: > On Sep 6, 12:47 am, Dr Mephesto <[EMAIL PROTECTED]> wrote: > > > > > I need some real speed! a database is waaay to slow for the algorithm > > im using. and because the sublists are of varying size, i dont think I > > can use an array...-

Re: creating really big lists

2007-09-06 Thread Hrvoje Niksic
Dr Mephesto <[EMAIL PROTECTED]> writes: > I need some real speed! Is the speed with the GC turned off sufficient for your usage? -- http://mail.python.org/mailman/listinfo/python-list

Re: creating really big lists

2007-09-06 Thread Paul McGuire
On Sep 6, 12:47 am, Dr Mephesto <[EMAIL PROTECTED]> wrote: > > I need some real speed! a database is waaay to slow for the algorithm > im using. and because the sublists are of varying size, i dont think I > can use an array...- Hide quoted text - > > - Show quoted text - How about a defaultdict a

Re: creating really big lists

2007-09-05 Thread Dr Mephesto
On 6 Sep., 01:34, "Delaney, Timothy (Tim)" <[EMAIL PROTECTED]> wrote: > Hrvoje Niksic wrote: > > Dr Mephesto <[EMAIL PROTECTED]> writes: > > >> I would like to create a pretty big list of lists; a list 3,000,000 > >> long, each entry containing 5 empty lists. My application will > >> append data ea

RE: creating really big lists

2007-09-05 Thread Delaney, Timothy (Tim)
Hrvoje Niksic wrote: > Dr Mephesto <[EMAIL PROTECTED]> writes: > >> I would like to create a pretty big list of lists; a list 3,000,000 >> long, each entry containing 5 empty lists. My application will >> append data each of the 5 sublists, so they will be of varying >> lengths (so no arrays!).

Re: creating really big lists

2007-09-05 Thread Hrvoje Niksic
Dr Mephesto <[EMAIL PROTECTED]> writes: > I would like to create a pretty big list of lists; a list 3,000,000 > long, each entry containing 5 empty lists. My application will > append data each of the 5 sublists, so they will be of varying > lengths (so no arrays!). > > Does anyone know the most e

Re: creating really big lists

2007-09-05 Thread John Machin
On Sep 5, 7:50 pm, Dr Mephesto <[EMAIL PROTECTED]> wrote: > Hi! > > I would like to create a pretty big list of lists; a list 3,000,000 > long, each entry containing 5 empty lists. My application will append > data each of the 5 sublists, so they will be of varying lengths (so no > arrays!). Will

Re: creating really big lists

2007-09-05 Thread Aahz
In article <[EMAIL PROTECTED]>, Dr Mephesto <[EMAIL PROTECTED]> wrote: > >I would like to create a pretty big list of lists; a list 3,000,000 >long, each entry containing 5 empty lists. My application will append >data each of the 5 sublists, so they will be of varying lengths (so no >arrays!). W

Re: creating really big lists

2007-09-05 Thread Dr Mephesto
yep, thats why I'm asking :) On Sep 5, 12:22 pm, "Diez B. Roggisch" <[EMAIL PROTECTED]> wrote: > Paul Rudin wrote: > > Dr Mephesto <[EMAIL PROTECTED]> writes: > > >> Hi! > > >> I would like to create a pretty big list of lists; a list 3,000,000 > >> long, each entry containing 5 empty lists. My ap

Re: creating really big lists

2007-09-05 Thread Paul Rudin
"Diez B. Roggisch" <[EMAIL PROTECTED]> writes: > Paul Rudin wrote: > >> Dr Mephesto <[EMAIL PROTECTED]> writes: >> >>> Hi! >>> >>> I would like to create a pretty big list of lists; a list 3,000,000 >>> long, each entry containing 5 empty lists. My application will append >>> data each of the 5 s

Re: creating really big lists

2007-09-05 Thread Bryan Olson
Paul Rudin wrote: > Dr writes: >> I would like to create a pretty big list of lists; a list 3,000,000 >> long, each entry containing 5 empty lists. My application will append >> data each of the 5 sublists, so they will be of varying lengths (so no >> arrays!). >> >> Does anyone know the most effic

Re: creating really big lists

2007-09-05 Thread Diez B. Roggisch
Paul Rudin wrote: > Dr Mephesto <[EMAIL PROTECTED]> writes: > >> Hi! >> >> I would like to create a pretty big list of lists; a list 3,000,000 >> long, each entry containing 5 empty lists. My application will append >> data each of the 5 sublists, so they will be of varying lengths (so no >> arra

Re: creating really big lists

2007-09-05 Thread Paul Rudin
Dr Mephesto <[EMAIL PROTECTED]> writes: > Hi! > > I would like to create a pretty big list of lists; a list 3,000,000 > long, each entry containing 5 empty lists. My application will append > data each of the 5 sublists, so they will be of varying lengths (so no > arrays!). > > Does anyone know th

creating really big lists

2007-09-05 Thread Dr Mephesto
Hi! I would like to create a pretty big list of lists; a list 3,000,000 long, each entry containing 5 empty lists. My application will append data each of the 5 sublists, so they will be of varying lengths (so no arrays!). Does anyone know the most efficient way to do this? I have tried: list =