Re: "".join(string_generator()) fails to be magic

2007-10-11 Thread Dan Stromberg
On Thu, 11 Oct 2007 01:26:04 -0500, Matt Mackal wrote: > I have an application that occassionally is called upon to process > strings that are a substantial portion of the size of memory. For > various reasons, the resultant strings must fit completely in RAM. > Occassionally, I need to join some

Re: "".join(string_generator()) fails to be magic

2007-10-11 Thread Carl Banks
On Oct 11, 2:26 am, Matt Mackal <[EMAIL PROTECTED]> wrote: > I have an application that occassionally is called upon to process > strings that are a substantial portion of the size of memory. For > various reasons, the resultant strings must fit completely in RAM. > Occassionally, I need to join so

Re: "".join(string_generator()) fails to be magic

2007-10-11 Thread Sion Arrowsmith
Matt Mackal <[EMAIL PROTECTED]> wrote: >I have an application that occassionally is called upon to process >strings that are a substantial portion of the size of memory. For >various reasons, the resultant strings must fit completely in RAM. Do you mean physical RAM, or addressable memory? If the

Re: "".join(string_generator()) fails to be magic

2007-10-11 Thread Marc 'BlackJack' Rintsch
On Thu, 11 Oct 2007 07:02:10 +, thebjorn wrote: > On Oct 11, 8:53 am, Marc 'BlackJack' Rintsch <[EMAIL PROTECTED]> wrote: >> Even if `str.join()` would not convert the generator into a list first, >> you would have overallocation. You don't know the final string size >> beforehand so intermed

Re: "".join(string_generator()) fails to be magic

2007-10-11 Thread Diez B. Roggisch
Matt Mackal schrieb: > I have an application that occassionally is called upon to process > strings that are a substantial portion of the size of memory. For > various reasons, the resultant strings must fit completely in RAM. > Occassionally, I need to join some large strings to build some even >

Re: "".join(string_generator()) fails to be magic

2007-10-11 Thread thebjorn
On Oct 11, 8:53 am, Marc 'BlackJack' Rintsch <[EMAIL PROTECTED]> wrote: > On Thu, 11 Oct 2007 01:26:04 -0500, Matt Mackal wrote: > > I have an application that occassionally is called upon to process > > strings that are a substantial portion of the size of memory. For > > various reasons, the resu

Re: "".join(string_generator()) fails to be magic

2007-10-10 Thread Marc 'BlackJack' Rintsch
On Thu, 11 Oct 2007 01:26:04 -0500, Matt Mackal wrote: > I have an application that occassionally is called upon to process > strings that are a substantial portion of the size of memory. For > various reasons, the resultant strings must fit completely in RAM. > Occassionally, I need to join some

"".join(string_generator()) fails to be magic

2007-10-10 Thread Matt Mackal
I have an application that occassionally is called upon to process strings that are a substantial portion of the size of memory. For various reasons, the resultant strings must fit completely in RAM. Occassionally, I need to join some large strings to build some even larger strings. Unfortunately,