Re: Handeling huge hashes.

2006-04-23 Thread Jay Savage
Please don't top post. On 4/23/06, Rob Coops <[EMAIL PROTECTED]> wrote: > Thanks for the tips, I think a combination of the two will be my best chance > for this one. > > Store the bulk on disk or in a DB and use several smaller hashes to do the > merging. After which I can retreive the bulk from

Re: Handeling huge hashes.

2006-04-23 Thread Rob Coops
Thanks for the tips, I think a combination of the two will be my best chance for this one. Store the bulk on disk or in a DB and use several smaller hashes to do the merging. After which I can retreive the bulk from disk/db while looping over the resulting combined hash. (note to self: must not fo

Re: Handeling huge hashes.

2006-04-21 Thread Dr.Ruud
Rob Coops schreef: > I have two quite large hashes each are several hundreds of MB's in > size, now I want to with some logic merge these into a single hash. I > this works of course but as one might imagine this takes quite a lot > of memory. And can depending on the machine simply run out of mem

Re: Handeling huge hashes.

2006-04-21 Thread Mr. Shawn H. Corey
On Fri, 2006-21-04 at 14:39 +0200, Rob Coops wrote: > Good day list, > > I hope there is someone out there that can point me in the right direction > to find a solution for this. > > I have two quite large hashes each are several hundreds of MB's in size, now > I want to with some logic merge the