Re: Joining Big Files

2007-08-31 Thread vasudevram
On Aug 27, 12:43 am, mcl <[EMAIL PROTECTED]> wrote: > All, > > Thank you very much. > > As my background is much smaller memory machines than today's giants - > 64k being abigmachine and 640k being gigantic. I get very worried > about crashing machines when copying or editingbigfiles, especially >

Re: Joining Big Files

2007-08-26 Thread mcl
On 26 Aug, 15:45, vasudevram <[EMAIL PROTECTED]> wrote: > On Aug 26, 6:48 am, Paul McGuire <[EMAIL PROTECTED]> wrote: > > > > > On Aug 25, 8:15 pm, Paul McGuire <[EMAIL PROTECTED]> wrote: > > > > On Aug 25, 4:57 am,mosscliffe<[EMAIL PROTECTED]> wrote: > > > > > I have 4 text files each approx 50mb.

Re: Joining Big Files

2007-08-26 Thread vasudevram
On Aug 26, 6:48 am, Paul McGuire <[EMAIL PROTECTED]> wrote: > On Aug 25, 8:15 pm, Paul McGuire <[EMAIL PROTECTED]> wrote: > > > > > On Aug 25, 4:57 am, mosscliffe <[EMAIL PROTECTED]> wrote: > > > > I have 4 text files each approx 50mb. > > > 50mb? Really? Did you actually try this and find out it

Re: Joining Big Files

2007-08-25 Thread Paul McGuire
On Aug 25, 8:15 pm, Paul McGuire <[EMAIL PROTECTED]> wrote: > On Aug 25, 4:57 am, mosscliffe <[EMAIL PROTECTED]> wrote: > > > I have 4 text files each approx 50mb. > > 50mb? Really? Did you actually try this and find out it was a > problem? > > Try this: > import time > > start = time.clock() > o

Re: Joining Big Files

2007-08-25 Thread Paul McGuire
On Aug 25, 4:57 am, mosscliffe <[EMAIL PROTECTED]> wrote: > I have 4 text files each approx 50mb. > 50mb? Really? Did you actually try this and find out it was a problem? Try this: import time start = time.clock() outname = "temp.dat" outfile = file(outname,"w") for inname in ['file1.dat', 'fi

Re: Joining Big Files

2007-08-25 Thread beginner
On Aug 25, 4:57 am, mosscliffe <[EMAIL PROTECTED]> wrote: > I have 4 text files each approx 50mb. > > I need to join these into one large text file. > > I only need to do this very occasionally, as the problem has occurred > because of upload limitations. > > Bearing in mind filesize and memory use

Re: Joining Big Files

2007-08-25 Thread Marc 'BlackJack' Rintsch
On Sat, 25 Aug 2007 02:57:24 -0700, mosscliffe wrote: > I have 4 text files each approx 50mb. > > I need to join these into one large text file. > > I only need to do this very occasionally, as the problem has occurred > because of upload limitations. > > Bearing in mind filesize and memory use

Joining Big Files

2007-08-25 Thread mosscliffe
I have 4 text files each approx 50mb. I need to join these into one large text file. I only need to do this very occasionally, as the problem has occurred because of upload limitations. Bearing in mind filesize and memory useage, would I be better reading every line in every file and writing eac