Re: Python 2.5, problems reading large ( > 4Gbyes) files on win2k

[Paul Duffy]

I am not using the universal newline.  File reading loop is essentially...

ifile = open("fileName", "r")
for line in ifile
  ...

Thanks

Peter Otten wrote:
> [EMAIL PROTECTED] wrote:
>
>   
>> I've a Python 2.5 app running on 32 bit Win 2k SP4 (NTFS volume).
>> Reading a file of 13 GBytes, one line at a time.  It appears that,
>> once the read line passes the 4 GByte boundary, I am getting
>> occasional random line concatenations.  Input file is confirmed good
>> via UltraEdit.  Groovy version of the same app runs fine.
>>
>> Any ideas?
>> 
>
> Do you open the file in  universal newline mode -- open(filename, "U") --,
> and if not, does the problem persist if you do?
>
> Peter
>   
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Python 2.5, problems reading large ( > 4Gbyes) files on win2k

[Paul Duffy]

Bill Tydeman wrote:
> Just curious, but since the file size limitation on NTFS is 4 GB, have 
> you confirmed that it isn't some other part of the interaction that is 
> causing the problem?   What FS is hosting the files?
I don't think that is correct.  Groovy version of app runs just fine.
>
> On 2 Mar 2007 10:09:15 -0800, [EMAIL PROTECTED] 
> * <[EMAIL PROTECTED] 
> > wrote:
>
> Folks,
>
> I've a Python 2.5 app running on 32 bit Win 2k SP4 (NTFS volume).
> Reading a file of 13 GBytes, one line at a time.  It appears that,
> once the read line passes the 4 GByte boundary, I am getting
> occasional random line concatenations.  Input file is confirmed good
> via UltraEdit.  Groovy version of the same app runs fine.
>
> Any ideas?
>
> Cheers
>
> --
> http://mail.python.org/mailman/listinfo/python-list
>
>
>
>
> -- 
> There is no reason for any individual to have a computer in his home.
> Ken Olsen, President, Digital Equipment, 1977
> US computer engineer & industrialist (1926 - )
>
-- 
http://mail.python.org/mailman/listinfo/python-list