[issue1141] reading large files

2007-09-10 Thread christen
New submission from christen: September 11, 2007 I downloaded py 3.k The good news : Under Windows, Python 3k properly reads files larger than 4 Go (in contrast to python 2.5 that skips some lines, see below) The bad news : py 3k is very slow compared to py 2.5; see the results below the code

[issue1141] reading large files

2007-09-10 Thread christen
christen added the comment: Hi Martin I could certainly do that, but how you get my huge files ? 5 Go of data is quite big... > If you want to compute runtimes, it is better to not convert them to > local time. Instead, use the pattern > > start = time.time() > ... > print

[issue1141] reading large files

2007-09-10 Thread christen
christen added the comment: Hi Stefan Calculations are underway both read and write do not work well with p3k you can try the code below on your own machine : fichout.write(str(i)+' '*59+'\n') #generates a big file fichout.write(str(i)+'\n') #generate

[issue1142] code sample showing errors reading large files with py 2.5

2007-09-10 Thread christen
New submission from christen: Error in reading >4Go files under windows try this: import sys print(sys.version_info) import time print (time.strftime('%Y-%m-%d %H:%M:%S')) liste=[] start = time.time() fichout=open('test.txt','w') for i in xrange(85014

[issue1142] code sample showing errors reading large files with py 2.5

2007-09-10 Thread christen
christen added the comment: made an error in copy paste if you replace by fichout.write(str(i)+' '*59+'\n') should be if you replace by fichout.write(str(i)+'\n') of course :-( __ Tracker <[EMAIL PROTECTED]&g

[issue1142] code sample showing errors reading large files with py 2.5/3.0

2007-09-10 Thread christen
christen added the comment: Hi Guido It is not the end of the file that is not read (see also below) I found about that about one year ago when I was parsing very large files resulting from "blast" on the human genome My parser chock after 4 Go, well before the end of the file : one

[issue1142] code sample showing errors reading large files with py 2.5/3.0

2007-09-11 Thread christen
christen added the comment: Bug is still there but pb is solved, simply use oepn('file', 'U') see outputs : fichin=open('test.txt','U') ===> (2, 5, 0, 'final', 0) 2007-09-12 08:00:43 (500, 9.31236239624) (1000, 22.3120

[issue1451466] reading very large files

2010-05-12 Thread christen
christen added the comment: I have no idea because - I am using 2.5 (windows) or 2.6 (2.5 because of old stuff that I compiled compatible with 2.5 not 2.6) - I am using open(file, 'U') that solved the problem under windows, and the pd does not exist in Linux best Richard Terry

[issue24537] Py_Initialize unable to load the file system codec

2015-06-30 Thread Dana Christen
New submission from Dana Christen: I'm using the C API to embed the Python interpreter (see the attached example). Everything works fine until I try to run the resulting executable on a machine without a Python installation. In that case, the call to Py_Initialize fails with the foll