New submission from christen:
September 11, 2007 I downloaded py 3.k
The good news :
Under Windows, Python 3k properly reads files larger than 4 Go (in
contrast to python 2.5 that skips some lines, see below)
The bad news : py 3k is very slow compared to py 2.5; see the results below
the code
christen added the comment:
Hi Martin
I could certainly do that, but how you get my huge files ? 5 Go of data
is quite big...
> If you want to compute runtimes, it is better to not convert them to
> local time. Instead, use the pattern
>
> start = time.time()
> ...
> print
christen added the comment:
Hi Stefan
Calculations are underway
both read and write do not work well with p3k
you can try the code below on your own machine :
fichout.write(str(i)+' '*59+'\n') #generates a big file
fichout.write(str(i)+'\n') #generate
New submission from christen:
Error in reading >4Go files under windows
try this:
import sys
print(sys.version_info)
import time
print (time.strftime('%Y-%m-%d %H:%M:%S'))
liste=[]
start = time.time()
fichout=open('test.txt','w')
for i in xrange(85014
christen added the comment:
made an error in copy paste
if you replace by
fichout.write(str(i)+' '*59+'\n')
should be
if you replace by
fichout.write(str(i)+'\n')
of course :-(
__
Tracker <[EMAIL PROTECTED]&g
christen added the comment:
Hi Guido
It is not the end of the file that is not read (see also below)
I found about that about one year ago when I was parsing very large
files resulting from "blast" on the human genome
My parser chock after 4 Go, well before the end of the file : one
christen added the comment:
Bug is still there but pb is solved, simply use oepn('file', 'U')
see outputs :
fichin=open('test.txt','U')
===>
(2, 5, 0, 'final', 0)
2007-09-12 08:00:43
(500, 9.31236239624)
(1000, 22.3120
christen added the comment:
I have no idea because
- I am using 2.5 (windows) or 2.6 (2.5 because of old stuff that I
compiled compatible with 2.5 not 2.6)
- I am using open(file, 'U') that solved the problem under windows, and
the pd does not exist in Linux
best
Richard
Terry
New submission from Dana Christen:
I'm using the C API to embed the Python interpreter (see the attached example).
Everything works fine until I try to run the resulting executable on a machine
without a Python installation. In that case, the call to Py_Initialize fails
with the foll