Jerry Hill wrote:
On Thu, Dec 4, 2008 at 11:48 AM, Christian Heimes <[EMAIL PROTECTED]> wrote:
Cro wrote:
vContent = io.StringIO()
vContent = huge.read() # This line takes hours to process !!!
Do you really mean io.StringIO? I guess you want io.BytesIO() ..
I don't think it matters. Here's a quick comparison between 2.5 and
3.0 on a relatively small 17 meg file:
C:\>c:\Python30\python -m timeit -n 1
"open('C:\\work\\temp\\bppd_vsub.csv', 'rb').read()"
1 loops, best of 3: 36.8 sec per loop
C:\>c:\Python25\python -m timeit -n 1
"open('C:\\work\\temp\\bppd_vsub.csv', 'rb').read()"
1 loops, best of 3: 33 msec per loop
That's 3 orders of magnitude slower on python3.0!
Timing of os interaction may depend on os. I verified above on WinXp
with 4 meg Pythonxy.chm file. Eye blink versus 3 secs, duplicated. I
think something is wrong that needs fixing in 3.0.1.
http://bugs.python.org/issue4533
tjr
--
http://mail.python.org/mailman/listinfo/python-list
