[issue18744] pathological performance using tarfile

2013-09-12 Thread Serhiy Storchaka
Changes by Serhiy Storchaka : -- nosy: -serhiy.storchaka ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https

[issue18744] pathological performance using tarfile

2013-08-16 Thread Serhiy Storchaka
Serhiy Storchaka added the comment: I think in most cases peoples extracts archives in natural order and don't have a failure. But adding a warning looks reasonable. -- assignee: -> docs@python components: +Documentation -Library (Lib) nosy: +docs@python stage: -> needs patch version

[issue18744] pathological performance using tarfile

2013-08-16 Thread K Richard Pixley
K Richard Pixley added the comment: I see your point. The alternative would be to limit the size of archive that can be extracted from to the size of virtual memory, which is essentially what I'm doing manually. Either way, someone will be surprised. I'm not which which way will result in t

[issue18744] pathological performance using tarfile

2013-08-16 Thread Serhiy Storchaka
Serhiy Storchaka added the comment: Thank you for the script Richard. If you say about performance degradation when extracting a tarfile in changed order this behavior is expected. When you read a gzip file in random order you need seek in it. A gzip file is a singe-direction road. For seeking

[issue18744] pathological performance using tarfile

2013-08-15 Thread K Richard Pixley
K Richard Pixley added the comment: Here's a script that tests for the problem. -- Added file: http://bugs.python.org/file31303/tarproblem.py ___ Python tracker ___ _

[issue18744] pathological performance using tarfile

2013-08-15 Thread K Richard Pixley
K Richard Pixley added the comment: New info... I see the degradation on most of the linux boxes I've tried: * ubuntu-13.04, (raring), 64-bit * rhel-5.4 64-bit * rhel-5.7 64-bit * suse-11 64-bit I see some degradation on MacOsX-10.8.4 but it's in the acceptable range, more like 2x than 60x. T

[issue18744] pathological performance using tarfile

2013-08-15 Thread Serhiy Storchaka
Serhiy Storchaka added the comment: Could you please provide a simple script which shows the problem? -- nosy: +serhiy.storchaka ___ Python tracker ___ __

[issue18744] pathological performance using tarfile

2013-08-14 Thread Ned Deily
Changes by Ned Deily : -- nosy: +lars.gustaebel ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.pyt

[issue18744] pathological performance using tarfile

2013-08-14 Thread K Richard Pixley
New submission from K Richard Pixley: There's a problem with tarfile. Write a program to traverse the contents of a modest sized tar archive. Make sure your tar archive is compressed. Then read the tar archive with your program. I'm finding that allowing tarfile to read a compressed archive