[issue19395] lzma hangs for a very long time when run in parallel using python's muptiprocessing module?

2013-10-25 Thread cantor
New submission from cantor: import lzma from functools import partial import multiprocessing def run_lzma(data,c): return c.compress(data) def split_len(seq, length): return [str.encode(seq[i:i+length]) for i in range(0, len(seq), length)] def lzma_mp(sequence,threads=3): lzc

[issue19395] lzma hangs for a very long time when run in parallel using python's muptiprocessing module?

2013-10-25 Thread cantor
cantor added the comment: lzma -- ___ Python tracker <http://bugs.python.org/issue19395> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.pyth

[issue19395] lzma hangs for a very long time when run in parallel using python's muptiprocessing module?

2013-10-25 Thread cantor
Changes by cantor : -- nosy: +nadeem.vawda ___ Python tracker <http://bugs.python.org/issue19395> ___ ___ Python-bugs-list mailing list Unsubscribe:

[issue19395] lzma hangs for a very long time when run in parallel using python's muptiprocessing module?

2013-10-25 Thread cantor
Changes by cantor : -- components: -ctypes ___ Python tracker <http://bugs.python.org/issue19395> ___ ___ Python-bugs-list mailing list Unsubscribe:

[issue19395] unpickled LZMACompressor is crashy

2013-10-25 Thread cantor
cantor added the comment: just to mention that map() (i.e. the non parallel version) works: import lzma from functools import partial import multiprocessing def run_lzma(data,c): return c.compress(data) def split_len(seq, length): return [str.encode(seq[i:i+length]) for i in range(0

[issue19395] unpickled LZMACompressor is crashy

2013-10-25 Thread cantor
cantor added the comment: in python 2.7.3 this kind of works however it is less efficient than the pure lzma.compress() from threading import Thread from backports import lzma from functools import partial import multiprocessing class CompressClass(Thread): def __init__ (self,data,c

[issue19395] unpickled LZMACompressor is crashy

2013-10-25 Thread cantor
cantor added the comment: python 3.3 version - tried this code and got a sliglty faster processing time then when running lzma.compress() on its own. Could this be improved upon? import lzma from functools import partial from threading import Thread def split_len(seq, length): return

[issue17769] python-config --ldflags gives broken output when statically linking Python with --as-needed

2013-04-16 Thread Max Cantor
New submission from Max Cantor: On certain Linux distributions such as Ubuntu, the linker is invoked by default with --as-needed, which has an undesireable side effect when linking static libraries: it is bad at detecting required symbols, and the order of libraries on the command line become

[issue18038] Unhelpful error message on invalid encoding specification

2013-05-22 Thread Max Cantor
New submission from Max Cantor: When you specify a nonexistent encoding at the top of a file, like so for example: # -*- coding: fakefakefoobar -*- The following exception occurs: SyntaxError: encoding problem: with BOM This is very unhelpful, especially in cases where you might have made a