[issue23655] Memory corruption using pickle over pipe to subprocess

Changes by Serhiy Storchaka : -- status: open -> pending ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https:

[issue23655] Memory corruption using pickle over pipe to subprocess

Serhiy Storchaka added the comment: Without additional information we can't solve this issue. Is the problem still reproduced? -- status: pending -> open ___ Python tracker ___

[issue23655] Memory corruption using pickle over pipe to subprocess

Changes by Serhiy Storchaka : -- status: open -> pending ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https:

[issue23655] Memory corruption using pickle over pipe to subprocess

Changes by Ethan Furman : -- nosy: -ethan.furman ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.

[issue23655] Memory corruption using pickle over pipe to subprocess

Changes by Ethan Furman : -- nosy: +ethan.furman ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.p

[issue23655] Memory corruption using pickle over pipe to subprocess

John Nagle added the comment: More info: the problem is on the "unpickle" side. If I use _Unpickle and Pickle, so the unpickle side is in Python, but the pickle side is in C, no problem. If I use Unpickle and _Pickle, so the unpickle side is C, crashes. -- ___

[issue23655] Memory corruption using pickle over pipe to subprocess

Serhiy Storchaka added the comment: No, there are no subprocess specific tests for pickle. Pickle tests are in Lib/test/pickletester.py and Lib/test/test_pickle.py. First try dump pickled data to a file and then load it in other process. Is it still failed? -- __

[issue23655] Memory corruption using pickle over pipe to subprocess

John Nagle added the comment: "minimize you data" - that's a big job here. Where are the tests for "pickle"? Is there one that talks to a subprocess over a pipe? Maybe I can adapt that. -- ___ Python tracker

[issue23655] Memory corruption using pickle over pipe to subprocess

Serhiy Storchaka added the comment: Could you please try to minimize you data and try to reproduce an issue without using third-party modules if this is possible? -- ___ Python tracker

[issue23655] Memory corruption using pickle over pipe to subprocess

John Nagle added the comment: > Or just use pickle._Pickler instead of pickle.Pickler and like > (implementation detail!). Tried that. Changed my own code as follows: 25a26 > 71,72c72,73 < self.reader = pickle.Unpickler(self.proc.stdout)# set up reader < self.writer = pic

[issue23655] Memory corruption using pickle over pipe to subprocess

Serhiy Storchaka added the comment: sys.modules['_pickle'] del sys.modules['pickle'] # if exists import pickle Or just use pickle._Pickler instead of pickle.Pickler and like (implementation detail!). -- nosy: +alexandre.vassalotti, pitrou, serhiy.storchaka stage: -> test needed type:

[issue23655] Memory corruption using pickle over pipe to subprocess

New submission from John Nagle: I'm porting a large, working system from Python 2 to Python 3, using "six", so the same code works with both. One part of the system works a lot like the multiprocessing module, but predates it. It launches child processes with "Popen" and talks to them using "p