[issue12775] immense performance problems related to the garbage collector

2011-08-18 Thread Daniel Svensson
Daniel Svensson added the comment: Yes, but this ticket was only opened due to time delta between no-gc and gc, not as much absolute time, but that's a nice improvement. -- ___ Python tracker <http://bugs.python.org/is

[issue12775] immense performance problems related to the garbage collector

2011-08-18 Thread Daniel Svensson
Changes by Daniel Svensson : -- versions: -Python 2.7, Python 3.1, Python 3.2, Python 3.3, Python 3.4 ___ Python tracker <http://bugs.python.org/issue12

[issue12775] immense performance problems related to the garbage collector

2011-08-18 Thread Daniel Svensson
Daniel Svensson added the comment: using: (except in python2.5 case where simplejson is used, which ought to be the same thing right?) import time, gc, json, sys def read_json_blob(): t0 = time.time() fd = open("datatest1.json") data = fd.read()

[issue12775] immense performance problems related to the garbage collector

2011-08-18 Thread Daniel Svensson
Daniel Svensson added the comment: Working on getting a reasonable large file to test with on my laptop where I have 2.6, 2.7, 3.2. The Python version where the problem became apparent was 2.5.2 as the software is deployed on Debian Lenny

[issue12775] immense performance problems related to the garbage collector

2011-08-18 Thread Daniel Svensson
Daniel Svensson added the comment: "Or you could disable the GC only when decoding JSON data and reenable it afterwards." JSON was just an example, and disabling/enabling the GC is not safe in a multithreaded environment? -- ___ Pyth

[issue12775] immense performance problems related to the garbage collector

2011-08-18 Thread Daniel Svensson
Daniel Svensson added the comment: The bug note contains a test script. You just have to generate a huge JSON-blob, or allocate 1 GB or so and pickle it down to file and replace the cjson.decode to pickle.loads, pickle is about 20 times faster without GC

[issue12775] immense performance problems related to the garbage collector

2011-08-18 Thread Daniel Svensson
New submission from Daniel Svensson : I've noticed problems with the GC in two applications. In one case the application did not respond to SOAP-requests for 9 seconds, every couple of minutes, when it really shouldn't have taken more than 20ms. In another case we had one operatio

[issue4892] Sending Connection-objects over multiprocessing connections fails

2009-08-26 Thread Daniel Svensson
Daniel Svensson added the comment: Ehm.. completly broken url in prev message.. Revision 65016, "Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global registry/

[issue4892] Sending Connection-objects over multiprocessing connections fails

2009-08-26 Thread Daniel Svensson
Daniel Svensson added the comment: When reverting this commit stuff works: http://svn.python.org/view/python/trunk/Lib/multiprocessing/reduction.py?r1=64257&r2=65016 -- ___ Python tracker <http://bugs.python.org/is

[issue4892] Sending Connection-objects over multiprocessing connections fails

2009-08-26 Thread Daniel Svensson
Daniel Svensson added the comment: And to be clear, I have enabled connection pickling by issuing: multiprocessing.allow_connection_pickling() -- ___ Python tracker <http://bugs.python.org/issue4

[issue4892] Sending Connection-objects over multiprocessing connections fails

2009-08-26 Thread Daniel Svensson
Daniel Svensson added the comment: A typical use case would be for a server to receive a connection, and then send that connection over to another process that does the actual work. This used to work with pyprocessing, and the support seems to be available in multiprocessing.c

[issue6175] inet_aton documentation kind of lies

2009-06-02 Thread Daniel Svensson
New submission from Daniel Svensson : The documentation for inet_aton specifically says that it's used to "Convert an IPv4 address from dotted-quad string format". This however is not really true, it does accept dotted-quad, but not dotted-quad alone, but also these forms from i