Re: Strange occasional marshal error

2011-03-03 Thread Graham Stratton
On Mar 3, 6:04 pm, Guido van Rossum wrote: > This bug report doesn't mention the Python version nor the platform -- > it could in theory be a bug in the platform compiler or memory > allocator. I've seen the problem with 2.6 and 2.7, on RHEL 4 (possibly with a custom kernel, I can't check at the

Re: Strange occasional marshal error

2011-03-03 Thread Graham Stratton
On Mar 2, 3:01 pm, Graham Stratton wrote: > We are using marshal for serialising objects before distributing them > around the cluster, and extremely occasionally a corrupted marshal is > produced. The current workaround is to serialise everything twice and > check that the serialisat

Strange occasional marshal error

2011-03-02 Thread Graham Stratton
Hi, I'm using Python with ZeroMQ to distribute data around an HPC cluster. The results have been good apart from one issue which I am completely stuck with: We are using marshal for serialising objects before distributing them around the cluster, and extremely occasionally a corrupted marshal is