Bug#771452: Duplicate object check

2014-12-03 Thread Nikolaus Rath
On 12/01/2014 07:31 AM, Nikolaus Rath wrote: > Attached is the object_list.txt file from running fsck using your > patch. > > Seems a little peculiar that the exception occurs at the 10 > object > mark, though it may simply be chance and me

Bug#771452: Duplicate object check

2014-12-02 Thread Nikolaus Rath
severity 771452 important thanks On 12/02/2014 01:50 PM, Shannon Dealy wrote: > On Mon, 1 Dec 2014, Nikolaus Rath wrote: > >> severity -1 normal >> retitle -1 fsck.s3ql sporadically crashes when checking objects >> thanks >> >> Retitling this bug and lowering severity for now. I don't think that

Bug#771452: Duplicate object check

2014-12-02 Thread Nikolaus Rath
Now (most likely) fixed in https://bitbucket.org/nikratio/s3ql/commits/8e563c492228a4d0669277d1b45a89955b68 Best, -Nikolaus -- GPG encrypted emails preferred. Key id: 0xD113FCAC3C4E599F Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F »Time flies like an arrow, f

Bug#771452: Duplicate object check

2014-12-02 Thread Nikolaus Rath
Hi, Could you try if the attached patch fixes the problem? (You could do that at the same time as the fsck.s3ql --debug run). Best, -Nikolaus -- GPG encrypted emails preferred. Key id: 0xD113FCAC3C4E599F Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F »Time flies li

Bug#771452: Duplicate object check

2014-12-02 Thread Nikolaus Rath
On 12/02/2014 03:35 PM, Nikolaus Rath wrote: > Not to fsck.s3ql, but the attached patch should enable traffic dumping > on the lower-level dugong library. It creates files "raw_stream_xx.dat" > in the current directory. Could you give that a shot and attach both the > results for an ssl and no-ssl

Bug#771452: Duplicate object check

2014-12-02 Thread Nikolaus Rath
On 12/02/2014 02:20 PM, Shannon Dealy wrote: > On Tue, 2 Dec 2014, Shannon Dealy wrote: > > [snip] >> I performed a capture as requested, ... > > Sorry Nikolaus, > > I have deleted that file from where I posted it. > > I made a mistake, that file was captured with ssl enabled. In fact, it > ap

Bug#771452: Duplicate object check

2014-12-02 Thread Shannon Dealy
On Tue, 2 Dec 2014, Shannon Dealy wrote: [snip] I performed a capture as requested, ... Sorry Nikolaus, I have deleted that file from where I posted it. I made a mistake, that file was captured with ssl enabled. In fact, it appears based on a limited sample, that fsck.s3ql fails 100% of th

Bug#771452: Duplicate object check

2014-12-02 Thread Shannon Dealy
On Mon, 1 Dec 2014, Nikolaus Rath wrote: severity -1 normal retitle -1 fsck.s3ql sporadically crashes when checking objects thanks Retitling this bug and lowering severity for now. I don't think that the mount.s3ql crash is related to the fsck.s3ql crashes, or that there is any data corruption.

Bug#771452: Duplicate object check

2014-12-02 Thread Shannon Dealy
On Mon, 1 Dec 2014, Nikolaus Rath wrote: [snip] I still have the bucket that was copied using the aws command line tools, and am in the process of copying that to a new bucket for testing so we don't lose the corrupt version, but won't get to testing it tonight. I have not tried to use the orig

Bug#771452: Duplicate object check

2014-12-01 Thread Nikolaus Rath
severity -1 normal retitle -1 fsck.s3ql sporadically crashes when checking objects thanks Retitling this bug and lowering severity for now. I don't think that the mount.s3ql crash is related to the fsck.s3ql crashes, or that there is any data corruption. Best, -Nikolaus -- GPG encrypted emails

Bug#771452: Duplicate object check

2014-12-01 Thread Nikolaus Rath
On 12/01/2014 02:31 PM, Shannon Dealy wrote: > On Mon, 1 Dec 2014, Nikolaus Rath wrote: > > [snip] >> I think at this point I can probably write you a patch to get the file >> system functional again, but I'd very much like to find out what's >> happening here. >> >> Would you be able to run fsck

Bug#771452: Duplicate object check

2014-12-01 Thread Shannon Dealy
On Mon, 1 Dec 2014, Nikolaus Rath wrote: [snip] I think at this point I can probably write you a patch to get the file system functional again, but I'd very much like to find out what's happening here. Would you be able to run fsck with --backend-options no-ssl, and capture the traffic using Wi

Bug#771452: Duplicate object check

2014-12-01 Thread Nikolaus Rath
On 12/01/2014 02:04 AM, Shannon Dealy wrote: > On Sun, 30 Nov 2014, Nikolaus Rath wrote: > >> On 11/30/2014 07:07 PM, Nikolaus Rath wrote: >>> On 11/30/2014 01:07 AM, Shannon Dealy wrote: Attached is the object_list.txt file from running fsck using your patch. Seems a litt

Bug#771452: Duplicate object check

2014-11-30 Thread Nikolaus Rath
On 11/30/2014 07:07 PM, Nikolaus Rath wrote: > On 11/30/2014 01:07 AM, Shannon Dealy wrote: >> >> Attached is the object_list.txt file from running fsck using your patch. >> >> Seems a little peculiar that the exception occurs at the 10 object >> mark, though it may simply be chance and mean no

Bug#771452: Duplicate object check

2014-11-30 Thread Nikolaus Rath
On 11/30/2014 01:07 AM, Shannon Dealy wrote: > > Attached is the object_list.txt file from running fsck using your patch. > > Seems a little peculiar that the exception occurs at the 10 object > mark, though it may simply be chance and mean nothing: > > "..processed 10 objects so far