Re: [ceph-users] Flapping OSDs

2017-04-03 Thread Vlad Blando
Most of the time random and most of the time 1 at a time, but I also see 2-3 that are down at the same time. The network seems fine, the bond seems fine, I just don't know where to look anymore. My other option is to redo the server but that's the last resort, as much as possible I don't want to.

Re: [ceph-users] radosgw leaking objects

2017-04-03 Thread Luis Periquito
> Right. The tool isn't removing objects (yet), because we wanted to > have more confidence in the tool before having it automatically > deleting all the found objects. The process currently is to manually > move these objects to a different backup pool (via rados cp, rados > rm), then when you're

Re: [ceph-users] Flapping OSDs

2017-04-03 Thread Brian :
Hi Vlad Is there anything in syslog on any of the hosts when this happens? Had a similar issue with a single node recently and it was caused by a firmware issue on a single ssd. That would cause the controller to reset and osds on that node would flap as a result. flashed the SSD with new FW and

Re: [ceph-users] deep-scrubbing

2017-04-03 Thread M Ranga Swami Reddy
I use a ceph cluster and its show the deeps scrub's PG distribution as below from "ceph pg dump" command: 2000 Friday 1000 Saturday 4000 Sunday == On Friday, I have disabled the deep-scrub due to some reason. If this case, all Friday's PG deep-scrub will be performed on Saturday

Re: [ceph-users] Kraken release and RGW --> "S3 bucket lifecycle API has been added. Note that currently it only supports object expiration."

2017-04-03 Thread ceph . novice
Hi Cephers... I did set the "lifecycle" via Cyberduck.I do also get an error first, then suddenly Cyberduck refreshes the window aand the lifecycle is there. I see the following when I check it via s3cmd (GitHub master version because the regular installed version doesn't offer the "getlifecycl

[ceph-users] Space accounting for snapshot objects

2017-04-03 Thread Michal Koutný
Hello, I noticed that when Ceph creates snapshot objects, it detects partial object change and creates an overlap record. This overlapping space is then subtracted from the total space occupied by objects. This makes sense to some extent, however, this is little inconsistent when a file storage bac

Re: [ceph-users] Kraken release and RGW --> "S3 bucket lifecycle API has been added. Note that currently it only supports object expiration."

2017-04-03 Thread ceph . novice
... additional strange but a bit different info related to the "permission denied"   [root s3cmd-master]# ./s3cmd --no-ssl put INSTALL s3://Test/ --expiry-days=5 upload: 'INSTALL' -> 's3://Test/INSTALL' [1 of 1] 3123 of 3123 100% in0s 225.09 kB/s done [root s3cmd-master]# ./s3cmd i

Re: [ceph-users] deep-scrubbing

2017-04-03 Thread M Ranga Swami Reddy
+ ceph-devel On Mon, Feb 27, 2017 at 3:54 PM, M Ranga Swami Reddy wrote: > Hello, > I use a ceph cluster and its show the deeps scrub's PG distribution as below > from "ceph pg dump" command: > > >2000 Friday >1000 Saturday >4000 Sunday > == > > On Friday, I have disabled the

Re: [ceph-users] Troubleshooting incomplete PG's

2017-04-03 Thread Sage Weil
On Fri, 31 Mar 2017, nokia ceph wrote: > Hello Brad, > Many thanks of the info :) > > ENV:-- Kracken - bluestore - EC 4+1 - 5 node cluster : RHEL7 > > What is the status of the down+out osd? Only one osd osd.6 down and out from > cluster. > What role did/does it play? Mostimportantly, is it osd.6

Re: [ceph-users] deep-scrubbing

2017-04-03 Thread Sage Weil
On Mon, 3 Apr 2017, M Ranga Swami Reddy wrote: > + ceph-devel > > On Mon, Feb 27, 2017 at 3:54 PM, M Ranga Swami Reddy > wrote: > > Hello, > > I use a ceph cluster and its show the deeps scrub's PG distribution as below > > from "ceph pg dump" command: > > > > > >2000 Friday > >100

Re: [ceph-users] Get/set/list rbd image using python librbd

2017-04-03 Thread Jason Dillaman
We try to keep the C/C++ and Python APIs in-sync, but it looks like these functions were missed and are not currently available via the Python API. I created a tracker ticket [1] the issue. If you are interested, feel free to contribute a pull request for the missing APIs. [1] http://tracker.ceph.

Re: [ceph-users] rbd expord-diff aren't counting AioTruncate op correctly

2017-04-03 Thread Jason Dillaman
On Fri, Mar 31, 2017 at 10:36 PM, 许雪寒 wrote: > We created an image, write data into it, then protect it and clone a new > image. Then we create a snapshot, snap1, of the cloned image, then truncate > it and create a snapshot, snap2. In the diff of the two snapshot, we found > that only the data

Re: [ceph-users] Kraken release and RGW --> "S3 bucket lifecycle API has been added. Note that currently it only supports object expiration."

2017-04-03 Thread ceph . novice
... hmm, "modify" gives no error and may be the option to use, but I don't see anything related to an "expires" meta field   [root s3cmd-master]# ./s3cmd --no-ssl --verbose modify s3://Test/INSTALL --expiry-days=365 INFO: Summary: 1 remote files to modify modify: 's3://Test/INSTALL' [root s3c

[ceph-users] 答复: rbd expord-diff aren't counting AioTruncate op correctly

2017-04-03 Thread 许雪寒
Hi, the operation we performed is AioTruncate. 发件人: Jason Dillaman [jdill...@redhat.com] 发送时间: 2017年4月3日 22:11 收件人: 许雪寒 Cc: ceph-users@lists.ceph.com 主题: Re: [ceph-users] rbd expord-diff aren't counting AioTruncate op correctly On Fri, Mar 31, 2017 at 10:36

Re: [ceph-users] 答复: rbd expord-diff aren't counting AioTruncate op correctly

2017-04-03 Thread Jason Dillaman
Are you referring to the class "AioTruncate"? If so, *how* did you issue the truncate against a specific object? Did you use the RBD API's discard method? Did you resize an image? I need a repeatable set of instructions. On Mon, Apr 3, 2017 at 10:58 AM, 许雪寒 wrote: > Hi, the operation we performed

Re: [ceph-users] List-Archive unavailable

2017-04-03 Thread Herbert Faleiros
accessible again, perhaps rebuild the mailman archive too (partially missing history from 03/29 to 04/02). On Sat, Apr 1, 2017 at 4:47 AM, Robert Sander wrote: > Hi, > > the list archive at http://lists.ceph.com/pipermail/ceph-users-ceph.com/ > is currently not available. Anybody knows what is g

[ceph-users] 答复: 答复: rbd expord-diff aren't counting AioTruncate op correctly

2017-04-03 Thread 许雪寒
Hi, actually, in our test, we created an image with the size 4MB which means it has only one object, then we write data into it, create a snap, clone it and create a snap of the new image, say "snap1", and then we send a "AioTruncate" to truncate the image to 1MB and create the second snap of th

Re: [ceph-users] radosgw leaking objects

2017-04-03 Thread Yehuda Sadeh-Weinraub
On Mon, Apr 3, 2017 at 1:32 AM, Luis Periquito wrote: >> Right. The tool isn't removing objects (yet), because we wanted to >> have more confidence in the tool before having it automatically >> deleting all the found objects. The process currently is to manually >> move these objects to a differen

Re: [ceph-users] deep-scrubbing

2017-04-03 Thread M Ranga Swami Reddy
Thanks Sage. We have older version Ceph (Firefly version), where I could not see this behavior (is on Saturday, after enabling the deep-scrub @ 7AM hours, I could not see the deep-scrub started for Friday's PG deep-scrub)). Is the deep-scrub's performed based on the time-stamp? For ex: a PG deep-sc

Re: [ceph-users] Kraken release and RGW --> "S3 bucket lifecycle API has been added. Note that currently it only supports object expiration."

2017-04-03 Thread Ben Hines
Interesting. I'm wondering what the -13 return code for the op execution in my debug output is (can't find in the source..) I just tried out setting the lifecycle with cyberduck and got this error, which is probably the other bug with AWSv4 auth, http://tracker.ceph.com/ issues/17076 Not sure

Re: [ceph-users] radosgw global quotas - how to set in jewel?

2017-04-03 Thread Graham Allan
Ah, thanks, I thought I was going crazy for a bit there! The global quota would be useful for us (now wanting to retroactively impose quotas on pre-existing users), but we can script a workaround instead. Thanks, Graham On 03/29/2017 10:17 AM, Casey Bodley wrote: Hi Graham, you're absolutely

[ceph-users] how-to undo a "multisite" config

2017-04-03 Thread ceph . novice
Hi Cephers.   Quick question couldn't find a "how-to" or "docu"... not even sure if someone else ever had to do it...   What would be the steps to make a (failed) multisite config change, exactly following - http://docs.ceph.com/docs/master/radosgw/multisite/ undone again?   And as I'm