[ceph-users] ?????? about rgw region sync

I build two ceph clusters. for the first cluster, I do the follow steps 1??create pools sudo ceph osd pool create .us-east.rgw.root 64 64 sudo ceph osd pool create .us-east.rgw.control 64 64 sudo ceph osd pool create .us-east.rgw.gc 64 64 sudo ceph osd pool create .us-east.rgw.buckets 64 64 sudo

Re: [ceph-users] [cephfs][ceph-fuse] cache size or memory leak?

On Fri, May 8, 2015 at 11:15 AM, Dexter Xiong wrote: > I tried "echo 3 > /proc/sys/vm/drop_caches" and dentry_pinned_count dropped. > > Thanks for your help. > could you please try the attached patch patch Description: Binary data ___ ceph-users maili

[ceph-users] Fwd: rbd unmap command hangs when there is no network connection with mons and osds

This causes an annoying problem with rbd resource agent in pacemaker. In a situation where pacemaker needs to stop a rbd resource agent on a node where there is no network connection, the rbd unmap command hangs. This causes the resource agent stop command to timeout and the node is fenced. On Thu

Re: [ceph-users] rbd unmap command hangs when there is no network connection with mons and osds

On Fri, May 8, 2015 at 1:18 PM, Vandeir Eduardo wrote: > This causes an annoying problem with rbd resource agent in pacemaker. In a > situation where pacemaker needs to stop a rbd resource agent on a node where > there is no network connection, the rbd unmap command hangs. This causes the > resour

Re: [ceph-users] rbd unmap command hangs when there is no network connection with mons and osds

On Fri, May 8, 2015 at 3:59 PM, Ilya Dryomov wrote: > On Fri, May 8, 2015 at 1:18 PM, Vandeir Eduardo > wrote: >> This causes an annoying problem with rbd resource agent in pacemaker. In a >> situation where pacemaker needs to stop a rbd resource agent on a node where >> there is no network conne

Re: [ceph-users] rbd unmap command hangs when there is no network connection with mons and osds

Wouldn't be better a configuration named (map|unmap)_timeout? Cause we are talking about a map/unmap of a RBD device, not a mount/unmount of a file system. On Fri, May 8, 2015 at 10:04 AM, Ilya Dryomov wrote: > On Fri, May 8, 2015 at 3:59 PM, Ilya Dryomov wrote: > > On Fri, May 8, 2015 at 1:18

Re: [ceph-users] rbd unmap command hangs when there is no network connection with mons and osds

On Fri, May 8, 2015 at 4:13 PM, Vandeir Eduardo wrote: > Wouldn't be better a configuration named (map|unmap)_timeout? Cause we are > talking about a map/unmap of a RBD device, not a mount/unmount of a file > system. The mount_timeout option is already there and is used in cephfs. We could certa

Re: [ceph-users] rbd unmap command hangs when there is no network connection with mons and osds

On Fri, May 8, 2015 at 4:25 PM, Ilya Dryomov wrote: > On Fri, May 8, 2015 at 4:13 PM, Vandeir Eduardo > wrote: >> Wouldn't be better a configuration named (map|unmap)_timeout? Cause we are >> talking about a map/unmap of a RBD device, not a mount/unmount of a file >> system. > > The mount_timeout

Re: [ceph-users] export-diff exported only 4kb instead of 200-600gb

There is probably something that I am not understanding, but to me it sounds like you are saying that there are no/minimal deltas between snapshots move2db24-20150428 and 2015-05-05 (both from the export-diff and from your clone). Are you certain that you made 700-800GBs of changes between the

Re: [ceph-users] osd does not start when object store is set to "newstore"

I tried adding "enable experimental unrecoverable data corrupting features = newstore rocksdb" but no luck. Here is the config I am using. [global] . . . osd objectstore = newstore newstore backend = rocksdb enable experimental unrecoverable data corrupting features = newstore rocksdb Regard

Re: [ceph-users] osd does not start when object store is set to "newstore"

I think you need to build code with rocksdb enabled if you are not already doing this. Go to root folder and try this.. ./do_autogen.sh –r Thanks & Regards Somnath From: Srikanth Madugundi [mailto:srikanth.madugu...@gmail.com] Sent: Friday, May 08, 2015 10:33 AM To: Somnath Roy Cc: ceph-us...@

Re: [ceph-users] "too many PGs per OSD" in Hammer

We actually have 3 OSDs by default, but some users run 5. Typically we're not looking at more than that. Should we try 64? I suppose I still don't understand the tradeoffs here - using fewer PGs definitely makes platform start faster (and replication when adding new hosts), but not sure what having

Re: [ceph-users] osd does not start when object store is set to "newstore"

I tried with leveldb, osd does not start either osd objectstore = newstore newstore backend = leveldb enable experimental unrecoverable data corrupting features = newstore leveldb -Srikanth On Fri, May 8, 2015 at 10:41 AM, Somnath Roy wrote: > I think you need to build code with rocksdb e

Re: [ceph-users] osd does not start when object store is set to "newstore"

re-init the osd with the following command sudo ceph-osd --id 0 --mkkey —mkfs and then restart the osd again. I hope it works. -Krishna > On May 8, 2015, at 11:56 AM, Srikanth Madugundi > wrote: > > I tried with leveldb, osd does not start either > > osd objectstore = newstore > > newstore b

[ceph-users] Missing /etc/init.d/ceph file

Hi, I am setting up ceph from git master branch (g...@github.com:ceph/ceph.git) and followed the steps listed at http://docs.ceph.com/docs/master/install/build-ceph/ The build was successful on my RHEL6 host and used "make install" to install the packages as described here. http://docs.ceph.com/

[ceph-users] Find out the location of OSD Journal

Hi, i cant remember on which drive I install which OSD journal :-|| Is there any command to show this? thanks regards ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] "too many PGs per OSD" in Hammer

Is there a way to shrink/merge PG's on a pool without removing it? I have a pool with some data in it but the PG's were miscalculated and just wondering the best way to resolve it. On Fri, May 8, 2015 at 4:49 PM, Somnath Roy wrote: > Sorry, I didn’t read through all..It seems you have 6 OSDs,

Re: [ceph-users] "too many PGs per OSD" in Hammer

Re: [ceph-users] osd does not start when object store is set to "newstore"

Changing this setting alone will not work…Did you do mkfs ? From: Srikanth Madugundi [mailto:srikanth.madugu...@gmail.com] Sent: Friday, May 08, 2015 11:56 AM To: Somnath Roy Cc: ceph-us...@ceph.com Subject: Re: [ceph-users] osd does not start when object store is set to "newstore" I tried with

[ceph-users] accepter.accepter.bind unable to bind to IP on any port in range 6800-7300:

I've run into an issue starting OSD's where I'm running out of ports. I've increased the port range with "ms bind port max" and on the next attempt to start the osd it reports no ports in the new range. I am only running 1 osd on the node and rarely restart the osd. I've increased the debug leve

Re: [ceph-users] "too many PGs per OSD" in Hammer

There are 2 parameters in a pool, pg_num and pgp_num. Pg_num you can’t decrease, but, pgp_num you can. This is the total number of PG for placement purpose. If you reduce that, you will see rebalancing will start and things should settle down after it is done. But, I am not aware of any other im

[ceph-users] RFC: Deprecating ceph-tool commands

All, While working on #11545 (mon: have mon-specific commands under 'ceph mon ...') I crashed into a slightly tough brick wall. The purpose of #11545 is to move certain commands, such as 'ceph scrub', 'ceph compact' and 'ceph sync force' to the 'mon' module of the ceph-tool. These commands have

Re: [ceph-users] RFC: Deprecating ceph-tool commands

On Fri, May 8, 2015 at 4:55 PM, Joao Eduardo Luis wrote: > All, > > While working on #11545 (mon: have mon-specific commands under 'ceph mon > ...') I crashed into a slightly tough brick wall. > > The purpose of #11545 is to move certain commands, such as 'ceph scrub', > 'ceph compact' and 'ceph s