[ceph-users] Accidentally Remove OSDs

2015-04-23 Thread FaHui Lin
Dear Ceph experts, I'm a very new Ceph user. I made a blunder that I removed some OSDs (and all files in the related directories) before Ceph finished rebalancing datas and migrating pgs. Not to mention the data loss, I meet the problem that: 1) There are always stale pgs showing in ceph sta

Re: [ceph-users] Accidentally Remove OSDs

2015-04-23 Thread FaHui Lin
till show up in your CRUSH, then try and remove them from the CRSH map with 'ceph osd crush rm osd.15'. If you took out both OSDs, you will need to use some of the recovery tools. I believe the procedure is roughly, mount the drive in another box, extract the PGs needed, then shut

Re: [ceph-users] Accidentally Remove OSDs

2015-04-23 Thread FaHui Lin
e from back up as to not be surprised by data corruption in the images. Neither option is ideal or quick. Robert LeBlanc Sent from a mobile device please excuse any typos. On Apr 23, 2015 6:42 PM, "FaHui Lin" <mailto:fahui@twgrid.org>> wrote: Hi, thank you for y

[ceph-users] Read-out much slower than write-in on my ceph cluster

2015-10-27 Thread FaHui Lin
Dear Ceph experts, I found something strange about the performance of my Ceph cluster: Read-out much slower than write-in. I have 3 machines running OSDs, each has 8 OSDs running on 8 raid0s (each made up of 2 HDDs) respectively. The OSD journal and data the is on the same device. All machi

[ceph-users] CephFS fsync failed and read error

2016-01-27 Thread FaHui Lin
Dear Ceph experts, I've got a problem with CephFS one day. When I use vim to edit a file on cephfs, it will show fsync failed, and later the file cannot be read/open anymore. Strangely there is no error I can spot on ceph logs, dmesg, etc. Here is an example below: (all machines in my ceph clus

Re: [ceph-users] CephFS fsync failed and read error

2016-01-27 Thread FaHui Lin
aHui Yan, Zheng 於 2016/1/28 下午 02:51 寫道: This seems like the user has no read/write permission to cephfs data pool. Regards Yan, Zheng On Thu, Jan 28, 2016 at 11:36 AM, FaHui Lin wrote: Dear Ceph experts, I've got a problem with CephFS one day. When I use vim to edit a file on cep

[ceph-users] CEPHFS file or directories disappear when ls (metadata problem)

2016-03-23 Thread FaHui Lin
Dear Ceph experts, We meet a nasty problem with our CephFS from time to time: When we try to list a directory under CephFS, some files or directories do not show up. For example: This is the complete directory content: # ll /cephfs/ies/home/mika drwxr-xr-x 1 10035 11 1559018781 Feb 2 07:

Re: [ceph-users] CEPHFS file or directories disappear when ls (metadata problem)

2016-03-23 Thread FaHui Lin
Regarding mounting 100+ clients, it shouldn't be a problem for the MDS. If you do run into issues, please report them! -Greg ELRepo maintains mainline RPMs for EL6 and EL7: http://elrepo.org/tiki/kernel-ml Alternatively, you could try the FUSE client. —Lincoln On Mar 23, 2016, at 11:12 AM,