[ceph-users] НА: inconsistent pgs

2015-08-11 Thread Межов Игорь Александрович
Hi! Glad to hear your Ceph is working again! ;) BTW, it is a new knowledge: how ceph behave with bad ram. Do you have memory ECC errors in logs? Linux has EDAC module (I think, it is enabled by default in Debian) which reports any machine errors happening - machine check exeptions, memory error

Re: [ceph-users] НА: inconsistent pgs

2015-08-07 Thread Константин Сахинов
I removed btrfs OSD as written in docs, reformatted it to xfs, and then added as new OSD. пт, 7 авг. 2015 г. в 19:00, Jan Schermer : > Did you copy the OSD objects between btrfs->xfs or did you remove the > btrfs OSD and add a new XFS OSD? > > Jan > > On 07 Aug 2015, at 17:06, Межов Игорь Алексан

Re: [ceph-users] НА: inconsistent pgs

2015-08-07 Thread Jan Schermer
Did you copy the OSD objects between btrfs->xfs or did you remove the btrfs OSD and add a new XFS OSD? Jan > On 07 Aug 2015, at 17:06, Межов Игорь Александрович wrote: > > Hi! > > I'm sorry, but I dont know, how to help you. We move OSDs from XFS to EXT4 on > our test > cluster (Hammer 0.94

[ceph-users] НА: inconsistent pgs

2015-08-07 Thread Межов Игорь Александрович
Hi! I'm sorry, but I dont know, how to help you. We move OSDs from XFS to EXT4 on our test cluster (Hammer 0.94.2), removing ODSs one-by-one and re-adding them after reformatting to EXT4. This process is usual to a ceph (Add/Remove OSDs in documentaion) and took place without any data loss. We

[ceph-users] НА: inconsistent pgs

2015-08-07 Thread Межов Игорь Александрович
Hi! When inconsistent PGs starting to appear? Maybe after some event? Hang, node reboot or after reconfiguration or changing parameters? Can you say, what triggers such behaviour? And, BTW, what system/kernel you use? Megov Igor CIO, Yuterra ___ ceph-u

[ceph-users] НА: inconsistent pgs

2015-08-07 Thread Межов Игорь Александрович
Hi! >If there is cable or SATA-controller issues, will it be shown in >/var/log/dmesg? If it will lead to read errors, it will be logged in dmesg. If it cause only SATA command retransmission, it maybe won't logged in dmesg, but have to be shown in SMART attributes. And anyway, we face only som

[ceph-users] НА: inconsistent pgs

2015-08-07 Thread Межов Игорь Александрович
Hi! Do you have any disk errors in dmesg output? In our practice, every time the deep scrub found inconsistent PG, we also found a disk error, that was the reason. Sometimes it was media errors (bad sectors), one time - bad sata cable and we also had some raid/hba firmware issues. But in all case