[ceph-users] Re: Ceph Tentacle release timeline — when?

2025-02-06 Thread Matthew Leonard (BLOOMBERG/ 120 PARK)
Bloomberg is mainly agnostic to the time delay, obviously getting back in alignment with OS releases is ideal. We cannot overstate our agreement on RPM and bare metal support. We also have no desire or interest in being forced to containers. So we also agree to the other on that matter. Sen

[ceph-users] Re: [Urgent] Ceph system Down, Ceph FS volume in recovering

2024-02-26 Thread Matthew Leonard (BLOOMBERG/ 120 PARK)
Glad to hear it all worked out for you! From: nguyenvand...@baoviet.com.vn At: 02/26/24 05:32:32 UTC-5:00To: ceph-users@ceph.io Subject: [ceph-users] Re: [Urgent] Ceph system Down, Ceph FS volume in recovering Dear Mr Eugen, Mr Matthew, Mr David, Mr Anthony My System is UP. Thank you so muc

[ceph-users] Re: [Urgent] Ceph system Down, Ceph FS volume in recovering

2024-02-24 Thread Matthew Leonard (BLOOMBERG/ 120 PARK)
Once recovery is underway way simply restarting the RGWs should be enough to reset them and get your object store back up. Bloomberg doesn’t use cephfs so hopefully David’s suggestions work or if anyone else in the community can chip in for that part. Sent from Bloomberg Professional for iPh

[ceph-users] Re: [Urgent] Ceph system Down, Ceph FS volume in recovering

2024-02-24 Thread Matthew Leonard (BLOOMBERG/ 120 PARK)
Sudo watch ceph -s You should see stats on the recovery and see PGs transition from all the backfill* states to active+clean Once you get everything active clean then we can focus on your rgws and MDSs Sent from Bloomberg Professional for iPhone - Original Message - From: nguyenvand

[ceph-users] Re: [Urgent] Ceph system Down, Ceph FS volume in recovering

2024-02-24 Thread Matthew Leonard (BLOOMBERG/ 120 PARK)
Anthony is correct, this is what I was getting at as well when seeing your ceph -s output. More details in the Ceph docs here if you want to understand the details of why you need to balance your nodes. https://docs.ceph.com/en/quincy/rados/operations/monitoring-osd-pg/ But you need to get you

[ceph-users] Re: [Urgent] Ceph system Down, Ceph FS volume in recovering

2024-02-24 Thread Matthew Leonard (BLOOMBERG/ 120 PARK)
It looks like you have quite a few problems I’ll try and address them one by one. 1) Looks like you had a bunch of crashes, from the ceph -s it looks like you don’t have enough MDS daemons running for a quorum. So you’ll need to restart the crashed containers. 2) It looks like you might have

[ceph-users] Re: [Urgent] Ceph system Down, Ceph FS volume in recovering

2024-02-23 Thread Matthew Leonard (BLOOMBERG/ 120 PARK)
Can you send sudo ceph -s and sudo ceph health detail Sent from Bloomberg Professional for iPhone - Original Message - From: nguyenvand...@baoviet.com.vn To: ceph-users@ceph.io At: 02/23/24 20:27:53 UTC-05:00 Could you pls guide me more detail :( im very newbie in Ceph :( _

[ceph-users] Re: Issue with Setting Public/Private Permissions for Bucket

2024-02-23 Thread Matthew Leonard (BLOOMBERG/ 120 PARK)
https://docs.aws.amazon.com/AmazonS3/latest/userguide/acl-overview.html From: asad.siddi...@rapidcompute.com At: 02/23/24 09:42:29 UTC-5:00To: ceph-users@ceph.io Subject: [ceph-users] Issue with Setting Public/Private Permissions for Bucket Hi Team, I'm currently working with Ceph object stora

[ceph-users] Re: 1 PG stucked in "active+undersized+degraded for long time

2023-07-20 Thread Matthew Leonard (BLOOMBERG/ 120 PARK)
Assuming you're running systemctl OSDs you can run the following command on the host that OSD 343 resides on. systemctl restart ceph-osd@343 From: siddhit.ren...@nxtgen.com At: 07/20/23 13:44:36 UTC-4:00To: ceph-users@ceph.io Subject: [ceph-users] Re: 1 PG stucked in "active+undersized+degrad

[ceph-users] Re: Multi site alternative

2022-11-23 Thread Matthew Leonard (BLOOMBERG/ 120 PARK)
Hey Ivan, I think the answer would be multisite. I know there is a lot of effort currently to work out the last few kinks. This tracker might be of interest as it sounds like an already identified issue, https://tracker.ceph.com/issues/57562#change-228263 Matt From: istvan.sz...@agoda.com At: