[ceph-users] P420i Raid Controller HBA Mode for Ceph

2023-01-01 Thread hosseinz8...@yahoo.com
Hi Experts,For my new ceph cluster, my existing storage nodes have Smart Array Raid Controller P420i (HP G8). I have 6 Enterprise-SSD Disks for every storage Node.From your experiences, activating HBA Mode is better than Raid 0 or not?I know that Raid Controller and Raid Controller Cache are not

[ceph-users] Re: P420i Raid Controller HBA Mode for Ceph

2023-01-01 Thread Anthony D'Atri
Absolutely. > On Jan 1, 2023, at 10:49 AM, hosseinz8...@yahoo.com wrote: > > Hi Experts,For my new ceph cluster, my existing storage nodes have Smart > Array Raid Controller P420i (HP G8). I have 6 Enterprise-SSD Disks for every > storage Node.From your experiences, activating HBA Mode is be

[ceph-users] pg deep scrubbing issue

2023-01-01 Thread Jeffrey Turmelle
Hi Everyone, My Nautilus cluster of 6 nodes, 180 OSDs, is having a weird issue I don’t know how to troubleshoot. I started receiving health warning issues, and the number of PGS not deep-scrubbed in time has been increasing. # ceph health detail HEALTH_WARN 3013 pgs not scrubbed in time PG_NO

[ceph-users] Re: P420i Raid Controller HBA Mode for Ceph

2023-01-01 Thread Sebastian
Definitely HBA mode. In my opinion, it is good to use in a lab, but not for production. Unfortunately, I have had bad experiences with p420 controllers. These controllers had problems with internal (controller) restarts under high workloads, which resulted in problems with Ceph. A firmware updat

[ceph-users] Re: P420i Raid Controller HBA Mode for Ceph

2023-01-01 Thread hosseinz8...@yahoo.com
Thanks a lot. You said HP is not a good solution for storage node. What is the alternative? Which hardware model is better?Thanks. On Sunday, January 1, 2023, 10:24:42 PM GMT+3:30, Sebastian wrote: Definitely HBA mode. In my opinion, it is good to use in a lab, but not for production.

[ceph-users] Re: Urgent help! RGW Disappeared on Quincy

2023-01-01 Thread Pavin Joseph
Happy New Year, glad you got the fundamentals fixed :) I'm not very familiar with RGW/Object storage as I mainly use CephFS in production. The missing realm is probably the reason the rgw is not working with your configuration and perhaps the orchestrator fudged it on upgrade. Since you've

[ceph-users] Re: ceph failing to write data - MDSs read only

2023-01-01 Thread Kotresh Hiremath Ravishankar
The MDS requests the clients to release caps to trim caches when there is cache pressure or it might proactively request the client to release caps in some cases. But the client is failing to release the caps soon enough in your case. Few questions: 1. Have you tuned MDS cache configurations? If