[ceph-users] Some hint for a DELL PowerEdge T440/PERC H750 Controller...

2023-04-06 Thread Marco Gaiarin
We are testing an experimental Ceph cluster with server and controller at subject. The controller have not an HBA mode, but only a 'NonRAID' mode, come sort of 'auto RAID0' configuration. We are using SSD SATA disks (MICRON MTFDDAK480TDT) that perform very well, and SAS HDD disks (SEAGATE ST800

[ceph-users] Re: Some hint for a DELL PowerEdge T440/PERC H750 Controller...

2023-04-11 Thread Marco Gaiarin
Mandi! Matthias Ferdinand In chel di` si favelave... > To check current state: > sdparm --get=WCE /dev/sdf > /dev/sdf: SEAGATE ST2000NM0045 DS03 > WCE 0 [cha: y, def: 0, sav: 0] > "WCE 0" means: off > "sav: 0" means: off next time the disk is powered on Checkin

[ceph-users] Re: Some hint for a DELL PowerEdge T440/PERC H750 Controller...

2023-04-11 Thread Marco Gaiarin
Mandi! Anthony D'Atri In chel di` si favelave... > Dell???s CLI guide describes setting individual drives in Non-RAID, which > *smells* like passthrough, not the more-complex RAID0 workaround we had to do > before passthrough. > https://www.dell.com/support/manuals/en-nz/perc-h750-sas/perc_cli

[ceph-users] Re: Some hint for a DELL PowerEdge T440/PERC H750 Controller...

2023-04-15 Thread Marco Gaiarin
Mandi! Frank Schilder In chel di` si favelave... >> iops: min=2, max= 40, avg=21.13, stdev= 6.10, samples=929 >> iops: min=2, max= 42, avg=21.52, stdev= 6.56, samples=926 > That looks horrible. Exactly, horrible. The strange thing is that we came from an homegro

[ceph-users] Re: Some hint for a DELL PowerEdge T440/PERC H750 Controller...

2023-04-19 Thread Marco Gaiarin
Mandi! Matthias Ferdinand In chel di` si favelave... > In the first linked mail, Dan van der Ster points to this page: > https://docs.ceph.com/en/latest/start/hardware-recommendations/#write-caches root@pppve1:~# for d in a b c d e f; do smartctl -g wcache /dev/sd$d | grep ^Write; done Wri

[ceph-users] Re: Some hint for a DELL PowerEdge T440/PERC H750 Controller...

2023-04-19 Thread Marco Gaiarin
Mandi! Konstantin Shalygin In chel di` si favelave... > Current controller mode is RAID. You can switch to HBA mode and disable cache > in controller settings at the BIOS No, is a bit complex then that. Controller does not have an 'HBA-mode', but a 'AutoRAID0' mode. -- Documentation is li

[ceph-users] Re: Some hint for a DELL PowerEdge T440/PERC H750 Controller...

2023-04-19 Thread Marco Gaiarin
Mandi! Mario Giammarco In chel di` si favelave... > The disk cache is: If the controller does not lie, disk cache is disabled, see my previous messages. > The controller cache: Manual say that for Non-RAID/Automatic RAID0 disks, «The only supported cache policy for non???RAID disks is Write-

[ceph-users] Re: Some hint for a DELL PowerEdge T440/PERC H750 Controller...

2023-04-20 Thread Marco Gaiarin
Mandi! Anthony D'Atri In chel di` si favelave... > Actually there was a firmware bug around that a while back. The HBA and > storcli claimed to not touch drive cache, but actually were enabling it and > lying. Some pointer to the issue? I doubt hit me but... Thanks. -- ma l'impresa e

[ceph-users] Re: FileStore OSD, journal direct symlinked, permission troubles.

2019-08-29 Thread Marco Gaiarin
ART_ENTRY_TYPE=0xfd ID_PART_ENTRY_NUMBER=8 ID_PART_ENTRY_OFFSET=839847936 ID_PART_ENTRY_SIZE=97853440 ID_PART_ENTRY_DISK=8:16 As stated, partitions are 'DOS'... -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia&

[ceph-users] Re: FileStore OSD, journal direct symlinked, permission troubles.

2019-08-29 Thread Marco Gaiarin
; ones. AFAICS, Ceph has laid more focus on bluestore and it might be > better to do a conversion sooner than later. (my opinion) Not for now; bluestore migration need a bit more time/study/knowledge... -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associ

[ceph-users] Re: FileStore OSD, journal direct symlinked, permission troubles.

2019-08-30 Thread Marco Gaiarin
and: brw-rw 1 root disk 8, 6 ago 28 14:38 /dev/sda6 (so, journal partition group-owned by 'disk' and 'ceph' user in group 'disk'), still i have permission access. The ceph-osd process reset group ownership on runtime? Thanks. -- dott. Marco Gaiari

[ceph-users] Re: FileStore OSD, journal direct symlinked, permission troubles.

2019-09-03 Thread Marco Gaiarin
Mandi! Alwin Antreich In chel di` si favelave... > > I'm not a ceph expert, but solution iii) seems decent for me, with a > > little overhead (a readlinkk and a stat for every osd start). > However you like it. But to note that in Ceph Nautilus the udev rules > aren't shipped anymore. Ok. I mak

[ceph-users] Re: Proposal to disable "Avoid Duplicates" on all ceph.io lists

2019-09-05 Thread Marco Gaiarin
Mandi! Ilya Dryomov In chel di` si favelave... > I'm proposing that we disable this handler for all ceph.io lists. +1 -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia'' http://www.lanostrafamig

[ceph-users] Re: vfs_ceph and permissions

2019-09-10 Thread Marco Gaiarin
. Yes, the latter override the former, so the two 'vfs objects' mean for samba 'vfs objects = ceph' only. Do a 'samba-tool testparm' and verify how samba read the file... -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 A

[ceph-users] Re: FileStore OSD, journal direct symlinked, permission troubles.

2019-09-11 Thread Marco Gaiarin
> I'm not a ceph expert, but solution iii) seems decent for me, with a > little overhead (a readlinkk and a stat for every osd start). I've tested my patch and work as expected, i've created: https://tracker.ceph.com/issues/41777 Thanks. --

[ceph-users] Re: ERROR: osd init failed: (13) Permission denied

2019-12-02 Thread Marco Gaiarin
Mandi! Marc Roos In chel di` si favelave... > Node does not start osds! Why do I have this error? Previous boot was > just fine (upgraded recently to nautilus) See if this is your case: https://tracker.ceph.com/issues/41777 -- dott. Marco G

[ceph-users] Disk fail, some question...

2020-01-07 Thread Marco Gaiarin
rite data to the OSD, they are not automatically relocated to other OSD? This violate the crushmap? - while, when the failing OSD get out, the inconsistent PG get not automatically fixed? I've count=3, the other 2 copies are not coherent? But, if so, how ce

[ceph-users] Re: ceph-volume lvm filestore OSDs fail to start on reboot. Permission denied on journal partition

2020-01-22 Thread Marco Gaiarin
h.io/thread/FH4QHTQZJ3R7MOXGJYW6YYLURGUHABPW/ https://tracker.ceph.com/issues/41777 still hoping that patch will be integrated upstream... -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia'' http://www.lanostrafa