[ceph-users] Ideas for Powersaving on archive Cluster ?

2022-01-12 Thread Christoph Adomeit
Hi, a customer has a ceph cluster which is used for archiving large amounts of video data. The cluster sometimes is not used for several days but if data is needed the cluster should be available within a few minutes. The cluster consists of 5 Servers and 180 physical seagate harddisks and was

[ceph-users] Re: CephFS mirroring / cannot remove peer

2022-01-12 Thread Venky Shankar
Hey Manuel - sorry for the delay in response. On Sat, Dec 25, 2021 at 7:10 PM Manuel Holtgrewe wrote: > > Dear all, > > I'm running ceph v16.2.7, deployed via cephadm. > > I have setup a cephfs mirror and made a little error on the way so I > want to remove the peer again. This fails, see below.

[ceph-users] Re: cephfs: [ERR] loaded dup inode

2022-01-12 Thread Venky Shankar
On Tue, Jan 11, 2022 at 6:07 PM Frank Schilder wrote: > > Hi all, > > I found a bunch of error messages like below in our ceph log (2 different > types). How bad is this and should I do something? > > Ceph version is 13.2.10 (564bdc4ae87418a232fc901524470e1a0f76d641) mimic > (stable). > > 2022-0

[ceph-users] Re: Infinite Dashboard 404 Loop On Failed SAML Authentication

2022-01-12 Thread Ernesto Puerta
Hi Edward, I used a containerized environment that most of the Ceph Dashboard team uses for daily development with a ready to use SSO deployment . Kind Regards, Ernesto On Tue, Jan 11, 2022 at 6:56 PM Edward R Huyer wrote: > Actua

[ceph-users] Re: OSDs use 200GB RAM and crash

2022-01-12 Thread Dan van der Ster
Thanks David and Marius for your input. Can you share which versions of Ceph you've experienced this with? And what is the use-case: RGW, CephFS, RBD, mixed ... ? Is there anything special about your ceph usage ? small/large files? num osds ? Num PGs ? When was the cluster created? Thanks! dan

[ceph-users] Re: OSDs use 200GB RAM and crash

2022-01-12 Thread Dan van der Ster
And please also share the output of ceph osd dump | egrep '^flags|^require_osd_release|^pool' (mask the pool names if they contain private info) -- dan -- Dan On Wed, Jan 12, 2022 at 2:47 PM Dan van der Ster wrote: > > Thanks David and Marius for your input. > > Can you share which versions

[ceph-users] are you using nfs-ganesha builds from download.ceph.com

2022-01-12 Thread Dan van der Ster
Dear Ceph Users, There was a question at the CLT today about the nfs-ganesha builds at: https://download.ceph.com/nfs-ganesha/ Are people actively using those? Is there a reason you don't use the builds from https://download.nfs-ganesha.org/ (which links to the Storage SIG in the case of CentOS a

[ceph-users] RDMA Bridging? ("You don't know that you don't know")

2022-01-12 Thread Joshua West
Hey Folks, - For background, I am working with a small (home-lab) ceph cluster on a proxmox cluster. - Proxmox uses a shared cluster storage to pass configuration files around, including ceph.conf - All nodes are connected with Mellanox connectx-3 (mlx4_core) 56GbE cards connected via qsfp switc

[ceph-users] Re: Ideas for Powersaving on archive Cluster ?

2022-01-12 Thread David Orman
If performance isn't as big a concern, most servers have firmware settings that enable more aggressive power saving, at the cost of added latency/reduced cpu power/etc. HPE would be accessible/configurable via HP's ILO, Dells with DRAC, etc. They'd want to test and see how much of an impact it made

[ceph-users] Re: are you using nfs-ganesha builds from download.ceph.com

2022-01-12 Thread Arnaud MARTEL
Hi Dan, I probably have a very specific use of CEPH + nfs-ganesha but I don't use nfs-ganesha builds (from any location). The reason is that I had to patch nfs-ganesha 3.5 in order to play nicely with CEPHFS and POSIX ACLs (using VFS FSAL)... Arnaud ___

[ceph-users] Re: are you using nfs-ganesha builds from download.ceph.com

2022-01-12 Thread Oliver Freyermuth
Dear Dan, Am 12.01.22 um 16:23 schrieb Dan van der Ster: Dear Ceph Users, There was a question at the CLT today about the nfs-ganesha builds at: https://download.ceph.com/nfs-ganesha/ Are people actively using those? Is there a reason you don't use the builds from https://download.nfs-ganesha.

[ceph-users] Re: are you using nfs-ganesha builds from download.ceph.com

2022-01-12 Thread Seth Galitzer
Looks like I'm installing from a package repo and not from individually downloaded packages. According to my yum repo conf, I'm pulling from mirrors.centos.org using the repo storage-nfs-ganesha-28. If that redirects elsewhere upstream, I'm not aware of it. I don't remember why I did it this wa

[ceph-users] Re: are you using nfs-ganesha builds from download.ceph.com

2022-01-12 Thread Ramana Venkatesh Raja
On Wed, Jan 12, 2022 at 10:24 AM Dan van der Ster wrote: > > Dear Ceph Users, > > There was a question at the CLT today about the nfs-ganesha builds at: > https://download.ceph.com/nfs-ganesha/ > > Are people actively using those? Is there a reason you don't use the > builds from https://download.

[ceph-users] Re: 14.2.22 dashboard periodically dies and didn't failover

2022-01-12 Thread Peter Lieven
Am 13.01.22 um 08:37 schrieb Szabo, Istvan (Agoda): > Hi, > > I can see a lot of message regarding the rotating key, but not sure this is > the root cause. > > 2022-01-13 03:21:57.156 7fe7e085e700 -1 monclient: _check_auth_rotating > possible clock skew, rotating keys expired way too early (befor