[ceph-users] Re: MDS internal op exportdir despite ephemeral pinning

2022-11-29 Thread Frank Schilder
Hi Patrick. > "Both random and distributed ephemeral pin policies are off by default > in Octopus. The features may be enabled via the > mds_export_ephemeral_random and mds_export_ephemeral_distributed > configuration options." Thanks for that hint! This is a baddie. I never read that far, becaus

[ceph-users] Re: MDS internal op exportdir despite ephemeral pinning

2022-11-29 Thread Patrick Donnelly
Hi Frank, Sorry for the delay and thanks for sharing the data privately. On Wed, Nov 23, 2022 at 4:00 AM Frank Schilder wrote: > > Hi Patrick and everybody, > > I wrote a small script that pins the immediate children of 3 sub-dirs on our > file system in a round-robin way to our 8 active ranks.

[ceph-users] Re: MDS internal op exportdir despite ephemeral pinning

2022-11-23 Thread Frank Schilder
Hi Patrick and everybody, I wrote a small script that pins the immediate children of 3 sub-dirs on our file system in a round-robin way to our 8 active ranks. I think the experience is worth reporting here. In any case, Patrick, if you can help me get distributed ephemeral pinning to work, this

[ceph-users] Re: MDS internal op exportdir despite ephemeral pinning

2022-11-18 Thread Patrick Donnelly
On Fri, Nov 18, 2022 at 2:32 PM Frank Schilder wrote: > > Hi Patrick, > > we plan to upgrade next year. Can't do any faster. However, distributed > ephemeral pinning was introduced with octopus. It was one of the major new > features and is explained in the octopus documentation in detail. > > A

[ceph-users] Re: MDS internal op exportdir despite ephemeral pinning

2022-11-18 Thread Frank Schilder
Hi Patrick, we plan to upgrade next year. Can't do any faster. However, distributed ephemeral pinning was introduced with octopus. It was one of the major new features and is explained in the octopus documentation in detail. Are you saying that it is actually not implemented? If so, how much of

[ceph-users] Re: MDS internal op exportdir despite ephemeral pinning

2022-11-18 Thread Patrick Donnelly
On Fri, Nov 18, 2022 at 2:11 PM Frank Schilder wrote: > > Hi Patrick, > > thanks for your super fast answer. > > > I assume you mean "distributed ephemeral pinning"? > > Yes. Just to remove any potential for a misunderstanding from my side, I > enabled it with (copy-paste from the command history

[ceph-users] Re: MDS internal op exportdir despite ephemeral pinning

2022-11-18 Thread Frank Schilder
Hi Patrick, thanks for your super fast answer. > I assume you mean "distributed ephemeral pinning"? Yes. Just to remove any potential for a misunderstanding from my side, I enabled it with (copy-paste from the command history, /mnt/admin/cephfs/ is the mount point of "/" with all possible clie

[ceph-users] Re: MDS internal op exportdir despite ephemeral pinning

2022-11-18 Thread Patrick Donnelly
On Fri, Nov 18, 2022 at 12:51 PM Frank Schilder wrote: > > Hi Patrick, > > thanks! I did the following but don't know how to interpret the result. The > three directories we have ephemeral pinning set are: > > /shares > /hpc/home > /hpc/groups I assume you mean "distributed ephemeral pinning"?

[ceph-users] Re: MDS internal op exportdir despite ephemeral pinning

2022-11-18 Thread Frank Schilder
Hi Patrick, thanks! I did the following but don't know how to interpret the result. The three directories we have ephemeral pinning set are: /shares /hpc/home /hpc/groups If I understand the documentation correctly, everything under /hpc/home/user should be on the same MDS. Trying it out I get

[ceph-users] Re: MDS internal op exportdir despite ephemeral pinning

2022-11-18 Thread Patrick Donnelly
On Thu, Nov 17, 2022 at 4:45 AM Frank Schilder wrote: > > Hi Patrick, > > thanks for your explanation. Is there a way to check which directory is > exported? For example, is the inode contained in the messages somewhere? A > readdir would usually happen on log-in and the number of slow exports s

[ceph-users] Re: MDS internal op exportdir despite ephemeral pinning

2022-11-17 Thread Frank Schilder
_ From: Frank Schilder Sent: 17 November 2022 10:45:20 To: Patrick Donnelly Cc: ceph-users@ceph.io Subject: [ceph-users] Re: MDS internal op exportdir despite ephemeral pinning Hi Patrick, thanks for your explanation. Is there a way to check which directory is exported? For example, is

[ceph-users] Re: MDS internal op exportdir despite ephemeral pinning

2022-11-17 Thread Frank Schilder
Hi Patrick, thanks for your explanation. Is there a way to check which directory is exported? For example, is the inode contained in the messages somewhere? A readdir would usually happen on log-in and the number of slow exports seems much higher than the number of people logging in (I would as

[ceph-users] Re: MDS internal op exportdir despite ephemeral pinning

2022-11-16 Thread Patrick Donnelly
Hello Frank, On Wed, Nov 16, 2022 at 5:38 AM Frank Schilder wrote: > > Hi all, > > I have a question about ephemeral pinning on octopus latest. We have > ephemeral pinning set on all directories that are mounted (well on all their > parents), like /home etc. Every mount point of a ceph file sys