[AMD Official Use Only - General] I can also offer to help if there are any question regarding the ompio code, but I do not have the bandwidth/resources to do that myself, and more importantly, I do not have a platform to test the new component. Edgar
From: users <users-boun...@lists.open-mpi.org> On Behalf Of Jeff Squyres (jsquyres) via users Sent: Tuesday, November 29, 2022 9:16 AM To: users@lists.open-mpi.org Cc: Jeff Squyres (jsquyres) <jsquy...@cisco.com> Subject: Re: [OMPI users] CephFS and striping_factor More specifically, Gilles created a skeleton "ceph" component in this draft pull request: https://github.com/open-mpi/ompi/pull/11122 If anyone has any cycles to work on it and develop it beyond the skeleton that is currently there, that would be great! -- Jeff Squyres jsquy...@cisco.com<mailto:jsquy...@cisco.com> ________________________________ From: users <users-boun...@lists.open-mpi.org<mailto:users-boun...@lists.open-mpi.org>> on behalf of Gilles Gouaillardet via users <users@lists.open-mpi.org<mailto:users@lists.open-mpi.org>> Sent: Monday, November 28, 2022 9:48 PM To: users@lists.open-mpi.org<mailto:users@lists.open-mpi.org> <users@lists.open-mpi.org<mailto:users@lists.open-mpi.org>> Cc: Gilles Gouaillardet <gil...@rist.or.jp<mailto:gil...@rist.or.jp>> Subject: Re: [OMPI users] CephFS and striping_factor Hi Eric, Currently, Open MPI does not provide specific support for CephFS. MPI-IO is either implemented by ROMIO (imported from MPICH, it does not support CephFS today) or the "native" ompio component (that also does not support CephFS today). A proof of concept for CephFS in ompio might not be a huge work for someone motivated: That could be as simple as (so to speak, since things are generally not easy) creating a new fs/ceph component (e.g. in ompi/mca/fs/ceph) and implement the "file_open" callback that uses the ceph API. I think the fs/lustre component can be used as an inspiration. I cannot commit to do this, but if you are willing to take a crack at it, I can create such a component so you can go directly to implementing the callback without spending too much time on some Open MPI internals (e.g. component creation). Cheers, Gilles On 11/29/2022 6:55 AM, Eric Chamberland via users wrote: > Hi, > > I would like to know if OpenMPI is supporting file creation with > "striping_factor" for CephFS? > > According to CephFS library, I *think* it would be possible to do it > at file creation with "ceph_open_layout". > > https://github.com/ceph/ceph/blob/main/src/include/cephfs/libcephfs.h > > Is it a possible futur enhancement? > > Thanks, > > Eric >
