hey Istvan, The Hardware Recommendations <https://docs.ceph.com/en/latest/start/hardware-recommendations/> page actually has a ton of info on the questions you are asking, did you go though that one yet?
Without massive overkill, I don't think there's a "bulletproof" design, as the actual I/O use cases vary wildly depending on the application. e.g. you mentioned that "main use case would be k8s users", are there 2000 users that need 500 IOPS each at 100MB/s, OR 5 users that touch the storage every few minutes and store 10MB of data. These are polar opposites with orders of magnitude different requirements. On Fri, Jun 11, 2021 at 10:56 AM Szabo, Istvan (Agoda) < istvan.sz...@agoda.com> wrote: > Couple of team want to use cephfs with k8s so the main use case would be > k8s users. > > Istvan Szabo > Senior Infrastructure Engineer > --------------------------------------------------- > Agoda Services Co., Ltd. > e: istvan.sz...@agoda.com<mailto:istvan.sz...@agoda.com> > --------------------------------------------------- > > On 2021. Jun 11., at 17:48, Ansgar Jazdzewski <a.jazdzew...@googlemail.com> > wrote: > > Hi, > > first of all, check the workload you like to have on the filesystem if > you plan to migrate an old one do some proper performance-testing of > the old storage. > > the io500 can give some ideas https://www.vi4io.org/io500/start but it > depends on the use-case of the filesystem > > cheers, > Ansgar > > Am Fr., 11. Juni 2021 um 10:54 Uhr schrieb Szabo, Istvan (Agoda) > <istvan.sz...@agoda.com>: > > Hi, > > Can you suggest me what is a good cephfs design? I've never used it, only > rgw and rbd we have, but want to give a try. Howvere in the mail list I saw > a huge amount of issues with cephfs so would like to go with some let's say > bulletproof best practices. > > Like separate the mds from mon and mgr? > Need a lot of memory? > Should be on ssd or nvme? > How many cpu/disk ... > > Very appreciate it. > > Istvan Szabo > Senior Infrastructure Engineer > --------------------------------------------------- > Agoda Services Co., Ltd. > e: istvan.sz...@agoda.com<mailto:istvan.sz...@agoda.com> > --------------------------------------------------- > > > ________________________________ > This message is confidential and is for the sole use of the intended > recipient(s). It may also be privileged or otherwise protected by copyright > or other legal rules. If you have received it by mistake please let us know > by reply email and delete it from your system. It is prohibited to copy > this message or disclose its content to anyone. Any confidentiality or > privilege is not waived or lost by any mistaken delivery or unauthorized > disclosure of the message. All messages sent to and from Agoda may be > monitored to ensure compliance with company policies, to protect the > company's interests and to remove potential malware. Electronic messages > may be intercepted, amended, lost or deleted, or contain viruses. > _______________________________________________ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io > _______________________________________________ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io > -- Cheers, Peter Sarossy Technical Program Manager Data Center Data Security - Google LLC. _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
