Thanks for clarifying, I think I understand. The idea is that 1,000 ~4KB objects are packed together in RBD which stores them in a single 4MB RADOS object. Does that answer your question?
On 11/03/2021 08:22, Szabo, Istvan (Agoda) wrote: > Hi, > > It relates to this sentence: > "The median object size is ~4KB, written in RBD images using the default > 4MB[0] object size. That will be ~100 millions RADOS objects instead of 100 > billions." > > Istvan Szabo > Senior Infrastructure Engineer > --------------------------------------------------- > Agoda Services Co., Ltd. > e: istvan.sz...@agoda.com > --------------------------------------------------- > > -----Original Message----- > From: Loïc Dachary <l...@dachary.org> > Sent: Thursday, March 11, 2021 2:10 PM > To: Szabo, Istvan (Agoda) <istvan.sz...@agoda.com> > Cc: Ceph Users <ceph-users@ceph.io> > Subject: [ceph-users] Re: A practical approach to efficiently store 100 > billions small objects in Ceph > > Email received from outside the company. If in doubt don't click links nor > open attachments! > ________________________________ > > Hi, > > On 11/03/2021 04:38, Szabo, Istvan (Agoda) wrote: >> Does this mean that even in an object store the files which is smaller than >> 4MB will be packed in one 4 MB object? > I'm not sure I understand the question. Would you be so kind as to rephrase > it? > > Cheers >> -----Original Message----- >> From: Loïc Dachary <l...@dachary.org> >> Sent: Thursday, March 11, 2021 2:13 AM >> To: Konstantin Shalygin <k0...@k0ste.ru> >> Cc: Ceph Users <ceph-users@ceph.io>; swh-de...@inria.fr >> Subject: [ceph-users] Re: A practical approach to efficiently store 100 >> billions small objects in Ceph >> >> Email received from outside the company. If in doubt don't click links nor >> open attachments! >> ________________________________ >> >> Hi Konstantin, >> >> Thanks for the advice. Luckily objects are packed together and Ceph will >> only see larger objects. The median object size is ~4KB, written in RBD >> images using the default 4MB[0] object size. That will be ~100 millions >> RADOS objects instead of 100 billions. >> >> Cheers >> >> [0] https://docs.ceph.com/en/latest/man/8/rbd/#cmdoption-rbd-object-size >> >> On 10/03/2021 17:44, Konstantin Shalygin wrote: >>> Loic, please wait (or use shaman builds) for 14.2.17 cause for clusters >>> with billions of injects code was not optimal [1] at objects delete step >>> >>> >>> [1] https://tracker.ceph.com/issues/47044 >>> <https://tracker.ceph.com/issues/47044> >>> k >>> >>> Sent from my iPhone >>> >>>> On 10 Mar 2021, at 17:55, Loïc Dachary <l...@dachary.org> wrote: >>>> >>>> The next step will be to write and run benchmarks >> -- >> Loïc Dachary, Artisan Logiciel Libre >> >> >> >> ________________________________ >> This message is confidential and is for the sole use of the intended >> recipient(s). It may also be privileged or otherwise protected by copyright >> or other legal rules. If you have received it by mistake please let us know >> by reply email and delete it from your system. It is prohibited to copy this >> message or disclose its content to anyone. Any confidentiality or privilege >> is not waived or lost by any mistaken delivery or unauthorized disclosure of >> the message. All messages sent to and from Agoda may be monitored to ensure >> compliance with company policies, to protect the company's interests and to >> remove potential malware. Electronic messages may be intercepted, amended, >> lost or deleted, or contain viruses. > -- > Loïc Dachary, Artisan Logiciel Libre > > -- Loïc Dachary, Artisan Logiciel Libre
OpenPGP_signature
Description: OpenPGP digital signature
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
