On Mon, Jun 17, 2019 at 5:02 PM Harald Staub <harald.st...@switch.ch> wrote:
> There are customers asking for 500 million objects in a single object > storage bucket (i.e. 5000 shards), but also more. But we found some > places that say that there is a limit in the number of shards per > bucket, e.g. > We've got a cluster with a ~450M objects in a bucket with 4096 shards that's working mostly fine. Resharding caused a few timeout issues but that's mostly due to poor SSDs in the index pool. Not sure about listing performance, but it's probably horrible. Paul > > > https://access.redhat.com/documentation/en-us/red_hat_ceph_storage/2/html/object_gateway_guide_for_ubuntu/administration_cli > > It says that the maximum number of shards is 7877. But I could not find > this magic number (or any other limit) on http://docs.ceph.com. > > Maybe this hard limit no longer applies to Nautilus? Maybe there is a > recommended soft limit? > > Background about the application: Veeam (veeam.com) is a backup solution > for VMWare that can embed a cloud storage tier with object storage (only > with a single bucket). Just thinking loud: Maybe this could work with > an indexless bucket. Not sure how manageable this would be, e.g. to > monitor how much space is used. Maybe separate pools would be needed. > > Harry > _______________________________________________ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
