Hi, Some of our users have Quite Large buckets (up to 20M objects in a bucket), and AIUI best practice would be to have sharded indexes for those buckets (of the order of 1 shard per 100k objects).
On a trivial test case (make a 1M-object bucket, shard index to 10 shards, s3cmd ls s3://bucket >/dev/null), sharding makes the bucket listing slower (not a lot, but a bit). Are there simple(ish) workflows we could use to demonstrate an improvement from index sharding? Thanks, Matthew [I understand that Luminous has dynamic resharding, but it seems a bit unstable for production use; is that still the case?] -- The Wellcome Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE. _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
