On 3/17/16 1:41 PM, Marius Vaitiekunas wrote:
> It's possible that somebody changed the owner of some bucket. But all
> objects in that bucket still belongs to this user. That way you can get
> quota exceeded. We had the same situation.

Well the user says he didn't write to any other buckets than his own.
The usage shows that he did have two other buckets boston_bombing,
charlie_hebdo and the buckets no longer exist (and we have apache logs
for the DELETE for them) but from the usage they were never deleted.  I
am concerned that since the delete never shows up that this is where the
quota is being lost to.

ceph-access.log:192.168.79.51 - - [16/Mar/2016:02:50:01 -0400] "DELETE
/boston_bombing/ HTTP/1.1" 204 - "-" "Boto/2.34.0 Python/2.6.6
Linux/2.6.32-573.18.1.el6.x86_64"

ceph-access.log:192.168.79.51 - - [16/Mar/2016:02:51:47 -0400] "DELETE
/charlie_hebdo/ HTTP/1.1" 204 - "-" "Boto/2.34.0 Python/2.6.6
Linux/2.6.32-573.18.1.el6.x86_64"

# radosgw-admin usage show --uid=username --start-date=2015-01-01
--end-date=2016-03-16
...
{
                    "bucket": "boston",
                    "time": "2016-03-07 23:00:00.000000Z",
                    "epoch": 1457391600,
                    "categories": [
                        {
                            "category": "create_bucket",
                            "bytes_sent": 19,
                            "bytes_received": 0,
                            "ops": 1,
                            "successful_ops": 1
                        },
                        {
                            "category": "get_acls",
                            "bytes_sent": 174400,
                            "bytes_received": 0,
                            "ops": 352,
                            "successful_ops": 352
                        },
                        {
                            "category": "get_obj",
                            "bytes_sent": 86170638,
                            "bytes_received": 0,
                            "ops": 14,
                            "successful_ops": 10
                        },
                        {
                            "category": "list_bucket",
                            "bytes_sent": 381327,
                            "bytes_received": 0,
                            "ops": 10,
                            "successful_ops": 10
                        },
                        {
                            "category": "put_acls",
                            "bytes_sent": 3230,
                            "bytes_received": 73031,
                            "ops": 170,
                            "successful_ops": 170
                        },
                        {
                            "category": "put_obj",
                            "bytes_sent": 0,
                            "bytes_received": 14041021516,
                            "ops": 169,
                            "successful_ops": 169
                        },
                        {
                            "category": "stat_bucket",
                            "bytes_sent": 6688,
                            "bytes_received": 0,
                            "ops": 353,
                            "successful_ops": 352
                        }
                    ]
                }
,
        {
                    "bucket": "charlie_hebdo",
                    "time": "2016-03-07 23:00:00.000000Z",
                    "epoch": 1457391600,
                    "categories": [
                        {
                            "category": "create_bucket",
                            "bytes_sent": 19,
                            "bytes_received": 0,
                            "ops": 1,
                            "successful_ops": 1
                        },
                        {
                            "category": "get_acls",
                            "bytes_sent": 79062,
                            "bytes_received": 0,
                            "ops": 159,
                            "successful_ops": 159
                        },
                        {
                            "category": "get_obj",
                            "bytes_sent": 1096,
                            "bytes_received": 0,
                            "ops": 9,
                            "successful_ops": 4
                        },
                        {
                            "category": "list_bucket",
                            "bytes_sent": 84129,
                            "bytes_received": 0,
                            "ops": 6,
                            "successful_ops": 6
                        },
                        {
                            "category": "put_acls",
                            "bytes_sent": 1406,
                            "bytes_received": 31655,
                            "ops": 74,
                            "successful_ops": 74
                        },
                        {
                            "category": "put_obj",
                            "bytes_sent": 0,
                            "bytes_received": 6920262020,
                            "ops": 73,
                            "successful_ops": 73
                        },
                        {
                            "category": "stat_bucket",
                            "bytes_sent": 3021,
                            "bytes_received": 0,
                            "ops": 160,
                            "successful_ops": 159
                        }
                    ]
                }
,
                {
                    "bucket": "start",
                    "time": "2016-02-05 03:00:00.000000Z",
                    "epoch": 1454641200,
                    "categories": [
                        {
                            "category": "create_bucket",
                            "bytes_sent": 38,
                            "bytes_received": 0,
                            "ops": 2,
                            "successful_ops": 2
                        },
                        {
                            "category": "delete_bucket",
                            "bytes_sent": 19,
                            "bytes_received": 0,
                            "ops": 1,
                            "successful_ops": 1
                        },
                        {
                            "category": "delete_obj",
                            "bytes_sent": 1387,
                            "bytes_received": 0,
                            "ops": 73,
                            "successful_ops": 73
                        },
                        {
                            "category": "get_acls",
                            "bytes_sent": 204482,
                            "bytes_received": 0,
                            "ops": 413,
                            "successful_ops": 413
                        },
                        {
                            "category": "get_obj",
                            "bytes_sent": 16340862938,
                            "bytes_received": 0,
                            "ops": 225,
                            "successful_ops": 187
                        },
                        {
                            "category": "list_bucket",
                            "bytes_sent": 746235,
                            "bytes_received": 0,
                            "ops": 30,
                            "successful_ops": 30
                        },
                        {
                            "category": "put_acls",
                            "bytes_sent": 3705,
                            "bytes_received": 83375,
                            "ops": 195,
                            "successful_ops": 195
                        },
                        {
                            "category": "put_obj",
                            "bytes_sent": 0,
                            "bytes_received": 17571802879,
                            "ops": 194,
                            "successful_ops": 194
                        },
                        {
                            "category": "stat_bucket",
                            "bytes_sent": 9329,
                            "bytes_received": 0,
                            "ops": 493,
                            "successful_ops": 491
                        }
                    ]
                }

-- 
Derek T. Yarnell
University of Maryland
Institute for Advanced Computer Studies
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Reply via email to