[ceph-users] Re: what-does-nosuchkey-error-mean-while-subscribing-for-notification-in-ceph

2021-04-16 Thread David Caro
What does notif.xml have in it? Looking at the docs you linked, I say that it does not find the `S3Key` from that xml for whatever reason. On 04/16 06:54, Szabo, Istvan (Agoda) wrote: > Hi, > > > I am trying to follow this url > https://docs.ceph.com/en/latest/radosgw/s3/bucketops/#create-no

[ceph-users] Re: s3 requires twice the space it should use

2021-04-16 Thread Boris Behrens
Could this also be failed multipart uploads? Am Do., 15. Apr. 2021 um 18:23 Uhr schrieb Boris Behrens : > Cheers, > > [root@s3db1 ~]# ceph daemon osd.23 perf dump | grep numpg > "numpg": 187, > "numpg_primary": 64, > "numpg_replica": 121, > "numpg_stray": 2, >

[ceph-users] Re: what-does-nosuchkey-error-mean-while-subscribing-for-notification-in-ceph

2021-04-16 Thread Yuval Lifshitz
the "Filter" tag is optional in the XML, so I don't think this is the issue. Note that the bucket and topic have to exist when you create the notification. Can you try creating the notification using the AWS CLI tool instead of CURL? You can see examples here: https://github.com/ceph/ceph/tree/mas

[ceph-users] what-does-nosuchkey-error-mean-while-subscribing-for-notification-in-ceph

2021-04-16 Thread Szabo, Istvan (Agoda)
Hi, I am trying to follow this url https://docs.ceph.com/en/latest/radosgw/s3/bucketops/#create-notification to create a publisher for my bucket into a topic. My curl: curl -v -H 'Date: Fri, 16 Apr 2021 05:21:14 +' -H 'Authorization: AWS accessid:secretkey' -L -H 'content-type: text/xml'

[ceph-users] ceph/ceph-grafana docker image for arm64 missing

2021-04-16 Thread mabi
Hello, I want to deploy a new ceph Octopus cluster using cephadm on arm64 architecture but unfortunately the ceph/ceph-grafana docker image for arm64 is missing. Is this mailing list the right place to report this? or where should I report that? Best regards, Mabi __

[ceph-users] Can't get one OSD (out of 14) to start

2021-04-16 Thread Mark Johnson
Really not sure where to go with this one. Firstly, a description of my cluster. Yes, I know there are a lot of "not ideals" here but this is what I inherited. The cluster is running Jewel and has two storage/mon nodes and an additional mon only node, with a pool size of 2. Today, we had a s

[ceph-users] Re: what-does-nosuchkey-error-mean-while-subscribing-for-notification-in-ceph

2021-04-16 Thread Szabo, Istvan (Agoda)
This one: http://s3.amazonaws.com/doc/2006-03-01/";> id1 arn:aws:sns:data::testcephevent Istvan Szabo Senior Infrastructure Engineer --- Agoda Services Co., Ltd. e: istvan.sz...@agoda.com -

[ceph-users] Re: Can't get one OSD (out of 14) to start

2021-04-16 Thread Mark Johnson
I ran an fsck on the problem OSD and found and repaired a couple of errors. Remounted and started the OSD but it crashed again shortly after as before. So (and possibly from bad advise) I figured I'd mark the OSD lost and let it write out the pgs to other OSDs which it's in the process of back

[ceph-users] Octopus - unbalanced OSDs

2021-04-16 Thread Ml Ml
Hello List, any ideas why my OSDs are that unbalanced ? root@ceph01:~# ceph -s cluster: id: 5436dd5d-83d4-4dc8-a93b-60ab5db145df health: HEALTH_WARN 1 nearfull osd(s) 4 pool(s) nearfull services: mon: 3 daemons, quorum ceph03,ceph01,ceph02 (age 2w)

[ceph-users] Re: Can't get one OSD (out of 14) to start

2021-04-16 Thread Alex Gorbachev
Hi Mark, I wonder if the following will help you: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-pg/ There are instructions there on how to mark unfound PGs lost and delete them. You will regain a healthy cluster that way, and then you can adjust replica counts etc to best

[ceph-users] cephadm: how to create more than 1 rgw per host

2021-04-16 Thread i...@z1storage.com
Hello, According to the documentation, there's count-per-host key to 'ceph orch', but it does not work for me: :~# ceph orch apply rgw z1 sa-1 --placement='label:rgw count-per-host:2' --port=8000 --dry-run Error EINVAL: Host and label are mutually exclusive Why it says anything about Host i

[ceph-users] Re: Can't get one OSD (out of 14) to start

2021-04-16 Thread Mark Johnson
That's the exact same page I used to mark the osd as lost. Nothing in there seems to reference the incomplete and down+incomplete pgs that I have however so I really don't know if it helps me. I don't really understand what my problem is here. -Original Message- From: Alex Gorbachev

[ceph-users] Re: Can't get one OSD (out of 14) to start

2021-04-16 Thread Mark Johnson
All the backfill operations are complete and I'm now just left with the 3 incomplete and 1 down+incomplete: # ceph health detail HEALTH_ERR 4 pgs are stuck inactive for more than 300 seconds; 1 pgs down; 4 pgs incomplete; 4 pgs stuck inactive; 4 pgs stuck unclean; 266 requests are blocked > 32

[ceph-users] Re: Can't get one OSD (out of 14) to start

2021-04-16 Thread Mark Johnson
Querying the problem pgs gives me the following: 1.38: { "state": "incomplete", "snap_trimq": "[]", "snap_trimq_len": 0, "epoch": 2247, "up": [ 17, 4 ], "acting": [ 17, 4 ], . "up": [