[ceph-users] Re: v15-2-14-octopus no docker images on docker hub ceph/ceph ?

If you have a look at https://hub.docker.com/r/ceph/ceph "As of August 2021, new ceph/ceph container images are pushed to quay.io registry only. Docker hub won't receive new content for that specific image but current images remain available." Looks like everyone has to pull from quay.io now...

[ceph-users] Re: v15-2-14-octopus no docker images on docker hub ceph/ceph ?

On Sun, 15 Aug 2021 at 00:10, Jadkins21 wrote: > Am I just being too impatient ? or did I miss something around docker > being discontinued for cephadmin ? (hope not, it's great) > not showing via podman either: root@rnk-00:~# podman pull docker.io/ceph/ceph:v15.2.14 Trying to pull docker.io/ce

[ceph-users] Re: performance between ceph-osd and crimson-osd

Hi Igor, Thank you for answering. I understand what you are saying, but I still wonder why the crimson-osd (alienstore) has poor performance. I tested the performance on SeaStore also, but still ObjectStores which use crimson-osd (alienstore, seastore) have extremely poor performance. Do you have

[ceph-users] Fwd: Broken pipe error on Rados gateway log

Hi everyone, Recently, I just noticed that there are a lot of logs about Broken pipe error from all RGW nodes. Log: 2021-08-04T06:25:05.997+ 7f4f15f7b700 1 == starting new request req=0x7f4fac3d7670 = 2021-08-04T06:25:05.997+ 7f4f15f7b700 0 ERROR: client_io->complete_reque

[ceph-users] Re: [ceph-ansible] rolling-upgrade variables not present

Hi Dylan and Dimitri, On 19/8/21 9:56 pm, Dimitri Savineau wrote: If I'm right, I would suggest you to not store your {group,host)_vars directories inside the ceph-ansible sources. A better solution would be to keep the variables and the inventory in the same directory like /etc/ansible in your

[ceph-users] Re: Stretch Cluster with rgw and cephfs?

On Thu, Aug 19, 2021 at 3:50 PM Sean Matheny wrote: > > Hi all, > > The docs for setting up a stretch cluster look fairly straightforward > (https://docs.ceph.com/en/latest/rados/operations/stretch-mode/ > ), and I can > see how th

[ceph-users] Stretch Cluster with rgw and cephfs?

Hi all, The docs for setting up a stretch cluster look fairly straightforward (https://docs.ceph.com/en/latest/rados/operations/stretch-mode/ ), and I can see how this works with RBD pools—i.e. the client only specifies the local

[ceph-users] Re: hard disk failure, unique monitor down: ceph down, please help

On Thu, Aug 19, 2021 at 2:52 PM Ignacio García wrote: > > Hi, > > In a production ceph system (with pending tasks as you'll see) we have > had a disaster: the server's boot disk where the only monitor was > running has failed, containing as well the monitor daemon data. We will > appreciate any he

[ceph-users] hard disk failure, unique monitor down: ceph down, please help

Hi, In a production ceph system (with pending tasks as you'll see) we have had a disaster: the server's boot disk where the only monitor was running has failed, containing as well the monitor daemon data. We will appreciate any help you can offer before we break anything that could be recover

[ceph-users] Re: Manually add monitor to a running cluster

Question: You don't have to add the new monitor (i.e. mon2) on the monitor map of the running monitor to allow to join the cluster? Because these are the instruction I followed but the mon2 doesn't start because it was not mapped on the cluster. This will be done automatically when the mon is j

[ceph-users] Re: Manually add monitor to a running cluster

mkdir /var/lib/ceph/mon/ceph-$(hostname -s) This has to be done on new host, right? ceph auth get mon. -o /tmp/mon-keyfile ceph mon getmap -o /tmp/mon-monmap This has to be done on the running mon host, right? Then we have to send monmap and keyfiles on the new host? ceph-

[ceph-users] Manually add monitor to a running cluster

Good afternoon, I'm doing my best to follow all the instructions here to add extra monitors to a running cluster: https://docs.ceph.com/en/latest/rados/operations/add-or-rm-mons/ Unfortunately they seems quite confused and incomplete; can someone point me to have a more detailed and complete

[ceph-users] Re: EC CLAY production-ready or technology preview in Pacific?

I cannot speak in any official capacity, but my limited experience (20-30TB) EC CLAY has been functioning without an error for about 2 years. No issues in Pacific myself yet (fingers crossed). Statistics is not the plural of anecdote… YMMV, Jeremy On Thu, Aug 19, 2021 at 12:56 AM Alexander Sporle

[ceph-users] Re: S3 Bucket Notification requirement

Hi Yuval, Thanks very much for your reply. I am using AMQP 0.9.1. Can I use aws sns create-topic command to create a topic in Ceph's RadosGW ?,, If Yes then How and where to define notifications to associate with created topics? Basically, I want to understand the tasks needs to be defined in

[ceph-users] Re: S3 Bucket Notification requirement

Hi Sanjeev, Welcome to the Ceph community! Which protocol do you intend to use in ActiveMQ? If you want to use AMQP1.0, you will have to wait, as this is still not officially supported [1]. Currently, we support AMQP0.9.1, Kafka, and HTTP. As for the more general question. To make bucket notifica

[ceph-users] Re: performance between ceph-osd and crimson-osd

Can you run it with 4k block size , 1 thread. ( Default is 4M and 16 threads) $ rados bench -p rbd 10 write -b 4096 -t 1 --no-cleanup On 19/08/2021 04:22, 신희원 / 학생 / 컴퓨터공학부 wrote: Hi, I measured the performance of ceph-osd and crimson-osd with same single core affinity. I checked IOPS, Lat

[ceph-users] Re: Manually add monitor to a running cluster

Hi, so yes I was assuming that the new mon is a member of the cluster, so packages are installed and ceph.conf in place! You also need to add the IP of the new mon to the ceph.conf when you are done and redistribute it to all members of the cluster. Ansgar Am Do., 19. Aug. 2021 um 15:30 Uhr schr

[ceph-users] Missing OSD in SSD after disk failure

Hi everyone! I've got a doubt, I tried searching for it in this list, but didn't find an answer. I've got 4 OSD servers. Each server has 4 HDDs and 1 NVMe SSD disk. The deployment was done with "ceph orch apply deploy-osd.yaml", in which the file "deploy-osd.yaml" contained the following: --- s

[ceph-users] S3 Bucket Notification requirement

Dear Sir, I would like to inform you that I am new to Ceph, specially new to the S3 bucket notification topic and not able to understand how exactly to configure it in RadaosGW. We are using an ActiveMQ broker. There is no easy technical documentation for Ceph available and I am not sure how an

[ceph-users] Re: [ceph-ansible] rolling-upgrade variables not present

Hi Gregory, > $ time ansible-playbook infrastructure-playbooks/rolling_update.yml -e ireallymeanit=yes You mentioned you were using /etc/ansible/hosts as the ansible inventory file. But where are located the group_vars and host_vars directories ? It looks like you have your group_vars and host_v

[ceph-users] nautilus: abort in EventCenter::create_file_event

Hi Ceph users, one of our backup jobs ran into the following assertion. Is this something known? /build/ceph-14.2.21/src/msg/async/Event.cc: In function 'int EventCenter::create_file_event(int, int, EventCallbackRef)' thread 7f3c5d893700 time 2021-08-19 01:29:23.981240 /build/ceph-14.2.21/s

[ceph-users] Re: [ceph-ansible] rolling-upgrade variables not present

> >I deployed Ceph 14.2.16 with ceph-ansible stable-4.0 a while back, and >want to test upgrading. So for now I am trying rolling_update.yml for >latest 14.x (before trying stable-5.0 and 15.x) but getting some errors, >which seem to indicate empty or missing variables. > >Initially monitor_inte

[ceph-users] Re: Manually add monitor to a running cluster

Hi, Am Do., 19. Aug. 2021 um 14:57 Uhr schrieb Francesco Piraneo G. : > > > >mkdir /var/lib/ceph/mon/ceph-$(hostname -s) > > This has to be done on new host, right? Yes > >ceph auth get mon. -o /tmp/mon-keyfile > >ceph mon getmap -o /tmp/mon-monmap > This has to be done on the runni

[ceph-users] Re: Manually add monitor to a running cluster

Hi Francesco, in short you need to do this: mkdir /var/lib/ceph/mon/ceph-$(hostname -s) ceph auth get mon. -o /tmp/mon-keyfile ceph mon getmap -o /tmp/mon-monmap ceph-mon -i $(hostname -s) --mkfs --monmap /tmp/mon-monmap --keyring /tmp/mon-keyfile chown -R ceph: /var/lib/ceph/mon/ceph-$

[ceph-users] Re: performance between ceph-osd and crimson-osd

Hi Shin, a side note -  you disk choice might be inappropriate for Ceph - AFAIK this is a consumer model which apparently lacks power loss protection. This causes dramatic performance drop when each write request is followed by fsync one. And this is the mode RocksDB/BlueFS work in. Hence ex

[ceph-users] [ceph-ansible] rolling-upgrade variables not present

I deployed Ceph 14.2.16 with ceph-ansible stable-4.0 a while back, and want to test upgrading. So for now I am trying rolling_update.yml for latest 14.x (before trying stable-5.0 and 15.x) but getting some errors, which seem to indicate empty or missing variables. Initially monitor_interface w

[ceph-users] EC CLAY production-ready or technology preview in Pacific?

Hallo list, Is the "EC CLAY code plugin" considered to be production-ready in Pacific or is it more a technology preview? Best, Alex ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Re: performance between ceph-osd and crimson-osd

> > https://docs.google.com/spreadsheets/d/1AXj9h0yDc2ztFWuptqcTrNU2Ui3wMyAn > 6QUft3CPdcc/edit?usp=sharing > > > The gist of it is that on the read path, crimson+cyanstore is > significantly more efficient than crimson+alienstore and any classic > setup.  We are slower in terms of absolute perf

[ceph-users] Re: performance between ceph-osd and crimson-osd

Hi Mark. Thanks for answering. I tested the performance on Samsung NVMe SSD 960 PRO 512GB, 2-way E5-2650(2.2GHz, 12-core) CPU , not HDD... Is it a problem that I check the performance on ceph that is deployed by 'vstart'..? Please tell me how to deploy ceph to achieve similar results..! Thank you