[ceph-users] Re: Does Replica Count Affect Tell Bench Result or Not?

2022-12-27 Thread hosseinz8...@yahoo.com
Thanks. I am planning to change all of my disks. But do you know enterprise SSD Disk which is best in trade of between cost & iops performance?Which model and brand.Thanks in advance. On Wednesday, December 28, 2022 at 08:44:34 AM GMT+3:30, Konstantin Shalygin wrote: Hi, The cache wa

[ceph-users] Re: CephFS active-active

2022-12-27 Thread Milind Changire
Isaiah, I'm trying to understand your requirements for a CephFS Active-Active setup. What do you want to achieve with a CephFS Active-Active setup ? Once you list the exact requirements, we can discuss further on how to achieve them. There's also something called *CephFS Snapshot Mirroring*: https

[ceph-users] Re: Best Disk Brand for Ceph OSD

2022-12-27 Thread Eneko Lacunza
Hi, El 28/12/22 a las 0:55, hosseinz8...@yahoo.com escribiĂł: Hello Everyone.I want to create ceph cluster with 50 OSD. I am looking for the best enterprise SSD disk model which has high IOPs but acceptable price.Which disk Brand & Model do you know to introduce me to buy? Just search for En

[ceph-users] CephFS active-active

2022-12-27 Thread Isaiah Tang Yue Shun
Hi all, >From the documentation, I can only find Ceph Object Gateway multi-site >implementation. I wonder is it if we are using CephFS, how can we achieve >active-active setup for production? Any input is appreciated. Thanks. Regards, Isaiah Tang __

[ceph-users] Re: Does Replica Count Affect Tell Bench Result or Not?

2022-12-27 Thread Konstantin Shalygin
Hi, The cache was gone, optimize is proceed. This is not enterprise device, you should never use it with Ceph 🙂 k Sent from my iPhone > On 27 Dec 2022, at 16:41, hosseinz8...@yahoo.com wrote: > >  Thanks AnthonyI have a cluster with QLC SSD disks (Samsung QVO 860). The > cluster works for 2

[ceph-users] Re: Cannot create CephFS subvolume

2022-12-27 Thread Milind Changire
Also, please list the volumes available on your system: $ ceph fs volume ls On Wed, Dec 28, 2022 at 9:09 AM Milind Changire wrote: > What ceph version are you using? > > $ ceph versions > > > On Wed, Dec 28, 2022 at 3:17 AM Daniel Kovacs > wrote: > >> Hello! >> >> I'd like to create a CephFS

[ceph-users] Re: Cannot create CephFS subvolume

2022-12-27 Thread Milind Changire
What ceph version are you using? $ ceph versions On Wed, Dec 28, 2022 at 3:17 AM Daniel Kovacs wrote: > Hello! > > I'd like to create a CephFS subvol, with these command: ceph fs > subvolume create cephfs_ssd subvol_1 > I got this error: Error EINVAL: invalid value specified for > ceph.dir.sub

[ceph-users] Re: Urgent help! RGW Disappeared on Quincy

2022-12-27 Thread Deep Dish
Got logging enabled as per https://ceph.io/en/news/blog/2022/centralized_logging/. My embedded grafana doesn't come up in the dashboard, but at least I have log (files) on my nodes. Interesting. Two issues plaguing my cluster: 1 - RGWs not manageable 2 - MDS_SLOW_METADATA_IO warning (impact t

[ceph-users] Best Disk Brand for Ceph OSD

2022-12-27 Thread hosseinz8...@yahoo.com
Hello Everyone.I want to create ceph cluster with 50 OSD. I am looking for the best enterprise SSD disk model which has high IOPs but acceptable price.Which disk Brand & Model do you know to introduce me to buy? Thanks. ___ ceph-users mailing list -- ce

[ceph-users] Cannot create CephFS subvolume

2022-12-27 Thread Daniel Kovacs
Hello! I'd like to create a CephFS subvol, with these command: ceph fs subvolume create cephfs_ssd subvol_1 I got this error: Error EINVAL: invalid value specified for ceph.dir.subvolume If I use another cephfs volume, there were no error reported. What did I wrong? Best regards, Daniel __

[ceph-users] Re: Object missing in bucket index

2022-12-27 Thread mahnoosh shahidi
Hi Ramin, Thanks for your response. Can you explain it a bit more? How is the object locator supposed to fix this problem? And do you have any idea of the root cause? Thank you On Tue, Dec 27, 2022 at 8:33 PM Ramin Najjarbashi < ramin.najarba...@gmail.com> wrote: > Hi Mahnoosh > > try with obje

[ceph-users] Re: Urgent help! RGW Disappeared on Quincy

2022-12-27 Thread Deep Dish
HI Pavin, Thanks for the reply. I'm a bit at a loss honestly as this worked perfectly without any issue up until the rebalance of the cluster. Orchestrator is great. Aside from this (which I suspect is not orchestrator related), I haven't had any issues. In terms of logs, I'm not sure where t

[ceph-users] Re: Object missing in bucket index

2022-12-27 Thread Ramin Najjarbashi
Hi Mahnoosh try with object locator On Tue, Dec 27, 2022 at 8:13 PM mahnoosh shahidi wrote: > Hi Ceph users, > > I have a running cluster in octopus 15.2.12. I found an object in one of my > S3 buckets that does not exist in the bucket list but I can download it > with any client. I also tried

[ceph-users] Object missing in bucket index

2022-12-27 Thread mahnoosh shahidi
Hi Ceph users, I have a running cluster in octopus 15.2.12. I found an object in one of my S3 buckets that does not exist in the bucket list but I can download it with any client. I also tried to get bucket index data by ```radosgw-admin bi list --bucket MYBUCKET --object MYOBJECT``` and it return

[ceph-users] Re: Urgent help! RGW Disappeared on Quincy

2022-12-27 Thread Deep Dish
Quick update: - I followed documentation, and ran the following: # ceph dashboard set-rgw-credentials Error EINVAL: No RGW credentials found, please consult the documentation on how to enable RGW for the dashboard. - I see dashboard credentials configured (all this was working fine before):

[ceph-users] Urgent help! RGW Disappeared on Quincy

2022-12-27 Thread Deep Dish
I built a net-new Quincy cluster (17.2.5) using ceph orch as follows: 2x mgrs 4x rgw 5x mon 4x rgw 5x mds 6x osd hosts w/ 10 drives each --> will be growing to 7 osd hosts in the coming days. I migrated all data from my legacy nautilus cluster (via rbd-mirror, rclone for s3 buckets, etc.). All m

[ceph-users] Re: Does Replica Count Affect Tell Bench Result or Not?

2022-12-27 Thread Anthony D'Atri
I do not have *direct* experience with that model but can share some speculations: That is a *consumer* model, known as “client” in the SSD industry. It’s also QLC. It’s optimized for PB/$. I suspect that at least one of several things is going on. * Cliffing: Client SSDs are architected for

[ceph-users] Re: Does Replica Count Affect Tell Bench Result or Not?

2022-12-27 Thread hosseinz8...@yahoo.com
Thanks AnthonyI have a cluster with QLC SSD disks (Samsung QVO 860). The cluster works for 2 year. Now all OSDs return 12 iops when running tell bench which is very slow. But I Buy new QVO disks yesterday, and I added this new disk to cluster. For the first 1 hour, I got 100 iops from this new

[ceph-users] Re: Empty /var/lib/ceph/osd/ceph-$osd after reboot

2022-12-27 Thread Isaiah Tang Yue Shun
Hi, That's exactly what I meant. I did try to activate but it fails and the problem is due to bluestore label gone after reboot, which in the end caused the activation fail and /var/lib/ceph/osd/ceph-$osd​ empty Upgrading from Pacific to Quincy solved the problem for me. Regards, Isaiah Tang