Re: [ceph-users] zone, zonegroup and resharding bucket on luminous

Hello, >> I'm doing some tests on the radosgw on luminous (12.2.1), I have a few >> questions. >> >> In the documentation[1], there is a reference to "radosgw-admin region get" >> but it seems not to be available anymore. >> It should be "radosgw-admin zonegroup get" I guess. >> >> 1. http://doc

Re: [ceph-users] RGW how to delete orphans

The output, to stdout, is something like leaked: $objname. Am I supposed to pipe it to a log, grep for leaked: and pipe it to rados delete? Or am I supposed to dig around in the log pool to try and find the objects there? The information available is quite vague. Maybe Yehuda can shed some light on

Re: [ceph-users] Ceph monitoring

On 02/10/17 20:26, Erik McCormick wrote: > On Mon, Oct 2, 2017 at 11:55 AM, Matthew Vernon wrote: >> Making a dashboard is rather a matter of personal preference - we plot >> client and s3 i/o, network, server load & CPU use, and have indicator >> plots for numbers of osds up&in, and monitor quoru

Re: [ceph-users] Ceph monitoring

On Tue, Oct 3, 2017 at 7:37 AM, Jasper Spaans wrote: > Hi, > > On 02/10/2017 13:34, Osama Hasebou wrote: > > Hi Everyone, > > Is there a guide/tutorial about how to setup Ceph monitoring system using > collectd / grafana / graphite ? Other suggestions are welcome as well ! > > I found some GitHub

[ceph-users] How to use rados_aio_write correctly?

Hello, I'm working on third party code (Bareos Storage daemon) which gives very low write speeds for CEPH. The code was written to demonstrate that it is possible, but the speed is about 3-9 MB/s which is too slow. I modified the routine to use rados_aio_write instead of rados_write, and was ab

Re: [ceph-users] tunable question

Hi, What would make the decision easier: if we knew that we could easily revert the > "ceph osd crush tunables optimal" once it has begun rebalancing data? Meaning: if we notice that impact is too high, or it will take too long, that we could simply again say > "ceph osd crush tunables hamme

Re: [ceph-users] decreasing number of PGs

Thanks for your suggestions and help Andrei > From: "David Turner" > To: "Jack" , "ceph-users" > Sent: Monday, 2 October, 2017 22:28:33 > Subject: Re: [ceph-users] decreasing number of PGs > Adding more OSDs or deleting/recreating pools that have too many PGs are your > only 2 options to red

Re: [ceph-users] BlueStore questions about workflow and performance

Hi Sam, On Mon, Oct 2, 2017 at 6:01 PM Sam Huracan wrote: > Anyone can help me? > > On Oct 2, 2017 17:56, "Sam Huracan" wrote: > >> Hi, >> >> I'm reading this document: >> >> http://storageconference.us/2017/Presentations/CephObjectStore-slides.pdf >> >> I have 3 questions: >> >> 1. BlueStore w

Re: [ceph-users] decreasing number of PGs

Just remember that the warning appears at > 300 PGs/OSD, but the recommendation is 100. I would try to reduce your PGs by 1/3 or as close as you can to that. My learning cluster I had to migrate data between pools multiple times reducing the number of PGs as I went until I got to a more normal amo

Re: [ceph-users] BlueStore questions about workflow and performance

On 10/03/2017 07:59 AM, Alex Gorbachev wrote: Hi Sam, On Mon, Oct 2, 2017 at 6:01 PM Sam Huracan mailto:nowitzki.sa...@gmail.com>> wrote: Anyone can help me? On Oct 2, 2017 17:56, "Sam Huracan" mailto:nowitzki.sa...@gmail.com>> wrote: Hi, I'm reading this document:

Re: [ceph-users] tunable question

On Tue, Oct 3, 2017 at 8:38 AM lists wrote: > Hi, > > What would make the decision easier: if we knew that we could easily > revert the > > "ceph osd crush tunables optimal" > once it has begun rebalancing data? > > Meaning: if we notice that impact is too high, or it will take too long, > that

Re: [ceph-users] BlueStore questions about workflow and performance

Hi Mark, great to hear from you! On Tue, Oct 3, 2017 at 9:16 AM Mark Nelson wrote: > > > On 10/03/2017 07:59 AM, Alex Gorbachev wrote: > > Hi Sam, > > > > On Mon, Oct 2, 2017 at 6:01 PM Sam Huracan > > wrote: > > > > Anyone can help me? > > > > On Oct 2,

[ceph-users] Ceph stuck creating pool

Hi, I have installed a virtual Ceph Cluster lab. I using Ceph Luminous v12.2.1 It consist in 3 mon + 3 osd nodes. Each node have 3 x 250GB OSD. My osd tree: ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF -1 2.19589 root default -3 0.73196 host osd1 0 hdd 0.2

Re: [ceph-users] Ceph stuck creating pool

This looks like something wrong with the crush rule. What's the size, min_size and crush_rule of this pool? ceph osd pool get POOLNAME size ceph osd pool get POOLNAME min_size ceph osd pool get POOLNAME crush_ruleset How is the crush rule? ceph osd crush rule dump Regards, Webert Lima DevO

Re: [ceph-users] Ceph stuck creating pool

Here it is, size: 3 min_size: 2 crush_rule: replicated_rule [ { "rule_id": 0, "rule_name": "replicated_rule", "ruleset": 0, "type": 1, "min_size": 1, "max_size": 10, "steps": [ { "op": "take",

Re: [ceph-users] tunable question

Thanks Jake, for your extensive reply. :-) MJ On 3-10-2017 15:21, Jake Young wrote: On Tue, Oct 3, 2017 at 8:38 AM lists > wrote: Hi, What would make the decision easier: if we knew that we could easily revert the  > "ceph osd crush tunables opti

[ceph-users] radosgw notify on creation/deletion of file in bucket

Hi, Is there any way that radosgw can ping something when a file is removed or added to a bucket? Or use its sync facility to sync files to AWS/Google buckets? Just thinking about backups. What do people use for backups? Been looking at rclone. Thanks, Sean __

Re: [ceph-users] Ceph stuck creating pool

My guess is a networking problem. Do you have vlans, cluster network vs public network in the ceph.conf, etc configured? Can you ping between all of your storage nodes on all of their IPs? All of your OSDs communicate with the mons on the public network, but they communicate with each other for

Re: [ceph-users] radosgw notify on creation/deletion of file in bucket

Just to make sure you're not confusing redundancy with backups. Having your data in another site does not back up your data, but makes it more redundant. For instance if an object/file is accidentally deleted from RGW and you're syncing those files to AWS, Google buckets, or a second RGW cluster

Re: [ceph-users] Ceph stuck creating pool

Hi David; Yes I can ping the host from the cluster network. This is a test lab build in Hyper-V. I think you are right, probably there is a problem with the cluster network. I will check and let you know the results. Thanks very much Guilherme Lima Systems Administrator Main: +351 2

Re: [ceph-users] radosgw notify on creation/deletion of file in bucket

On Tue, Oct 3, 2017 at 8:59 AM, Sean Purdy wrote: > Hi, > > > Is there any way that radosgw can ping something when a file is removed or > added to a bucket? > That depends on what exactly you're looking for. You can't get that info as a user. but there is a mechanism for remote zones to detect

Re: [ceph-users] How to use rados_aio_write correctly?

On Tue, Oct 3, 2017 at 3:15 AM Alexander Kushnirenko wrote: > Hello, > > I'm working on third party code (Bareos Storage daemon) which gives very > low write speeds for CEPH. The code was written to demonstrate that it is > possible, but the speed is about 3-9 MB/s which is too slow. I modifie

Re: [ceph-users] 1 osd Segmentation fault in test cluster

Looks like there is one already. http://tracker.ceph.com/issues/21259 On Tue, Oct 3, 2017 at 1:15 AM, Gregory Farnum wrote: > Please file a tracker ticket with all the info you have for stuff like this. > They’re a lot harder to lose than emails are. ;) > > On Sat, Sep 30, 2017 at 8:31 AM Marc R

Re: [ceph-users] Ceph Developers Monthly - October

On Thu, Sep 28, 2017 at 12:08:00AM -0300, Leonardo Vaz wrote: > Hey Cephers, > > This is just a friendly reminder that the next Ceph Developer Montly > meeting is coming up: > > http://wiki.ceph.com/Planning > > If you have work that you're doing that it a feature work, significant > backports,

[ceph-users] why sudden (and brief) HEALTH_ERR

Hi, Yesterday I chowned our /var/lib/ceph ceph, to completely finalize our jewel migration, and noticed something interesting. After I brought back up the OSDs I just chowned, the system had some recovery to do. During that recovery, the system went to HEALTH_ERR for a short moment: See be