[ceph-users] OSD Startup Best Practice: gpt/udev or SysVInit/systemd ?

2015-02-18 Thread Anthony Alba
Hi Cephers, What is your "best practice" for starting up OSDs? I am trying to determine the most robust technique on CentOS 7 where I have too much choice: udev/gpt/uuid or /etc/init.d/ceph or /etc/systemd/system/ceph-osd@X 1. Use udev/gpt/UUID: no OSD sections in /etc/ceph/mycluster.conf or

[ceph-users] Calamari: No Cluster -> Hosts -> Info?

2015-02-23 Thread Anthony Alba
Running Calamari v1.2.3.1 and hit a oddity: Cluster has registered successfully and all graphs display. Only the "KEY VALUE" tables from Manage > Cluster > Hosts (click the "i' icon) are all empty. Manually running e.g. salt '*' grains.item num_cpus works. salt '*' ceph.get_heartbeats work. /

Re: [ceph-users] Shadow Files

2015-05-05 Thread Anthony Alba
Hi Yehuda, First run: /opt/ceph/bin/radosgw-admin --pool=.rgw.buckets --job-id=testing ERROR: failed to open log pool ret=-2 job not found Do I have to precreate some pool? On Tue, May 5, 2015 at 8:17 AM, Yehuda Sadeh-Weinraub wrote: > > I've been working on a new tool that would detect leak

Re: [ceph-users] Shadow Files

2015-05-05 Thread Anthony Alba
...sorry clicked send to quickly /opt/ceph/bin/radosgw-admin orphans find --pool=.rgw.buckets --job-id=abcd ERROR: failed to open log pool ret=-2 job not found On Tue, May 5, 2015 at 6:36 PM, Anthony Alba wrote: > Hi Yehuda, > > First run: > > /opt/ceph/bin/radosgw-admin --po

Re: [ceph-users] Shadow Files

2015-05-05 Thread Anthony Alba
5, 2015 at 10:41 PM, Yehuda Sadeh-Weinraub wrote: > Can you try creating the .log pool? > > Yehda > > ----- Original Message - >> From: "Anthony Alba" >> To: "Yehuda Sadeh-Weinraub" >> Cc: "Ben" , "ceph-users" >> Sent:

[ceph-users] Giant: only 1 default pool created rbd, no data or metadata

2014-10-12 Thread Anthony Alba
Hi, I am following the manual creation method with 0.8.6 on CentOS7. When I start mon.node1, I only have one pool created. No data, metadata pools. Any suggestions? Steps: ceph-authtool --create-keyring /tmp/ceph.mon.keyring --gen-key -n mon. --cap mon 'allow *' ceph-authtool --create-keyring /

Re: [ceph-users] Giant: only 1 default pool created rbd, no data or metadata

2014-10-12 Thread Anthony Alba
On Mon, Oct 13, 2014 at 12:15 AM, Wido den Hollander wrote: > > That is default now. No CephFS pools are created until you activate CephFS. > > Wido > Thanks you for the explanation! Anthony ___ ceph-users mailing list ceph-users@lists.ceph.com http://l

[ceph-users] Misconfigured caps on client.admin key, anyway to recover from EAESS denied?

2014-10-13 Thread Anthony Alba
Following the manual starter guide, I set up a Ceph cluster with HEALTH_OK, (1 mon, 2 osd). In testing out auth commands I misconfigured the client.admin key by accidentally deleting "mon 'allow *'". Now I'm getting EACESS denied for all ceph actions. Is there a way to recover or recreate a new

Re: [ceph-users] Misconfigured caps on client.admin key, anyway to recover from EAESS denied?

2014-10-13 Thread Anthony Alba
> You can disable cephx completely, fix the key and enable cephx again. > > auth_cluster_required, auth_service_required and auth_client_required That did not work: i.e disabling cephx in the cluster conf and restarting the cluster. The cluster still complained about failed authentication. >I *be

Re: [ceph-users] new installation

2014-10-15 Thread Anthony Alba
Firewall? Disable iptables, set SELinux to Permissive. On 15 Oct, 2014 5:49 pm, "Roman" wrote: > Pascal, > > Here is my latest installation: > > cluster 204986f6-f43c-4199-b093-8f5c7bc641bb > health HEALTH_WARN 192 pgs degraded; 192 pgs stuck unclean; recovery > 20/40 objects degraded (

[ceph-users] Use case: one-way RADOS "replication" between two clusters by time period

2014-10-16 Thread Anthony Alba
Hi list, Can RADOS fulfil the following use case: I wish to have a radosgw-S3 object store that is "LIVE", this represents "current" objects of users. Separated by an air-gap is another radosgw-S3 object store that is "ARCHIVE". The objects will only be created and manipulated by radosgw. Peri

Re: [ceph-users] Use case: one-way RADOS "replication" between two clusters by time period

2014-10-20 Thread Anthony Alba
Great information, thanks. I would like to confirm that if I regularly delete older buckets off the LIVE primary system, the "extra" objects on the ARCHIVE secondaries are ignored during replication. I.e. it does not behave like rsync -avz --delete LIVE/ ARCHIVE/ Rather it behaves more like rs

[ceph-users] Reusing old journal block device w/ data causes FAILED assert(0)

2014-11-13 Thread Anthony Alba
When I create a new OSD with a block device as journal that has existing data on it, ceph is causing FAILED assert. The block device iss a journal from a previous experiment. It can safely be overwritten. If I zero the block device with dd if=/dev/zero bs=512 count=1000 of=MyJournalDev then the a

Re: [ceph-users] Reusing old journal block device w/ data causes FAILED assert(0)

2014-11-13 Thread Anthony Alba
Ah no. On 13 Nov 2014 21:49, "Dan van der Ster" wrote: > Hi, > Did you mkjournal the reused journal? > >ceph-osd -i $ID --mkjournal > > Cheers, Dan > No - however the man page states that "--mkjournal" is for : "Create a new journal file to match an existing object repository. This is usef

[ceph-users] Multiple rules in a ruleset: any examples? Which rule wins?

2014-11-13 Thread Anthony Alba
Hi list, When there are multiple rules in a ruleset, is it the case that "first one wins"? When will a rule faisl, does it fall through to the next rule? Are min_size, max_size the only determinants? Are there any examples? The only examples I've see put one rule per ruleset (e.g. the docs ha

Re: [ceph-users] Multiple rules in a ruleset: any examples? Which rule wins?

2014-11-13 Thread Anthony Alba
at 7:03 AM, Gregory Farnum wrote: > On Thu, Nov 13, 2014 at 2:58 PM, Anthony Alba wrote: >> Hi list, >> >> >> When there are multiple rules in a ruleset, is it the case that "first >> one wins"? >> >> When will a rule faisl, does it fall t

[ceph-users] Radosgw /var/lib/ceph/radosgw is empty

2014-11-14 Thread Anthony Alba
What is the role of /var/lib/ceph/radosgw/ceph-radosgw.$ID? Following the Simple guide and creating the directory it is empty during runtime. Is this correct behaviour. The S3 gateway seems to be working though. Anthony ___ ceph-users mailing list ceph-

[ceph-users] ceph-deploy not creating osd data path directories

2014-11-14 Thread Anthony Alba
HI list, I am running ceph-deploy with a non-standard cluster name. At the activate stage of the OSD the data directory /var/lib/ceph/osd/-0 is not created so the mount fails., If I manually create the directory it works. I can't quite figure out when the directory is supposed to be created.

[ceph-users] Unclear about CRUSH map and more than one "step emit" in rule

2014-11-16 Thread Anthony Alba
The step emit documentation states "Outputs the current value and empties the stack. Typically used at the end of a rule, but may also be used to pick from different trees in the same rule." What use case is there for more than one "step emit"? Where would you put it since a rule looks like rule

[ceph-users] OSD systemd unit files makes it look failed

2014-11-20 Thread Anthony Alba
Hi the current OSD systemd unit files starts the OSD daemons correctly and ceph is HEALTH_OK. However there are some process tracking issues and systemd thinks the service has failed. systemctl stop ceph-osd@0 cannot stop the OSDs. [Service] EnvironmentFile=-/etc/sysconfig/ceph Environment=CLUS

Re: [ceph-users] OSD systemd unit files makes it look failed

2014-11-20 Thread Anthony Alba
HI Sage, Cephers (I'm not on ceph-devel at the moment, will switch in a moment.) Thanks. I am testing on RHEL7/CentOS 7. As quick workaround setting the .service file to [Service] Type=forking ExecStart= ceph-osd -i #without --foreground) ExecPreStart = works for the moment . Is there a

[ceph-users] Pass custom cluster name to SysVinit script on system startup?

2014-11-27 Thread Anthony Alba
How do you start up the SysVinit script with a cluster name? /etc/init.d/ceph (--cluster XXX <--how to you pass this for a normal system reboot; i.e. not run from command line) On a reboot, somehow the OSD manages to come up but the mon fails (no --cluster on the command line).. http://tra

[ceph-users] s3-tests with giant/radosgw, many failures with fastcgi

2014-11-29 Thread Anthony Alba
I am seeing a lot of failures with Giant/radosgw and s3test particularly with fastcgi. I am using community patched apache, fastcgi. civetweb is doing much better. 1. Both tests hangs at s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_above I have to exclude this

[ceph-users] Giant or Firefly for production

2014-12-04 Thread Anthony Alba
Hi Cephers, Have anyone of you decided to put Giant into production instead of Firefly? Any gotchas? Regards Anthony ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] normalizing radosgw

2014-12-07 Thread Anthony Alba
Suggestion: can we look at normalizing custom cluster names as well for RHEL-like systems? /etc/init.d/ceph: how do you pass --cluster myname at system startup? systemd service file uses EnvironmentFile. What about . /etc/sysconfig/ceph #near the top and /etc/sysconfig/ceph contains cluster=myna

[ceph-users] Rgw leaving hundreds of shadow multiparty objects

2014-12-10 Thread Anthony Alba
Hello Cephers I am observing in .87 and .89 that rgw occupies a lot more disk space than the objects and .rgw.buckets has thousands of _shadow and _multipart objects. After deleting the S3 objects he rados objects still remain. radosgw-admin gc list is empty radosgw-admin gc process doesn't cha

Re: [ceph-users] v0.90 released

2014-12-19 Thread Anthony Alba
Hi Sage, Has the repo metadata been regenerated? One of my reposync jobs can only see up to 0.89, using http://ceph.com/rpm-testing. Thanks Anthony On Sat, Dec 20, 2014 at 6:22 AM, Sage Weil wrote: > This is the last development release before Christmas. There are some API > cleanups for l