[ceph-users] Ceph delete files and status

2017-10-19 Thread nigel davies
Hay all I am looking at my small test Ceph cluster, i have uploaded a 200MB iso and checked the space on "ceph status" and see it incress. But when i delete the file the space used does not go down. Have i missed a configuration somewhere or something? ___

Re: [ceph-users] Ceph delete files and status

2017-10-19 Thread nigel davies
Hay I some how got the space back, by tweeking the reweights. but i am a tad confused i uploaded a file (200MB) then removed the file and the space is not changed. i am not sure why that happens and what i can do On Thu, Oct 19, 2017 at 6:42 PM, nigel davies wrote: > PS was not aware

Re: [ceph-users] Ceph delete files and status

2017-10-19 Thread nigel davies
The more information you can give us about how you're testing, the more we can help you. On Thu, Oct 19, 2017 at 5:00 PM nigel davies wrote: > Hay > > I some how got the space back, by tweeking the reweights. > > but i am a tad confused i uploaded a file (200MB) then removed t

Re: [ceph-users] Ceph delete files and status

2017-10-20 Thread nigel davies
tor with > something like: > > $ radosgw-admin gc process > > I haven’t used this command to actually test if this would have the > intended result of freeing up space. But it wouldn’t hurt anything. > > Regards, > > Hans > > On Oct 19, 2017, at 11:06 PM, nigel davies

[ceph-users] Check if Snapshots are enabled

2017-10-20 Thread nigel davies
Hay How would i check if snapshots are or are not enabled? THanks ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Check if Snapshots are enabled

2017-10-20 Thread nigel davies
ok i have set up an s3 bucket link to my ceph cluster so rgw​,i only created my cluster yesterday. i am just trying to work out if i have snapshots enabled for a pool and if so disable it ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists

Re: [ceph-users] Ceph delete files and status

2017-10-20 Thread nigel davies
19 Oct 2017 10:04 pm, "David Turner" wrote: >> >> How are you uploading a file? RGW, librados, CephFS, or RBD? There are >> multiple reasons that the space might not be updating or cleaning itself >> up. The more information you can give us about how you're

[ceph-users] s3 bucket permishions

2017-10-25 Thread nigel davies
Hay All is it possible to set permissions to buckets for example if i have 2 users (user_a and user_b) and 2 buckets (bk_a and bk_b) i want to set permissions, so user a can only see bk_a and user b can only see bk_b I have been looking at cant see what i am after. Any advise would be welcom

Re: [ceph-users] s3 bucket permishions

2017-10-25 Thread nigel davies
d, Oct 25, 2017 at 12:16 PM nigel davies wrote: > >> Hay All >> >> is it possible to set permissions to buckets >> >> for example if i have 2 users (user_a and user_b) and 2 buckets (bk_a >> and bk_b) >> >> i want to set permissions, so user a can only

Re: [ceph-users] s3 bucket permishions

2017-10-26 Thread nigel davies
them sorry i am new to all this and trying to get my head around it On Thu, Oct 26, 2017 at 9:54 AM, Abhishek Lekshmanan wrote: > nigel davies writes: > > > I am fallowing a guide at the mo. > > > > But I believe it's RWG users > > We have support f

Re: [ceph-users] s3 bucket permishions

2017-10-26 Thread nigel davies
Thanks all for offering input I believe i worked it out :D you can set permissions using s3cmd On Thu, Oct 26, 2017 at 10:20 AM, nigel davies wrote: > Thanks i spotted this, when i run the example i get > ERROR: S3 error: 400 (InvalidArgument) > > I found that bucket link will, lin

[ceph-users] (no subject)

2017-10-27 Thread nigel davies
Hay all I am new to ceph and made an test ceph cluster that supports s3 and rbd's (rbd's are linked using iscsi) I been looking about and notice that the space is not decreasing when i delete a file and in turn filled up my cluster osd's I have been doing some reading and see people recomand add

[ceph-users] Ceph S3 nginx Proxy

2017-11-03 Thread nigel davies
Hay all I am trying to set up an ceph cluster with an s3 buckets setup with an nignx proxy. I have the ceph and s3 parts working. :D when i run my php script through the nginx proxy i get an error "SignatureDoesNotMatch" but direct it works fine. Has any one come across this before and can he

Re: [ceph-users] Ceph S3 nginx Proxy

2017-11-03 Thread nigel davies
_frontends = civetweb port=127.0.0.1:1234 > keyring = /etc/ceph/keyring.radosgw.gateway > > > On 03/11/2017 12:26, nigel davies wrote: > > Hay all > > > > I am trying to set up an ceph cluster with an s3 buckets setup with an > > nignx proxy. > > > > I

[ceph-users] s3 bucket policys

2017-11-03 Thread nigel davies
Hay all i am having some problems with S3 acls / policy I want to set up two buckets bucket_upload bucket_process and two users usr_upload usr_process I want to set up acl or policys where usr_upload can write to bucket_upload usr_process can read to bucket_upload usr_process can read and wr

Re: [ceph-users] s3 bucket policys

2017-11-06 Thread nigel davies
ok i am using Jewel vershion when i try setting permissions using s3cmd or an php script using s3client i get the error InvalidArgumenttest_bucket (truncated...) InvalidArgument (client): - InvalidArgumenttest_buckettx a-005a005b91-109f-default109f-default-default in

Re: [ceph-users] s3 bucket policys

2017-11-06 Thread nigel davies
round the subuser keys to the > various apps that need that access to the bucket. It's not pretty, but it > works without altering object permissions. > > On Mon, Nov 6, 2017 at 11:38 AM Adam C. Emerson > wrote: > >> On 06/11/2017, nigel davies wrote: >> > ok

Re: [ceph-users] s3 bucket policys

2017-11-07 Thread nigel davies
new key pair > for each bucket. You also can't set acl permissions for individual objects > in the bucket for a subuser. The permissions for a key pair will apply to > everything in a bucket. It works well enough for what we're doing until we > can upgrade to Luminous and take adv

[ceph-users] Ceph+RBD+ISCSI = ESXI issue

2017-12-01 Thread nigel davies
Hay Ceph version 10.2.5 i have had an Ceph cluster going for a few months, with iscsi servers that are linked to Ceph by RBD. All of an sudden i am starting the ESXI server will louse the isscsi data store (disk space goes to 0 B) and i only fix this by rebooting the ISCSI server When checking

[ceph-users] Ceph luminous nfs-ganesha-ceph

2017-12-14 Thread nigel davies
Hay all i am in the process or trying to set up and VMware storage environment I been reading and found that Iscsi (on jewel release) can cause issues and the datastore can drop out. I been looking at using nfs-ganesha with my ceph platform, it all looked good until i looked at failover to our 2

Re: [ceph-users] Ceph luminous nfs-ganesha-ceph

2017-12-14 Thread nigel davies
: > Is this nfs-ganesha exporting Cephfs? > Are you using NFS for a Vmware Datastore? > What are you using for the NFS failover? > > We need more info but this does sound like a vmware/nfs question rather > than specifically ceph/nfs-ganesha > > On Thu, Dec 14, 2017 at 1:47

[ceph-users] Cephfs NFS failover

2017-12-20 Thread nigel davies
Hay all Can any one advise on how it can do this. I have set up an test ceph cluster 3 osd system 2 NFS servers I want to set up the two NFS serves as an failover process. So if one fails the other starts up. I have tried an few ways and getting stuck any advise would be gratefully received on

[ceph-users] Cephfs limis

2017-12-21 Thread nigel davies
Hay all is it possable to set cephfs to have an sapce limit eg i like to set my cephfs to have an limit of 20TB and my s3 storage to have 4TB for example thanks ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph

Re: [ceph-users] Cephfs NFS failover

2017-12-21 Thread nigel davies
Thanks all on this one The ctdb worked amazing, just need to tweak the settings on it. So the failover happens a tad faster. But all in all it works. Thanks for all your help On 21 Dec 2017 9:08 am, "Robert Sander" wrote: > On 20.12.2017 18:45, nigel davies wrote: > > Hay

Re: [ceph-users] Cephfs limis

2017-12-21 Thread nigel davies
Right ok I take an look. Can you do that after the pool /cephfs has been set up On 21 Dec 2017 12:25 pm, "Yan, Zheng" wrote: > On Thu, Dec 21, 2017 at 6:18 PM, nigel davies wrote: > > Hay all is it possable to set cephfs to have an sapce limit > > eg i like to set m

[ceph-users] MDS locatiins

2017-12-21 Thread nigel davies
Hay all Is it ok to set up mds on the same serves that do host the osd's or should they be on different server's ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] nfs-ganesha HA with Cephfs

2018-05-24 Thread nigel davies
Hay all I am trying to set an HA NFS cluster of two servers. I been reading and want to use RecoveryBackend to be all in ceph, as i under stand i need to craete an new pool and and place it in the config, but when i try and start nfs-ganesha with RecoveryBackend set as rados_ng or rados_kv i g

[ceph-users] radosgw failover help

2018-06-20 Thread nigel davies
Hay All Has any one, done or working a way to do S3(radosgw) failover. I am trying to work out away to have 2 radosgw servers, with an VIP when one server goes down it will go over to the other. I am trying this with CTDB, but while testing the upload can fail and then carry on or just hand and

[ceph-users] Ceph security hardening

2017-02-09 Thread nigel davies
Hay All Does any one have an advise on hardening my ceph cluster? I have or ready doen the cephx auth part, but not sure if i can say limit my ceph user sudo permission to use only ceph commands. Any advise on this would be grateful ___ ceph-users mail

[ceph-users] Fwd: Ceph security hardening

2017-02-09 Thread nigel davies
Hay All Does any one have an advise on hardening my ceph cluster? I have or ready doen the cephx auth part, but not sure if i can say limit my ceph user sudo permission to use only ceph commands. Any advise on this would be grateful ___ ceph-users mail

[ceph-users] Adding multiple osd's to an active cluster

2017-02-17 Thread nigel davies
Hay All How is the best way to added multiple osd's to an active cluster? As the last time i done this i all most killed the VM's we had running on the cluster Thanks ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.

[ceph-users] osd create dmcrypt cant find key

2017-02-20 Thread nigel davies
Hay All I created an small dev ceph cluster and dmcrypt the OSD's but i cant seam to see where the keys are stored after. >From looking at the debug notes the dir should be "/etc/ceph/dmcrypt-keys", but that foulder does not get created and no keys are stored?? Any help on this would be grate

[ceph-users] Fwd: osd create dmcrypt cant find key

2017-02-20 Thread nigel davies
Hay All I created an small dev ceph cluster and dmcrypt the OSD's but i cant seam to see where the keys are stored after. >From looking at the debug notes the dir should be "/etc/ceph/dmcrypt-keys", but that foulder does not get created and no keys are stored?? Any help on this would be grate