Re: [ceph-users] Data distribution question

2019-05-02 Thread Shain Miley
EddFhl23N5nD1Q&r=cqFccwnwHGRorPuRWs36Dw&m=4MlyqfSU36xG5-kC0nVslDEynoWLQUUf5xCScKrouvU&s=u3DTgcPLZDP6XwXpcmvDKsNEPswrgE9ICvhnQzrZ1WY&e=> .. Dan (Apologies for terseness, I'm mobile) On Tue, 30 Apr 2019, 20:02 Shain Miley, <mailto:smi...@npr.org>> wrote: Here i

Re: [ceph-users] Data distribution question

2019-04-30 Thread Shain Miley
_new-2Din-2Dnautilus-2Dpg-2Dmerging-2Dand-2Dautotuning_&d=DwICAg&c=E2nBno7hEddFhl23N5nD1Q&r=cqFccwnwHGRorPuRWs36Dw&m=1BfaF7xeFT_o8pdT9mrRmWm0gCn4wgalDi3UviTy24M&s=7-W9i3gJAcCtrL7MzjJlG5LZ_91zeesYBT7g0rGrLh0&e= On 04/30/2019 06:34 PM, Shain Miley wrote: Hi, We have a cl

[ceph-users] Data distribution question

2019-04-30 Thread Shain Miley
der to see if I can balance out the data more uniformly? Thanks in advance, Shain -- NPR | Shain Miley | Manager of Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] crush map has straw_calc_version=0 and legacy tunables on luminous

2019-02-04 Thread Shain Miley
let me know so I don’t end up running the cluster in a sub-optimal state for no reason. Thanks, Shain -- Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 From: ceph-users on behalf of Shain Miley Date: Monday, February 4, 2019 at 3:03 PM To

[ceph-users] crush map has straw_calc_version=0 and legacy tunables on luminous

2019-02-04 Thread Shain Miley
to the cluster. Thanks in advance, Shain -- Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Problem replacing osd with ceph-deploy

2019-02-01 Thread Shain Miley
er to resolve some of this 'backfillfull' errors I am seeing. I am assuming this isn't normal...however this would be the first bluestore osd added to this cluster...so I am not really sure. Thanks in advance, Shain -- NPR | Shain Miley | Ma

[ceph-users] Problem replacing osd with ceph-deploy

2019-02-01 Thread Shain Miley
'backfillfull' errors I am seeing. I am assuming this isn't normal...however this would be the first bluestore osd added to this cluster...so I am not really sure. Thanks in advance, Shain -- NPR | Shain Miley | Manager of Infra

Re: [ceph-users] Ceph Jewel and Ubuntu 16.04

2018-04-17 Thread Shain Miley
16/04/18 18:32, Shain Miley wrote: Hello, We are currently running Ceph Jewel (10.2.10) on Ubuntu 14.04 in production.  We have been running into a kernel panic bug off an on for a while and I am starting to look into upgrading as a possible solution.  We are currently running version 4.4.0-31

[ceph-users] Ceph Jewel and Ubuntu 16.04

2018-04-16 Thread Shain Miley
both Ubuntu and Ceph..in which order should the upgrade occur? Thanks in advance for any insight that you are able to provide me on this issue! Shain -- NPR | Shain Miley | Manager of Infrastructure, Digital Media | smi...@npr.org | 202.513.3649

Re: [ceph-users] Jewel upgrade and feature set mismatch

2017-05-24 Thread Shain Miley
183126872064 watch 15324 osd161 3.edeaca14 npr_archive_orpheus_img.rbd 871904'299183126872064 watch Do you think those 4 write operations are enough to make me think twice about a reboot? Thanks again, Shain On 05/24/2017 08:31 AM, Ilya Dryomov wrote: On Wed, May 24, 2017

[ceph-users] Jewel upgrade and feature set mismatch

2017-05-24 Thread Shain Miley
Hello, We just upgraded from Hammer to Jewel, and after the cluster once again reported a healthy state I set the crush tunables to ‘optimal’ (from legacy). 12 hours later and the cluster is almost done with the pg remapping under the new rules. The issue I am having is the server where we mount

Re: [ceph-users] Hammer to Jewel upgrade questions

2017-05-17 Thread Shain Miley
systemd in each OSD, mon, mds, etc. If you are comfortable using systemd, then go ahead and upgrade the OS first and get the cluster working with systemd before upgrading to jewel. On Wed, May 17, 2017 at 2:25 AM Frédéric Nass <mailto:frederic.n...@univ-lorraine.fr>> wrote:

[ceph-users] Hammer to Jewel upgrade questions

2017-05-16 Thread Shain Miley
emons The two questions I have are: 1)Am I missing anything from the steps above...based on prior experiences performing upgrades of this kind? 2)Should I upgrade to Ubuntu 16.04 first and then upgrade Ceph...or vice versa? Thanks in advance, Shain -- NPR | Shain Miley | Manager of Infr

Re: [ceph-users] active+clean+inconsistent and pg repair

2017-03-21 Thread Shain Miley
d hopefully work fine: > # smartctl -t long /dev/sdX > > If not repeat the above with new found defekt lba. > > Ive done this three time successfully - but not with an error on a primary pg. > > After that you can start the osd with > > # systemctl start ceph-os

Re: [ceph-users] active+clean+inconsistent and pg repair

2017-03-17 Thread Shain Miley
Brian, Never mind...looking back though some older emails I do see an indication of a problem with that drive. I will fail out the osd and replace the drive. Thanks again for the help, Shian On 03/17/2017 03:08 PM, Shain Miley wrote: This sender failed our fraud detection checks

Re: [ceph-users] active+clean+inconsistent and pg repair

2017-03-17 Thread Shain Miley
to detect with a simple list of file size) and differing attributes ("attr -l", but the error logs are usually precise in identifying the problematic PG copy). On Fri, Mar 17, 2017 at 8:16 AM, Shain Miley <mailto:smi...@npr.org>> wrote: Hello, Ceph status is showing:

[ceph-users] active+clean+inconsistent and pg repair

2017-03-17 Thread Shain Miley
? The documentation indicates there are times where running this command is less safe than others...and I would like to be sure before I do so. Thanks, Shain -- NPR | Shain Miley | Manager of Infrastructure, Digital Media |smi...@npr.org | 202.513.3649 __

Re: [ceph-users] Ceph-deploy and git.ceph.com

2017-03-16 Thread Shain Miley
I ended up using a newer version of ceph-deploy and things went more smoothly after that. Thanks again to everyone for all the help! Shain > On Mar 16, 2017, at 10:29 AM, Shain Miley wrote: > > This sender failed our fraud detection checks and may not be who they appear >

Re: [ceph-users] noout, nodown and blocked requests

2017-03-16 Thread Shain Miley
leshooting-osd/ > "STOPPING W/OUT REBALANCING". > > > Your clients are hanging because of the no down flag > > > See this blog for no-out, no-down flags experiements > > https://www.sebastien-han.fr/blog/2013/04/17/some-ceph-experiments/ > > - Mail orig

Re: [ceph-users] Unable to boot OS on cluster node

2017-03-16 Thread Shain Miley
e journals, you should be OK. I think > the keyring and such are typically stored on the OSD itself. If you have lost > track of what physical device maps to what OSD, you can always mount the OSDs > in a temporary spot and cat the “whoami” file. > > —Lincoln > >> On Mar 10

Re: [ceph-users] Ceph-deploy and git.ceph.com

2017-03-16 Thread Shain Miley
meError: Failed to execute command: apt-get -q update Does anyone know if there is still an issue ongoing issue….or is this something that should be working at this point? Thanks again, Shain > On Mar 15, 2017, at 2:08 PM, Shain Miley wrote: > > This sender failed our fraud detecti

Re: [ceph-users] Ceph-deploy and git.ceph.com

2017-03-15 Thread Shain Miley
gt;>> Shain >>>>> >>>>> On Mar 15, 2017, at 12:38 PM, Vasu Kulkarni wrote: >>>>> >>>>> Just curious, why you still want to deploy new hammer instead of stable >>>>> jewel? Is this a test environment? the last .10 r

Re: [ceph-users] Ceph-deploy and git.ceph.com

2017-03-15 Thread Shain Miley
ally for bug > fixes for 0.94.9. > > > > On Wed, Mar 15, 2017 at 9:16 AM, Shinobu Kinjo <mailto:ski...@redhat.com>> wrote: > FYI: > https://plus.google.com/+Cephstorage/posts/HuCaTi7Egg3 > <https://plus.google.com/+Cephstorage/posts/HuCaTi7Egg3> > >

[ceph-users] Ceph-deploy and git.ceph.com

2017-03-15 Thread Shain Miley
Hello, I am trying to deploy ceph to a new server using ceph-deply which I have done in the past many times without issue. Right now I am seeing a timeout trying to connect to git.ceph.com : [hqosd6][INFO ] Running command: env DEBIAN_FRONTEND=noninteractive apt-get -q

[ceph-users] noout, nodown and blocked requests

2017-03-12 Thread Shain Miley
Hello, One of the nodes in our 14 node cluster is offline and before I totally commit to fully removing the node from the cluster (there is a chance I can get the node back in working order in the next few days) I would like to run the cluster with that single node out for a few days. Currently

[ceph-users] Unable to boot OS on cluster node

2017-03-10 Thread Shain Miley
m the cluster, wipe the drives and then re-add them? Right now I have the 'noout' and 'nodown' flags set on the cluster so there has been no data movement yet as a result of this node being down. Thanks in advance for any help. Shain -- NPR | Shain Miley | Manager of Infr

Re: [ceph-users] Ubuntu latest ceph-deploy fails to install hammer

2016-09-09 Thread Shain Miley
Alex, I ran into this issue yesterday as well. I ended up just installing ceph via apt-get locally on the new server. I have not been able to get an actual osd added to the cluster at this point though (see my emails over the last 2 days or so). Please let me know if you end up able to add an o

Re: [ceph-users] Ceph-deploy not creating osd's

2016-09-09 Thread Shain Miley
the osd is not present in either the current crush map or the 'osd tree'. Thanks, Shain > On Sep 8, 2016, at 10:27 PM, Shain Miley wrote: > > I ended up starting from scratch and doing a purge and purgedata on that host > using ceph-deploy, after that things seemed to go b

Re: [ceph-users] Ceph-deploy not creating osd's

2016-09-08 Thread Shain Miley
map: http://pastebin.com/PMk3xZ0a as you can see from the entry for osd number 108 (the last osd to be added to the cluster)...the crush map does not contain a host entry for hqosd10...which is the host for osd #108. Any ideas on how to resolve this? Thanks, Shain On 9/8/16 2:20 PM, Shain

[ceph-users] Ceph-deploy not creating osd's

2016-09-08 Thread Shain Miley
Hello, I am trying to use ceph-deploy to add some new osd's to our cluster. I have used this method over the last few years to add all of our 107 osd's and things have seemed to work quite well. One difference this time is that we are going to use a pci nvme card to journal the 16 disks in

Re: [ceph-users] 2 osd failures

2016-09-07 Thread Shain Miley
hristian Balzer wrote: Hello, Too late I see, but still... On Tue, 6 Sep 2016 22:17:05 -0400 Shain Miley wrote: Hello, It looks like we had 2 osd's fail at some point earlier today, here is the current status of the cluster: You will really want to find out how and why that happene

Re: [ceph-users] 2 osd failures

2016-09-06 Thread Shain Miley
I restarted both osd daemons and things are back to normal. I'm not sure why they failed in the first place but I'll keep looking. Thanks! Shain Sent from my iPhone > On Sep 6, 2016, at 10:39 PM, lyt_yudi wrote: > > hi, > >> 在 2016年9月7日,上午10:17,Shain Miley

[ceph-users] 2 osd failures

2016-09-06 Thread Shain Miley
Hello, It looks like we had 2 osd's fail at some point earlier today, here is the current status of the cluster: root@rbd1:~# ceph -s cluster 504b5794-34bd-44e7-a8c3-0494cf800c23 health HEALTH_WARN 2 pgs backfill 5 pgs backfill_toofull 69 pgs backfi

[ceph-users] Ceph 0.94.8 Hammer upgrade on Ubuntu 14.04

2016-08-30 Thread Shain Miley
, at this point for example if I run 'ceph -v' it will tell me I'm running 0.94.7, even though from my perspective I should be running 0.94.8. Thanks, Shain -- NPR | Shain Miley | Manager of Infrastructure, Digital Media | smi...@npr.org

Re: [ceph-users] Ceph 0.94.8 Hammer upgrade on Ubuntu 14.04

2016-08-30 Thread Shain Miley
semination or copying of this message is prohibited. ---- *From:* Shain Miley [smi...@npr.org] *Sent:* Tuesday, August 30, 2016 11:12 AM *To:* Brian ::; David Turner *Cc:* ceph-users@lists.ceph.com *Subject:* R

Re: [ceph-users] Ceph 0.94.8 Hammer upgrade on Ubuntu 14.04

2016-08-30 Thread Shain Miley
-users [ceph-users-boun...@lists.ceph.com <mailto:ceph-users-boun...@lists.ceph.com>] on behalf of Shain Miley [smi...@npr.org <mailto:smi...@npr.org>] Sent: Tuesday, August 30, 2016 10:59 AM To: ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com> Subjec

Re: [ceph-users] Ceph 0.94.8 Hammer upgrade on Ubuntu 14.04

2016-08-30 Thread Shain Miley
at this point for example if I run 'ceph -v' it will tell me I'm running 0.94.7, even though from my perspective I should be running 0.94.8. Thanks, Shain -- NPR | Shain Miley | Manager of Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 __

[ceph-users] Ceph 0.94.8 Hammer upgrade on Ubuntu 14.04

2016-08-30 Thread Shain Miley
, at this point for example if I run 'ceph -v' it will tell me I'm running 0.94.7, even though from my perspective I should be running 0.94.8. Thanks, Shain -- NPR | Shain Miley | Manager of Infrastructure, Digital Media | smi...@npr.org

Re: [ceph-users] rbd-mirror questions

2016-08-06 Thread Shain Miley
Thank you both for the detailed answers...this gives me a starting point to work from! Shain Sent from my iPhone > On Aug 5, 2016, at 8:25 AM, Jason Dillaman wrote: > >> On Fri, Aug 5, 2016 at 3:42 AM, Wido den Hollander wrote: >> >>> Op 4 augustus 2016 o

[ceph-users] rbd-mirror questions

2016-08-04 Thread Shain Miley
have some rather large rbd images at this point..several in the 90TB range...would there be any concern using rbd-mirror given the size of our images? Thanks, Shain -- NPR | Shain Miley | Manager of Infrastructure, Digital Media | smi...@npr.org | 202.513.3649

Re: [ceph-users] is it time already to move from hammer to jewel?

2016-07-07 Thread Shain Miley
-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- NPR | Shain Miley | Manager of Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com

[ceph-users] Ceph upgrade questions

2016-03-29 Thread Shain Miley
upgrade to hammer then move onto ubuntu upgrades from there? Thanks in advance for any advice, Shain *NPR* | Shain Miley | Manager of Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 ___ ceph-users mailing list ceph-users@lists.ceph.com

[ceph-users] rbd to rbd file copy using 100% cpu

2015-01-20 Thread Shain Miley
til I kill the process. Last time...the best I could tell...a total of 62 MB was copied before the cpu got stuck at 100%. Is this the proper way I should be trying to copy files from one rbd image to another? Thanks, Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media |

Re: [ceph-users] reset osd perf counters

2015-01-14 Thread Shain Miley
rote: >> >> "perf reset" on the admin socket. I'm not sure what version it went in >> to; you can check the release logs if it doesn't work on whatever you >> have installed. :) >> -Greg >> >> >>> On Mon, Jan 12, 2015 at 2:26

Re: [ceph-users] rbd directory listing performance issues

2015-01-14 Thread Shain Miley
y nfs instead of samba to see if that provides better stability moving forward. Thanks, Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 From: Christian Balzer [ch...@gol.com] Sent: Monday, January 12,

Re: [ceph-users] rbd directory listing performance issues

2015-01-12 Thread Shain Miley
Hi, I am just wondering if anyone has any thoughts on the questions below...I would like to order some additional hardware ASAP...and the order that I place may change depending on the feedback that I receive. Thanks again, Shain Sent from my iPhone > On Jan 9, 2015, at 2:45 PM, Shain Mi

[ceph-users] reset osd perf counters

2015-01-12 Thread Shain Miley
Is there a way to 'reset' the osd perf counters? The numbers for osd 73 though osd 83 look really high compared to the rest of the numbers I see here. I was wondering if I could clear the counters out, so that I have a fresh set of data to work with. root@cephmount1:/var/log/samba# ceph os

Re: [ceph-users] rbd directory listing performance issues

2015-01-09 Thread Shain Miley
our users. Thanks again for all the help so far. Shain On 01/07/2015 03:40 PM, Shain Miley wrote: Just to follow up on this thread, the main reason that the rbd directory listing latency was an issue for us, was that we were seeing a large amount of IO delay in a PHP app that reads from that rbd

Re: [ceph-users] rbd directory listing performance issues

2015-01-07 Thread Shain Miley
seems that worst case...a daily or weekly cronjob that traverses the directory tree in that folder might be all we need. Thanks again for all the help. Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649

Re: [ceph-users] rbd directory listing performance issues

2015-01-06 Thread Shain Miley
In general, when looking at the graphs in Calamari, we see around 20ms latency (await) for our OSD's however there are lots of times where we see (via the graphs) spikes of 250ms to 400ms as well. Thanks again, Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media |

Re: [ceph-users] rbd directory listing performance issues

2015-01-06 Thread Shain Miley
readahead on RBD to 4M helps, but it didn't do anything for us. > >> On Tue, Jan 6, 2015 at 12:18 PM, Shain Miley wrote: >> It does seem like the entries get cached for a certain period of time. >> >> Here is the memory listing for the rbd client server: >>

Re: [ceph-users] rbd directory listing performance issues

2015-01-06 Thread Shain Miley
directories at this point. Also...one thing I just noticed is that the 'ls |wc' returns right away...even in cases when right after that I do an 'ls -l' and it takes a while. Thanks, Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@np

Re: [ceph-users] rbd directory listing performance issues

2015-01-06 Thread Shain Miley
Robert, xfs on the rbd image as well: /dev/rbd0 on /mnt/ceph-block-device-archive type xfs (rw) However looking at the mount options...it does not look like I've enabled anything special in terms of mount options. Thanks, Shain Shain Miley | Manager of Systems and Infrastructure, Di

[ceph-users] rbd directory listing performance issues

2015-01-06 Thread Shain Miley
at would warrant upgrading the cluster a a fix to resolve this issue? Any suggestions would be greatly appreciated. Thanks, Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 ___ ceph-users mailing

Re: [ceph-users] Calamari install issues

2014-11-21 Thread Shain Miley
7;))) --- > 'used_bytes': to_bytes(get_latest_graphite(df_path('total_used'))), > 'capacity_bytes': to_bytes(get_latest_graphite(df_path('total_space'))), > 'free_bytes': to_bytes(get_latest_graphite(df_path('total_avail&

[ceph-users] Calamari install issues

2014-11-21 Thread Shain Miley
x27; is not available. hqceph3.npr.org: 'ceph.get_heartbeats' is not available. hqceph2.npr.org: 'ceph.get_heartbeats' is not available. hqosd1.npr.org: 'ceph.get_heartbeats' is not available. Any help trying to move forward would be great! Thanks in adv

Re: [ceph-users] osd down

2014-11-10 Thread Shain Miley
ake care of you. On Thu, Nov 6, 2014 at 5:06 PM, Shain Miley mailto:smi...@npr.org>> wrote: I tried restarting all the osd's on that node, osd.70 was the only ceph process that did not come back online. There is nothing in the ceph-osd log for osd.70. However I do see over 13,000 of

Re: [ceph-users] osd down

2014-11-06 Thread Shain Miley
(sdl1): xfs_log_force: error 5 returned. Does anyone have any suggestions on how I might be able to get this HD back in the cluster (or whether or not it is worth even trying). Thanks, Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513

Re: [ceph-users] cephfs survey results

2014-11-04 Thread Shain Miley
en't set priorities beyond that. We're definitely interested in hearing feedback on this strategy, and on peoples' experiences with giant so far... sage ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.

Re: [ceph-users] PERC H710 raid card

2014-07-16 Thread Shain Miley
ot be used? ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513

Re: [ceph-users] Ceph / Dell hardware recommendation

2014-01-17 Thread Shain Miley
er be looking into the new ceph 'ssd tiering' options, or a little bit less dense Dell nodes for osd's using ssd's for the journals, in order to maximize performance. Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi.

Re: [ceph-users] [Rados Bench Result] Maximum bandwidth only 380MB/sec with 10Gb Network.

2013-12-19 Thread Shain Miley
00)? For example: 'rados bench -p test3 30 write' Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 From: ceph-users-boun...@lists.ceph.com [ceph-users-boun...@lists.ceph.com] on

Re: [ceph-users] radosgw setting puplic ACLs fails.

2013-11-27 Thread Shain Miley
at this point I don't see too many other alternatives for us. Thanks again, Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 From: Derek Yarnell [de...@umiacs.umd.edu] Sent: Wednesday, Novemb

Re: [ceph-users] radosgw setting puplic ACLs fails.

2013-11-26 Thread Shain Miley
ks in advance, Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 From: ceph-users-boun...@lists.ceph.com [ceph-users-boun...@lists.ceph.com] on behalf of Yehuda Sadeh [yeh...@inktank.com] Sent: F

[ceph-users] rbd ext4 vs xfs

2013-11-13 Thread Shain Miley
just wondering, if there is was any major known pros or cons when it comes to using xfs instead of ext4 (or vise versa) for the rbd filesystem. Thanks in advance, Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649

Re: [ceph-users] Radosgw and large files

2013-10-31 Thread Shain Miley
PS...I tested the cancel script it worked like a charm (the script found quite a few partial files that needed to be removed). Thanks again, Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 From

Re: [ceph-users] Radosgw and large files

2013-10-31 Thread Shain Miley
the following file: -rw-r--r-- 1 root root 10737418240 Oct 29 10:36 root.img Thanks again, Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 From: Mark Kirkwood [mark.kirkw...@catalyst.net.nz] Sent

Re: [ceph-users] Full OSD with 29% free

2013-10-31 Thread Shain Miley
Bryan, We are setting up a cluster using xfs and have been a bit concerned about running into similar issues to the ones you described below. I am just wondering if you came across any potential downsides to using a 2K block size with xfs on your osd's. Thanks, Shain Shain Miley | Ma

Re: [ceph-users] Radosgw and large files

2013-10-28 Thread Shain Miley
Mark, Thanks a lot for the info. Hopefully this will resolve our issues going forward! Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 From: Mark Kirkwood [mark.kirkw...@catalyst.net.nz] Sent

Re: [ceph-users] Radosgw and large files

2013-10-26 Thread Shain Miley
ommand for testing. I have tested uploading small files that do not have an extension and I do not seem to be running into the same issue. This may be a bug of some sort so I am going to open a bug report when I get a chance. Thanks, Shain Shain Miley | Manager of Systems and Infrastructure, Dig

Re: [ceph-users] Radosgw and large files

2013-10-26 Thread Shain Miley
cial in your in your ceph.com related to radosgw? Thanks again, Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 From: ceph-users-boun...@lists.ceph.com [ceph-users-boun...@lists.ceph.com] on b

Re: [ceph-users] Radosgw and large files

2013-10-26 Thread Shain Miley
T4.mov INFO: Summary: 1 local files to upload DEBUG: Unicodising '20130718_ascvid_cheyennemizeTEST4.mov' using UTF-8 WARNING: File can not be uploaded: 20130718_ascvid_cheyennemizeTEST4.mov: Permission denied We will need a command line tool to use in cronjobs, etc...so I am hoping I can

[ceph-users] Radosgw and large files

2013-10-26 Thread Shain Miley
multi-part (and it appears that they do as files larger than 15MB gets split into multiple pieces) however I can only upload files smaller than 5GB up to this point. I am using 0.67.4 and Ubuntu 12.04. Thanks in advance, Shain Shain Miley | Manager of Systems and Infrastructure, Digital Me

Re: [ceph-users] OSD journal size

2013-10-23 Thread Shain Miley
ed? Thanks, Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 From: Gruher, Joseph R [joseph.r.gru...@intel.com] Sent: Wednesday, October 23, 2013 6:32 PM To: Shain Miley Cc: ceph-users@lists.ceph.co

Re: [ceph-users] OSD journal size

2013-10-23 Thread Shain Miley
orted...or am I doing something wrong? Thanks, Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 From: ceph-users-boun...@lists.ceph.com [ceph-users-boun...@lists.ceph.com] on behalf of Shain

Re: [ceph-users] OSD journal size

2013-10-23 Thread Shain Miley
Alfredo, Do you know what version of ceph-deploy has this updated functionality I just updated to 1.2.7 and it does not appear to include it. Thanks, Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649

Re: [ceph-users] OSD journal size

2013-10-21 Thread Shain Miley
Alfredo, Thanks a lot for the info. I'll make sure I have an updated version of ceph-deploy and give it another shot. Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 From: Alfredo

[ceph-users] OSD journal size

2013-10-21 Thread Shain Miley
CERN is using '/dev/disk/by-path' for their OSD's. Does ceph-deploy currently support setting up OSD's using this method? Thanks, Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649

Re: [ceph-users] snapshots on CephFS

2013-10-16 Thread Shain Miley
10-13-2013 Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 From: ceph-users-boun...@lists.ceph.com [ceph-users-boun...@lists.ceph.com] on behalf of Kasper Dieter [dieter.kas...@ts.fujitsu.com] Sent:

Re: [ceph-users] cephforum.com

2013-10-11 Thread Shain Miley
again (on both the ML and irc), something like this could help eliminate a bit of the unnecessary traffic as well as help new users get answers to some of their most basic questions right away. Just a thought. Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi

Re: [ceph-users] Hardware recommendations

2013-08-26 Thread Shain Miley
Martin, Thank you very much for sharing your insight on hardware options. This will be very useful for us going forward. Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 From: Martin B Nielsen [mar

[ceph-users] Hardware recommendations

2013-08-26 Thread Shain Miley
Good morning, I am in the process of deciding what hardware we are going to purchase for our new ceph based storage cluster. I have been informed that I must submit my purchase needs by the end of this week in order to meet our FY13 budget requirements (which does not leave me much time). We

Re: [ceph-users] Getting started with RADOS Gateway

2013-07-08 Thread Shain Miley
gateway -i /etc/ceph/keyring.radosgw.gateway The documentation should be updated. Shain Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 From: Howarth, Chris [chris.howa...@citi.com] Sent: Monday, July 08, 20

Re: [ceph-users] Getting started with RADOS Gateway

2013-07-08 Thread Shain Miley
What is the output of 'ceph auth list'? There should be an entry similar to this one: client.radosgw.gateway key: AQB6H9NR6IcMJBAAZOuGdrKPjLXfkEXmNoOirw== caps: [mds] allow caps: [mon] allow rw caps: [osd] allow rwx If it does not exist you will need to create it. Shain On 07

Re: [ceph-users] Radosgw auth and 0.65-1

2013-07-02 Thread Shain Miley
Shain Miley | Manager of Systems and Infrastructure, Digital Media | smi...@npr.org | 202.513.3649 From: Gregory Farnum [g...@inktank.com] Sent: Tuesday, July 02, 2013 12:16 PM To: Shain Miley Cc: ceph-us...@ceph.com Subject: Re: [ceph-users] Radosgw

[ceph-users] Radosgw auth and 0.65-1

2013-07-02 Thread Shain Miley
mdsmap e1: 0/0/1 up Is there any issue with me trying to test radosgw on a node that is already being used as a mon and an osd? I may end up dropping back to the stable release...however I wanted to send a quick email in case there was an easy fix...or this was a bug of some sort. Thanks in adva