Re: [ceph-users] Fluctuating I/O speed degrading over time

2014-03-08 Thread Martin B Nielsen
Hi Indra, >I'd probably start by looking at your nodes and check if the SSDs are > saturated > >or if they have high write access times. > > Any recommended benchmark tool to do this? Especially those specific to > Ceph OSDs and will not cause any impact on overall performance? > A simple way wou

Re: [ceph-users] Fluctuating I/O speed degrading over time

2014-03-08 Thread Mark Nelson
On 03/07/2014 11:43 PM, Indra Pramana wrote: Hi Mariusz, Good day to you, and thank you for your email. >You should probably start by hooking up all servers into some kind of statistics >gathering software (we use collectd + graphite ) and monitor at least disk stats >(latency + iops + oct

[ceph-users] Incomplete PG

2014-03-08 Thread Stefan Schwarz
Hello, i've lost a complete server and an additional disk on another server over the night. I was able to fix everything except one PG that stays incomplete. i wasn't able to rescue the failed single disk. i already tried to get the cluster back running marking the failes osd as lost. some quest

[ceph-users] Running a mon on a USB stick

2014-03-08 Thread Jake Young
I was planning to setup a small Ceph cluster with 5 nodes. Each node will have 12 disks and run 12 osds. I want to run 3 mons on 3 of the nodes. The servers have an internal SD card that I'll use for the OS and an internal 16GB USB port that I want to mount the mon files to. >From what I understa

Re: [ceph-users] Running a mon on a USB stick

2014-03-08 Thread Kyle Bader
> Is there an issue with IO performance? Ceph monitors store cluster maps and various other things in leveldb, which persists to disk. I wouldn't recommend using a sd/usb cards for the monitor store because they tend to be slow and have poor durability. -- Kyle _