On Mon, 31 Mar 2014, Michael Nelson wrote:

Hi Loic,

On Sun, 30 Mar 2014, Loic Dachary wrote:

Hi Michael,

I'm trying to reproduce the problem from sources (today's instead of yesterday's but there is no difference that could explain the behaviour you have):

cd src
rm -fr /tmp/dev /tmp/out ; mkdir -p /tmp/dev ; CEPH_DIR=/tmp LC_ALL=C MON=1 OSD=6 bash -x ./vstart.sh -d -n -X -l mon osd ceph osd erasure-code-profile set profile33 ruleset-failure-domain=osd k=3 m=3
ceph osd crush rule create-erasure ecruleset33 profile33
ceph osd pool create testec-33 20 20 erasure profile33 ecruleset33
./rados --pool testec-33 put SOMETHING  /etc/group

but it succeeds. Could you please script a minimal set of commands I could run to repeat the problem you're seeing ?

The file that I put into the pool was 15MB in size and the error occurred after the first 4MB chunk. That might be the difference.

I will try to come up with a list of commands in case that doesn't trigger it for you.

Here is a concise version of what I am deploying with (limited to 6 OSDs in this example).

ceph-deploy new c1 c2 c3
pdsh -wc[1-3] yum -y install ceph
ceph-deploy mon create c1 c2 c3
sleep 30

cd /etc/ceph
ceph-deploy gatherkeys c1 c2 c3

machines=(c1 c2 c3)

for machine in ${machines[@]}; do
        for n in {1..2}; do
                ssh root@$machine 'rm -rf /data$n/osd$n && mkdir -p 
/data$n/osd$n'
                ssh root@$machine 'rm -rf /journals/journal-osd$n'
                ceph-deploy osd prepare 
$machine:/data$n/osd$n:/journals/journal-osd$n
                ceph-deploy osd activate 
$machine:/data$n/osd$n:/journals/journal-osd$n
        done
done

# Wait for OSDs to settle
sleep 60

ceph osd erasure-code-profile set profile33 ruleset-failure-domain=osd k=3 m=3
ceph osd crush rule create-erasure ecruleset33 profile33
ceph osd pool create ectest-33 20 20 erasure profile33 ecruleset33

root@c1:~/ceph# rados -p ectest-33 put xyz sampledata
error putting ectest-33/xyz: Operation not supported

root@c1:~/ceph# du -h sampledata
15M     sampledata

_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Reply via email to