Re: [ceph-users] cephfs (rbd) read performance low - where is the bottleneck?

2016-11-20 Thread Eric Eastman
Have you looked at your file layout? On a test cluster running 10.2.3 I created a 5GB file and then looked at the layout: # ls -l test.dat -rw-r--r-- 1 root root 524288 Nov 20 23:09 test.dat # getfattr -n ceph.file.layout test.dat # file: test.dat ceph.file.layout="stripe_unit=4194304 s

[ceph-users] RadosGW not responding if ceph cluster in state health_error

2016-11-20 Thread Thomas
Hi All, I have a cluster setup with 16 OSDs on 4 nodes, standard RGW install with standard rgw pools, replication on those pools is set to 2 (size 2, min_size 1). We've had the situation before where one node totally dropped out (so 4 OSDs) and the cluster health was warning and rgw as well

Re: [ceph-users] Intel P3700 SSD for journals

2016-11-20 Thread Anthony D'Atri
The SATA S3700 series has been the de-facto for journals for some time. And journals don’t neeed all that much space. We’re using 400GB P3700’s. I’ll say a couple of things: o Update to the latest firmware available when you get your drives, qual it and stick with it for a while so you have a

Re: [ceph-users] Ceph - access rdb lock out

2016-11-20 Thread Bruno Silva
I erased and restart the cluster. But the problem continues. So i tested and discover that the problem was the SSD disks Em dom, 20 de nov de 2016 às 23:25, Corentin Bonneton escreveu: > Can you tell me what status your pg is? ceph query given the full results. > > -- > Cordialement, > Corentin

Re: [ceph-users] Ceph - access rdb lock out

2016-11-20 Thread Corentin Bonneton
Can you tell me what status your pg is? ceph query given the full results. -- Cordialement, Corentin BONNETON > Le 21 nov. 2016 à 03:18, Bruno Silva a écrit : > > I killed the structure > > Em dom, 20 de nov de 2016 às 20:37, Corentin Bonneton > escreveu: > Hello, > > P

Re: [ceph-users] Ceph - access rdb lock out

2016-11-20 Thread Bruno Silva
Thanks for the atention. But, the consult returned: "down_osds_we_would_probe" and "peering_blocked_by" empty Em dom, 20 de nov de 2016 às 23:18, Bruno Silva escreveu: > I killed the structure > > Em dom, 20 de nov de 2016 às 20:37, Corentin Bonneton > escreveu: > > Hello, > > Please return c

Re: [ceph-users] Ceph - access rdb lock out

2016-11-20 Thread Bruno Silva
I killed the structure Em dom, 20 de nov de 2016 às 20:37, Corentin Bonneton escreveu: > Hello, > > Please return command : > > ceph pg 0.38 query > > > -- > Cordialement, > Corentin BONNETON > > Le 19 nov. 2016 à 23:54, Bruno Silva a écrit : > > I don't know what can i do to solve this. > I tr

Re: [ceph-users] Ceph - access rdb lock out

2016-11-20 Thread Corentin Bonneton
Hello, Please return command : ceph pg 0.38 query -- Cordialement, Corentin BONNETON > Le 19 nov. 2016 à 23:54, Bruno Silva a écrit : > > I don't know what can i do to solve this. > I try force create pg. > I try deactivate osd. > I add new disks. > And nothing do this scenario change. > >

[ceph-users] Contribution to CEPH

2016-11-20 Thread Jagan Kaartik
I am Jagan Kaartik, a freshman in computer science and engineering from Amrita school of engineering, Kerala, India. I have a basic knowledge in Python and C++. My interest in databases and network storage inspired me to join the CEPH organization. I want to learn and contribute and be a part of

[ceph-users] ceph osd down

2016-11-20 Thread 马忠明
Hi guys, So our cluster always got osd down due to medium error.Our current action plan is to replace the defective disk drive.But I was wondering whether it's too sensitive for ceph to take it down.Or whether our action plan was too simple and crude.Any advice for this issue will be appreciated

[ceph-users] cephfs (rbd) read performance low - where is the bottleneck?

2016-11-20 Thread Mike Miller
Hi, reading a big file 50 GB (tried more too) dd if=bigfile of=/dev/zero bs=4M in a cluster with 112 SATA disks in 10 osd (6272 pgs, replication 3) gives me only about *122 MB/s* read speed in single thread. Scrubbing turned off during measurement. I have been searching for possible bottlen