Re: [ceph-users] Giant to Jewel poor read performance with Rados bench

2016-08-09 Thread David
Hi Mark, thanks for following up. I'm now pretty convinced I have issues with my network, it's not Ceph related. My cursory iperf tests between pairs of hosts were looking fine but with multiple clients I'm seeing really high tcp retransmissions. On Mon, Aug 8, 2016 at 1:07 PM, Mark Nelson wrote:

Re: [ceph-users] Giant to Jewel poor read performance with Rados bench

2016-08-08 Thread Mark Nelson
Hi David, We haven't done any direct giant to jewel comparisons, but I wouldn't expect a drop that big, even for cached tests. How long are you running the test for, and how large are the IOs? Did you upgrade anything else at the same time Ceph was updated? Mark On 08/06/2016 03:38 PM, Da

Re: [ceph-users] Giant to Jewel poor read performance with Rados bench

2016-08-07 Thread David
I created a new pool that only contains OSDs on a single node. The Rados bench gives me the speed I'd expect (1GB/s...all coming out of cache) I then created a pool that contains OSDs from 2 nodes. Now the strange part is, if I run the Rados bench from either of those nodes, I get the speed I'd ex

[ceph-users] Giant to Jewel poor read performance with Rados bench

2016-08-06 Thread David
Hi All I've just installed Jewel 10.2.2 on hardware that has previously been running Giant. Rados Bench with the default rand and seq tests is giving me approx 40% of the throughput I used to achieve. On Giant I would get ~1000MB/s (so probably limited by the 10GbE interface), now I'm getting 300