Hello, In our deployment we are using the mix of s3 and s3website RGW. I’ve noticed strange behaviour when sending range requests to the s3website RGWs that I’m not able to replicate on the s3 ones.
I’ve created a simple wrk LUA script to test sending range requests on tiny ranges so the issue is easily seen. When sending these requests against s3 RGW I can see that the amount of data read from Ceph is ± equivalent to what the RGW sends to the client. This change very dramatically when I’m doing the same test against s3website RGW. The read from Ceph is huge (3Gb/s compared to ~22Mb/s on s3 RGW) I seems to me like the RGW is reading the whole files and then sending just the range which is different then what s3 does. I do not understand why would s3website need to read that much from Ceph and I believe this is a bug - I was looking through the tracker and wasn’t able to find anything related to s3website and range requests. Did anyone else noticed this issue? You can replicate it by running this wrk command wrk -t56 -c500 -d5m http://${rgwipaddress}:8080/${bucket}/videos/ -s wrk-range-small.lua wrk script -- Initialize the pseudo random number generator math.randomseed( os.time()) math.random(); math.random(); math.random() i = 1 function request() if i == 8 then i = 1 end local nrangefrom = math.random() local nrangeto = math.random(100) local path = wrk.path url = path..i..".mp4" wrk.headers["Range"] = nrangefrom.."-"..nrangeto i = i+1 return wrk.format(nil, url) end Kind regards, Ondrej _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
