Re: Performance of ratis streaming compared to Ozone [Attach image]

2020-12-14 Thread Rui Wang
Thanks runzhiwang for your explanation! It makes a lot of sense! -Rui On Mon, Dec 14, 2020 at 4:39 PM runzhiwang wrote: > Hi Rui, >I did not post the comparison result of async api and streaming, because > FileStore's asyncApi's implementation is different from Ozone. > FileStore's asyncAp

Re: Performance of ratis streaming compared to Ozone [Attach image]

2020-12-14 Thread runzhiwang
Hi Rui, I did not post the comparison result of async api and streaming, because FileStore's asyncApi's implementation is different from Ozone. FileStore's asyncApi does not have any optimization, such as Ozone implement dataStateMachineCache to improve readStateMachineData, but FileStore's asyn

Re: Performance of ratis streaming compared to Ozone [Attach image]

2020-12-14 Thread Rui Wang
The improvements of Ratis streaming is solid based on the doc! Thanks runzhiwang for your work! After walking through the performance doc, I think the comparison seemed to happen between an Ozone cluster and a filestore? If so, my question is, will the Ozone cluster be too heavy to compare with

Re: Performance of ratis streaming compared to Ozone [Attach image]

2020-12-14 Thread Lin, Yiqun
Hi runzhiwang/ Tsz-Wo, Seems a very good improvement, I am interested for this. As I see the Ratis Streaming feature (RATIS-979) is still in progress state. Do you know current status of this feature and if it's ready and stable for Ozone to use now? Thanks, Yiqun On 2020/12/14, 5:40 PM, "Tsz

Re: Performance of ratis streaming compared to Ozone [Attach image]

2020-12-14 Thread Tsz Wo Sze
runzhiwang, Thanks a lot for working hard on Ratis Streaming and running the benchmarks! Ratis Streaming is going to be a big improvement in Ozone. It is anticipated that Ratis Streaming can - improve the performance as shown in the benchmark results; - improve the scalability of Ozone since Str

Performance of ratis streaming compared to Ozone [Attach image]

2020-12-14 Thread runzhiwang
Hi all, I test the performance of ratis streaming. As the image shows, Raits streaming can improve Ozone's throughput, memory usage, and stability greatly. [image: screenshot-1.png] If you are interested with the test and want to reproduce it, please find the details here: https://docs.google.com

Performance of ratis streaming compared to Ozone

2020-12-14 Thread runzhiwang
Hi all, I test the performance of ratis streaming. As the image shows, Raits streaming can improve Ozone's throughput, memory usage, and stability greatly. [image: image.png] If you are interested with the test and want to reproduce it, please find the details here: https://docs.google.com/docume