Re: [RFC] Proposal: Reserve Space for Allocated Blocks

2022-09-28 Thread anu engineer
15 GB sounds excessive; I would first investigate how that can happen and if we have some sort of path this is not explored fully or perhaps a bug, in the allocation or the client are moving too fast for us to respond. If you think the issue is with the clients being able to get leases too fast, I

Re: [DISCUSS] Remove Ozone 0.5.0-beta from downloads page

2022-09-28 Thread Ayush Saxena
Hi Siyao, I don’t understand the line ‘along with its artifacts in Apache archive’ Why would we want to remove it from the archives? https://archive.apache.org/dist/hadoop/ozone/ The archive above has versions as old as 0.2.1-alpha as well. Checked the Hadoop archives as well: https://archive.

[DISCUSS] Remove Ozone 0.5.0-beta from downloads page

2022-09-28 Thread Siyao Meng
Hi Ozone devs, It has been over 2 years since Ozone's first stable release. Just now I realized we still have 0.5.0-beta listed available for download on our website. I here propose removing the 0.5.0-beta download link from the downloads page (along with it

Re: [RFC] Proposal: Reserve Space for Allocated Blocks

2022-09-28 Thread Kaijie Chen
Plus: If someday the QPS of OM and SCM has been improved, this (over-allocation) might be a more significant problem. Kaijie On Wed, 28 Sep 2022 20:54:17 +0800 Kaijie Chen wrote --- > Hi Anu, > > Thanks for your suggestions. These are indeed where we can > improve the code. I have s

Re: [RFC] Proposal: Reserve Space for Allocated Blocks

2022-09-28 Thread Kaijie Chen
Hi Anu, Thanks for your suggestions. These are indeed where we can improve the code. I have something more to share. I did more tests today, and I have observed containers over 15 GB, which is 15 times of the configured container size limit (1 GB). It might be related to the pipeline chosing poli