Re: [RFC] Proposal: Reserve Space for Allocated Blocks

2022-09-09 Thread anu engineer
Extending the same thought from Steven. If you are going to do a small delay, it is better to do it via a Lease. So SCM could offer a lease for 60 seconds, with a provision to reacquire the lease one more time. This does mean that a single container inside the data node technically could become la

Re: [RFC] Proposal: Reserve Space for Allocated Blocks

2022-09-09 Thread Stephen O'Donnell
> 4. Datanode wait until no write commands to this container, then close it. This could be done on SCM, with a simple delay. Ie hold back the close commands for a "normal" close for some configurable amount of time. Eg if we hold for 60 seconds, it is likely almost all blocks will get written. If