Re: Detecting disk/volume failures in Ozone

2023-06-20 Thread Uma Maheswara Rao Gangumalla
Thank you Ethan for working on this important work. Looks like we are not enabled by default to validate the data checksums when writing. I am just thinking that we should validate data with priorities in background scanning?. Example: For files which did not get scanned before should be prioritize

Re: Detecting disk/volume failures in Ozone

2023-06-20 Thread Ethan Rose
Hi Uma, The datanode side checksums on write are still turned off. IO Exceptions on the read/write path will trigger on demand container and volume/disk scans. We could add containers to the on demand scanning queue after they are closed for an initial scan, but this may place unnecessary burden o