Re: Regarding HDFS-15567. HDFS should expose msync() API to allow downstream applications call it explicitly

2020-12-13 Thread Xiaoqiao He
Thanks Steve very much for your discussion here. Leave some comments inline. Will focus on this thread to wait for the final conclusion to decide if we should prepare another release candidate of 3.2.2. Thanks Steve and Chao again for your warm discussions. On Sat, Dec 12, 2020 at 7:18 PM Steve L

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2020-12-13 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/145/ No changes -1 overall The following subsystems voted -1: asflicense hadolint jshint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored:

Re: Regarding HDFS-15567. HDFS should expose msync() API to allow downstream applications call it explicitly

2020-12-13 Thread Steve Loughran
This isn't worth holding up the RC. We'd just add something to the release notes "use with caution". And if we can get what the API does defined in a way which works, it shouldn't need changing. (which reminds me, I do need to check that RC out, don't I?) On Sun, 13 Dec 2020 at 09:00, Xiaoqiao He

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

2020-12-13 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/354/ [Dec 12, 2020 8:42:22 AM] (Adam Antal) YARN-10031. Create a general purpose log request with additional query parameters. Contributed by Andras Gyori -1 overall The following subsystems voted -1

Re: Regarding HDFS-15567. HDFS should expose msync() API to allow downstream applications call it explicitly

2020-12-13 Thread Chao Sun
> This is an API where it'd be ok to have a no-op if not implemented, correct? Or is there an requirement like Syncable that specific guarantees are met? Yes I think it's ok to leave it as no-op for other non-HDFS FS impls: it is only used by HDFS standby reads so far. On Sun, Dec 13, 2020 at 4

Re: Regarding HDFS-15567. HDFS should expose msync() API to allow downstream applications call it explicitly

2020-12-13 Thread Konstantin Shvachko
Hi Steve, I am not sure I fully understand what is broken here. It is not an incompatible change, right? Could you please explain what you think the process is. Would be best if you could share a link to a document describing it. I would be glad to follow up with tests and documentation that are n