Hi Gabor,
We recently discovered a HDFS data loss issue in any build which uses
snapshots containing HDFS-13101 but not including HDFS-15313. Unfortunately
3.1.4 falls into this category:
git log origin/branch-3.1.4 | egrep "HDFS-(15313|13101)"
HDFS-15012. NN fails to parse Edit logs after applying HDFS-13101.
Contributed by Shashikant Banerjee.
HDFS-13101. Yet another fsimage corruption related to snapshot.
Contributed by Shashikant Banerjee.
See this comment for more information on the bug:
https://issues.apache.org/jira/browse/HDFS-15313?focusedCommentId=17158140&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17158140
I think we should not make a release when we have a known data loss bug in
it. What do you think?
I am going to commit HDFS-15313 onto branch-3.1 shortly, so maybe we should
cut a new RC after including that?
Thanks,
Stephen.
On Mon, Jul 13, 2020 at 11:36 AM Gabor Bota <gabor.b...@cloudera.com.invalid>
wrote:
> Hi folks,
>
> I have put together a release candidate (RC3) for Hadoop 3.1.4.
>
> *****
> The RC includes in addition to the previous ones:
> * fix of YARN-10347. Fix double locking in
> CapacityScheduler#reinitialize in branch-3.1
> (https://issues.apache.org/jira/browse/YARN-10347)
> * the revert of HDFS-14941, as it caused
> HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> (https://issues.apache.org/jira/browse/HDFS-15421)
> * HDFS-15323, as requested.
> (https://issues.apache.org/jira/browse/HDFS-15323)
> *****
>
> The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC3/
> The RC tag in git is here:
> https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC3
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1274/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
>
> Please try the release and vote. The vote will run for 7 weekdays,
> until July 22. 2020. 23:00 CET.
>
>
> Thanks,
> Gabor
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
>
>
