Hui Fei created HDFS-16105:
------------------------------
Summary: Edit log corruption due to mismatch between fileId and
path
Key: HDFS-16105
URL: https://issues.apache.org/jira/browse/HDFS-16105
Project: Hadoop HDFS
Issue Type: Bug
Components: namanode
Affects Versions: 3.3.1, 3.2.2
Reporter: Hui Fei
We do stress testing in FUSE with HDFS, Standby Namenode crashes.
The log is following
{quote}
2021-06-25 17:13:02,953 ERROR
org.apache.hadoop.hdfs.server.namenode.FSEditLogLoader: Encountered exception
on operation AddBlockOp [path=/xxx/fiotest_write.354.46, penultimateBlock=xxx,
lastBlock=xxx, numOfBytes=0}, RpcClientId=, RpcCallId=-2]
java.io.FileNotFoundException: File /xxx/fiotest_write.354.46 does not exist.
{quote}
The following steps can reproduce it (Illegal writes).
1 create file A (fileId X) (1st block is being written)
2 rename file A to file B(stile fileId X)
3 continue to write file A(using above the same outputstream, 2nd block need to
be written)
4 standby namenode load the above edits and would crash
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
