daimin created HDFS-16422:
-----------------------------
Summary: Fix thread safety of EC decoding during concurrent preads
Key: HDFS-16422
URL: https://issues.apache.org/jira/browse/HDFS-16422
Project: Hadoop HDFS
Issue Type: Bug
Components: dfsclient, ec, erasure-coding
Affects Versions: 3.3.1, 3.3.0
Reporter: daimin
Assignee: daimin
Reading data on an erasure-coded file with missing replicas(internal block of
block group) will cause online reconstruction: read dataUnits part of data and
decode them into the target missing data. Each DFSStripedInputStream object has
a RawErasureDecoder object, and when we doing pread concurrently,
RawErasureDecoder.decode will be invoked concurrently too.
RawErasureDecoder.decode is not thread safe, as a result of that we get wrong
data from pread occasionally.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
