yinan zhan created HADOOP-17918:
-----------------------------------
Summary: memory field in SequenceFile.Sorter java int overflow
Key: HADOOP-17918
URL: https://issues.apache.org/jira/browse/HADOOP-17918
Project: Hadoop Common
Issue Type: Bug
Components: common
Affects Versions: 3.3.1
Reporter: yinan zhan
memory field in SequenceFile.Sorter, can cause run method in
SequenceFile.Sorter.SortPass enter an endless loop.
If you set the "io.sort.mb" attribute to a value greater than 2050, as a result
of
{code:java}
this.memory = conf.getInt(CommonConfigurationKeys.IO_SORT_MB_KEY,
CommonConfigurationKeys.SEQ_IO_SORT_MB_DEFAULT) * 1024 * 1024;{code}
, memory field java int overflow, may become negative, so memoryLimit field in
SequenceFile.Sorter.SortPass will be negative too, lead to run method in
SequenceFile.Sorter.SortPass enter an endless loop.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
