[
https://issues.apache.org/jira/browse/HIVE-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13836121#comment-13836121
]
Lefty Leverenz commented on HIVE-5910:
--------------------------------------
One more thing: these params are deprecated. The earliest mention I've found
is in
MAPREDUCE-3952 (early 2012) affecting versions 0.24.0 and 0.23.3:
{quote}
2012-02-28 15:56:37,970 WARN conf.Configuration
(Configuration.java:handleDeprecation(326)) - mapred.min.split.size.per.node is
deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node
2012-02-28 15:56:37,971 WARN conf.Configuration
(Configuration.java:handleDeprecation(326)) - mapred.min.split.size.per.rack is
deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack
{quote}
Apparently the deprecation was in effect for Hadoop 0.20:
[https://groups.google.com/a/cloudera.org/forum/#!msg/cdh-user/Xo-Rh9CRcpQ/o6feBnIg63cJ].
It's documented for Hadoop 2.2.0 here:
[http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/DeprecatedProperties.html].
> In HiveConf, the name of mapred.min.split.size.per.rack is
> MAPREDMINSPLITSIZEPERNODE and the name of mapred.min.split.size.per.node is
> MAPREDMINSPLITSIZEPERRACK
> ----------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-5910
> URL: https://issues.apache.org/jira/browse/HIVE-5910
> Project: Hive
> Issue Type: Bug
> Reporter: Yin Huai
>
> In HiveConf.java ...
> {code}
> MAPREDMINSPLITSIZEPERNODE("mapred.min.split.size.per.rack", 1L),
> MAPREDMINSPLITSIZEPERRACK("mapred.min.split.size.per.node", 1L),
> {\code}
> Then, in ExecDriver.java ...
> {code}
> if (mWork.getMinSplitSizePerNode() != null) {
> HiveConf.setLongVar(job, HiveConf.ConfVars.MAPREDMINSPLITSIZEPERNODE,
> mWork.getMinSplitSizePerNode().longValue());
> }
> if (mWork.getMinSplitSizePerRack() != null) {
> HiveConf.setLongVar(job, HiveConf.ConfVars.MAPREDMINSPLITSIZEPERRACK,
> mWork.getMinSplitSizePerRack().longValue());
> }
> {\code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
