[
https://issues.apache.org/jira/browse/HIVE-4403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13674011#comment-13674011
]
Hudson commented on HIVE-4403:
------------------------------
Integrated in Hive-trunk-h0.21 #2126 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/2126/])
HIVE-4403 : Running Hive queries on Yarn (MR2) gives warnings related to
overriding final parameters (Chu Tong via Ashutosh Chauhan) (Revision 1489008)
Result = FAILURE
hashutosh :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1489008
Files :
* /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
> Running Hive queries on Yarn (MR2) gives warnings related to overriding final
> parameters
> ----------------------------------------------------------------------------------------
>
> Key: HIVE-4403
> URL: https://issues.apache.org/jira/browse/HIVE-4403
> Project: Hive
> Issue Type: Bug
> Affects Versions: 0.10.0, 0.11.0
> Reporter: Mark Grover
> Assignee: Chu Tong
> Fix For: 0.12.0
>
> Attachments: HIVE-4403.patch, HIVE-4403.patch
>
>
> While working on BIGTOP-885, I saw that Hive was giving a bunch of warnings
> related to overriding final parameters in job.conf. This was on a pseudo
> distributed cluster. FWIW, I didn't see this happen on a fully-distributed
> cluster. Perhaps, Hive's job.conf is overriding some final parameters it
> shouldn't.
> Here is what the warnings looked like:
> {code}
> 2013-04-19 14:20:32,304 WARN [main] conf.Configuration
> (Configuration.java:loadProperty(2032)) -
> file:/tmp/root/hive_2013-04-19_14-20-30_159_5701876916688815815/-local-10002/jobconf.xml:an
> attempt to override final parameter:
> mapreduce.job.end-notification.max.retry.interval; Ignoring.
> 2013-04-19 14:20:32,367 WARN [main] conf.Configuration
> (Configuration.java:loadProperty(2032)) -
> file:/tmp/root/hive_2013-04-19_14-20-30_159_5701876916688815815/-local-10002/jobconf.xml:an
> attempt to override final parameter:
> mapreduce.job.end-notification.max.attempts; Ignoring.
> {code}
> To reproduce, run a query like:
> {code}
> CREATE TABLE u_data (
> userid INT,
> movieid INT,
> rating INT,
> unixtime STRING)
> ROW FORMAT DELIMITED
> FIELDS TERMINATED BY '\t'
> STORED AS TEXTFILE;
> {code}
> Load some data into u_data, here is some sample data:
> https://github.com/apache/bigtop/blob/master/bigtop-tests/test-artifacts/hive/src/main/resources/seed_data_files/ml-data/u.data
> Run a simple query on that data (on YARN/MR2)
> {code}
> INSERT OVERWRITE DIRECTORY '/tmp/count'
> SELECT COUNT(1) FROM u_data
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
