Hadoop Ctl script.

2011-12-28 Thread Prashant Sharma
Hi all, There should exist a "hadoopctl" (A typical script found with most standard opensource utils) script which provides a central way of executing scripts or doing all the tasks. Accompanied by a proper man page it would serve as a standard way of starting various daemons with complete co

[jira] [Resolved] (HADOOP-4131) Allow use of hadoop scripts on EC2

2011-12-28 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-4131. - Resolution: Not A Problem Given Apache Whirr http://whirr.apache.org, this doesn't seem to be a problem

[jira] [Resolved] (HADOOP-3252) Reduce the number of public FileSystem.create() methods

2011-12-28 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-3252. - Resolution: Not A Problem This is fixed as we go ahead with the {{Options}} approach in {{FileContext}},

[jira] [Resolved] (HADOOP-4416) class names in Configuration are not resolved if the configuration value has a white space

2011-12-28 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-4416. - Resolution: Not A Problem We trim in these functions today. This was fixed in more recent jiras. This on

[jira] [Resolved] (HADOOP-5693) The distcp command is working slower in trunk when compared to hadoop-0.18.3

2011-12-28 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-5693. - Resolution: Incomplete This has gone stale. Please reopen if you feel this is still a real issue. Could

Re: Regarding MultipleInputs.addInputPath

2011-12-28 Thread Harsh J
Ensure you are sticking with either new API or old API. I'm sure you have your imports for the Input/Output formats mixed with mapred.* and mapreduce.* stuff. Stabilizing that will fix it. In future, please send user mail to common-u...@hadoop.apache.org and not common-dev, which is for develop

[jira] [Resolved] (HADOOP-3386) the job directory of a failed task may stay forever on a tasktracker node

2011-12-28 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-3386. - Resolution: Cannot Reproduce I'm not seeing failed task dirs flood my local directories during runtime.

Regarding MultipleInputs.addInputPath

2011-12-28 Thread Bhavesh Shah
Hello, I am using the class MultipleInputs class in Map-Rduce program. Syntax is :         MultipleInputs.addInputPath(job, path, inputFormatClass)    or         MultipleInputs.addInputPath(job, path, inputFormatClass, mapperClass) I have used as: MultipleInputs.addInputPath(conf, new Path("hdfs:

[jira] [Resolved] (HADOOP-3579) Support property groups in Hadoop configuration

2011-12-28 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-3579. - Resolution: Not A Problem This has gone stale. If you continue to feel there's merits in doing this, pl

[jira] [Resolved] (HADOOP-3608) Make the JobTracker reentrant

2011-12-28 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-3608. - Resolution: Incomplete This has gone stale. Please reopen if you will be continuing to work on this. Gi

[jira] [Resolved] (HADOOP-1078) Improve logging

2011-12-28 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-1078. - Resolution: Not A Problem I think we've long since switched over to using the .class attribute. Resolvin

[jira] [Resolved] (HADOOP-3669) Aggregate Framework should allow usage of MultipleOutputFormat

2011-12-28 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-3669. - Resolution: Invalid This has gone stale. If this is still required, please reopen and upload a fresher

[jira] [Resolved] (HADOOP-3218) getRecordWriter need not to check the existence of the output directory

2011-12-28 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-3218. - Resolution: Won't Fix This shouldn't be removed, given Amareshwari's comment. > getReco

[jira] [Resolved] (HADOOP-3211) Utility to enforce current replication policy on already exitsting blocks

2011-12-28 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-3211. - Resolution: Not A Problem The balancer does this today. The BlockManager and its services do not, howeve

[jira] [Resolved] (HADOOP-1860) I'd like a log4j appender that can write to a Hadoop FileSystem

2011-12-28 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-1860. - Resolution: Not A Problem This has gone stale. Apparently, from related jiras, 'Chukwa' had come up in

[jira] [Resolved] (HADOOP-2893) checksum exceptions on trunk

2011-12-28 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-2893. - Resolution: Cannot Reproduce This was probably resolved at some point long ago. Gone stale now, and does

[jira] [Resolved] (HADOOP-2837) JobTracker got stuck

2011-12-28 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-2837. - Resolution: Cannot Reproduce > JobTracker got stuck > - > > Key

[jira] [Reopened] (HADOOP-2837) JobTracker got stuck

2011-12-28 Thread Harsh J (Reopened) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reopened HADOOP-2837: - > JobTracker got stuck > - > > Key: HADOOP-2837 > U

[jira] [Resolved] (HADOOP-2837) JobTracker got stuck

2011-12-28 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-2837. - Resolution: Fixed This has gone stale. FWIW, I've never seen an OOM hang on the clusters in the last on

[jira] [Resolved] (HADOOP-2900) distributedcache: Can we create symlink without mapred.create.symlink = yes?

2011-12-28 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-2900. - Resolution: Not A Problem This behavior was fixed at some point such that now it is: [filename]#[symlin

[jira] [Resolved] (HADOOP-2426) TestLocalFileSystemPermission fails in mac

2011-12-28 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-2426. - Resolution: Not A Problem Been years since Leopard is out and it doesn't seem to be a problem anymore:

[jira] [Created] (HADOOP-7942) enabling clover coverage reports fails hadoop unit test compilation

2011-12-28 Thread Giridharan Kesavan (Created) (JIRA)
enabling clover coverage reports fails hadoop unit test compilation --- Key: HADOOP-7942 URL: https://issues.apache.org/jira/browse/HADOOP-7942 Project: Hadoop Common Issue Type

[jira] [Resolved] (HADOOP-2644) Remove the warning for attempting to override a final parameter

2011-12-28 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-2644. - Resolution: Won't Fix I disagree that we should remove this. It may be noise to a developer, but its go

[jira] [Resolved] (HADOOP-2628) the combiner output counter is really counting number of input keys to the combiner

2011-12-28 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-2628. - Resolution: Not A Problem This was resolved at some point in history. We have proper in/out counters and

[jira] [Resolved] (HADOOP-2580) Ability to apply user specified filters on the task logs

2011-12-28 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-2580. - Resolution: Won't Fix Why must this be done today, when there's great browser search and even better pa

[jira] [Created] (HADOOP-7941) NoClassDefFoundError while running distcp/archive

2011-12-28 Thread Ramya Sunil (Created) (JIRA)
NoClassDefFoundError while running distcp/archive - Key: HADOOP-7941 URL: https://issues.apache.org/jira/browse/HADOOP-7941 Project: Hadoop Common Issue Type: Bug Components: build