Doubt regarding classification of jobs given to hadoop

2010-01-28 Thread T. Madana Gopal
Hi all, What are the factors on which we can classify the jobs given to hadoop as CPU intensive or I/O intensive? Regards, T.Madanagopal. - This email was sent using TCEMail Service. Thiagarajar College of Engineering Madurai-625 015, India

Doubt regarding classification of jobs given to hadoop

2010-01-28 Thread T. Madana Gopal
Hi all, What are the factors on which we can classify the jobs given to hadoop as CPU intensive or I/O intensive? Regards, T.Madanagopal. - This email was sent using TCEMail Service. Thiagarajar College of Engineering Madurai-625 015, India

Re: Doubt regarding classification of jobs given to hadoop

2010-01-28 Thread Wang Xu
On Thu, Jan 28, 2010 at 7:46 PM, T. Madana Gopal wrote: > Hi all, >       What are the factors on which we can classify the jobs given to > hadoop as CPU intensive or I/O intensive? In our case, we just compare the input and output, jobs like sort have almost equally input and output, while those

[jira] Created: (HADOOP-6518) Kerberos login in UGI should honor KRB5CCNAME

2010-01-28 Thread Owen O'Malley (JIRA)
Kerberos login in UGI should honor KRB5CCNAME - Key: HADOOP-6518 URL: https://issues.apache.org/jira/browse/HADOOP-6518 Project: Hadoop Common Issue Type: Improvement Components: security

[jira] Resolved: (HADOOP-6506) Failing tests prevent the rest of test targets from execution.

2010-01-28 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik resolved HADOOP-6506. Resolution: Fixed Fix Version/s: 0.20.2 Hadoop Flags: [Reviewed] I hav

[jira] Resolved: (HADOOP-6511) FsPermission.getDefault choice of 0777 is bad in all cases

2010-01-28 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HADOOP-6511. - Resolution: Invalid Hearing no counter-arguments, I'm closing this as invalid... > FsPermission

[jira] Created: (HADOOP-6519) o.a.h.hdfs.server.datanode.DataXceiver - run() - Version mismatch exception - more context to help debugging

2010-01-28 Thread Kay Kay (JIRA)
o.a.h.hdfs.server.datanode.DataXceiver - run() - Version mismatch exception - more context to help debugging Key: HADOOP-6519 URL: https://issues.apache.o

Re: Doubt regarding classification of jobs given to hadoop

2010-01-28 Thread Kay Kay
top iostat utilitities should get some metrics corresponding to the cpu and the io, that can help identify the nature of the job. On 1/28/10 3:46 AM, T. Madana Gopal wrote: Hi all, What are the factors on which we can classify the jobs given to hadoop as CPU intensive or I/O intensi

Re: Doubt regarding classification of jobs given to hadoop

2010-01-28 Thread Abhilaash
> > top > iostat > > utilitities should get some metrics corresponding to the cpu and the io, > that can help identify the nature of the job. > > Thank you sir We found top utility is available and what output it gives but We were not able to find iostat utility.How to install it and

Re: Doubt regarding classification of jobs given to hadoop

2010-01-28 Thread T. Madana Gopal
Thank you sir, 'top' helps to find the cpu time related information in run time.But we need to classify the job as CPU or I/O intensive before executing it. Regards, T.Madanagopal. > > top > iostat > > utilitities should get some metrics corresponding to the cpu and the io, > that c

How to obtain dynamic bandwidth

2010-01-28 Thread Arya
hi all, Is there any way to obtain the dynamic bandwidth?. Is any command available to get the dynamic bandwidth?. Regards, Arya - This email was sent using TCEMail Service. Thiagarajar College of Engineering Madurai-625 015, India

Re: Doubt regarding classification of jobs given to hadoop

2010-01-28 Thread Kay Kay
On 01/28/2010 08:36 PM, Abhilaash wrote: top iostat utilitities should get some metrics corresponding to the cpu and the io, that can help identify the nature of the job. Thank you sir We found top utility is available and what output it gives but We were not able to fi

Re: Doubt regarding classification of jobs given to hadoop

2010-01-28 Thread Kay Kay
You can always perform a dry run before the actual deployment to collect the metrics before going into meaningful deployment. Other options would be to do a rough math based on the input data set / complexity of the algorithms used , but that would be an useful after-step after getting through

[jira] Created: (HADOOP-6520) UGI should load tokens from the environment

2010-01-28 Thread Owen O'Malley (JIRA)
UGI should load tokens from the environment --- Key: HADOOP-6520 URL: https://issues.apache.org/jira/browse/HADOOP-6520 Project: Hadoop Common Issue Type: Bug Reporter: Owen O'Malley For