Does anyone do related work on the log of hadoop?

Hi, all I want to do some study on the log of hadoop. I intend to konw how hadoop record the IO in the logs. Does anyone do related work and give some suggestions? Thanks, May

Re: New to Hadoop

Hi, You dont need to do any course for Hadoop. I think first you read documents, books and understand the architecture, concepts in Hadoop. Then start using Hadoop and write some programs in it. Once you know basics then you can contribute to Hadoop but dont jump directly into contributing code, r

[jira] [Created] (HADOOP-8725) MR is broken when security is off

Daryn Sharp created HADOOP-8725: --- Summary: MR is broken when security is off Key: HADOOP-8725 URL: https://issues.apache.org/jira/browse/HADOOP-8725 Project: Hadoop Common Issue Type: Bug

[jira] [Resolved] (HADOOP-7942) enabling clover coverage reports fails hadoop unit test compilation

[ https://issues.apache.org/jira/browse/HADOOP-7942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HADOOP-7942. Resolution: Fixed Seems like no one has observed a need for this in other branches in six months.

[jira] [Created] (HADOOP-8724) Add improved APIs for globbing

Robert Joseph Evans created HADOOP-8724: --- Summary: Add improved APIs for globbing Key: HADOOP-8724 URL: https://issues.apache.org/jira/browse/HADOOP-8724 Project: Hadoop Common Issue Ty

Re: How to get TaskId from ContainerId or ApplicationId or Request in Hadoop 0.23??

Thanks Vinod. Yes it's the second case where I am working with MR over yarn. When I run a job then for a specific Machine I am trying to compute that how much time the machine takes to execute mapping tasks and reduce tasks. What I am doing now is that I compute time difference between container a

Re: How to get TaskId from ContainerId or ApplicationId or Request in Hadoop 0.23??

Moving to yarn-dev, as that is the right place for this discussion. Can you let us know more about what you are trying to accomplish? Working with MapReduce over YARN or your own YARN application? If you are working with MR over YARN, you have to note that TaskId/TaskAttemptID/Map/Reduce task

Re: I want to revise the source codes, which version is proper?

See http://hadoop.apache.org/common/releases.html for versions and their current status. You can checkout the source code from one of the links at http://hadoop.apache.org/common/version_control.html. HTH, +Vinod On Aug 23, 2012, at 1:56 AM, Li Shengmei wrote: > Hi, all > > I want to

[jira] [Created] (HADOOP-8723) Remove tests and tests-sources jars from classpath

Jason Lowe created HADOOP-8723: -- Summary: Remove tests and tests-sources jars from classpath Key: HADOOP-8723 URL: https://issues.apache.org/jira/browse/HADOOP-8723 Project: Hadoop Common Issue

Re: How to get TaskId from ContainerId or ApplicationId or Request in Hadoop 0.23??

There really is no way. The RM also has no knowledge of map tasks vs reduce tasks nor should it know. --Bobby On 8/22/12 8:23 PM, "Shekhar Gupta" wrote: >In ResourceManager, is there any way to findout if the assigned container >is going to execute a mapping task or a reduce task? I can access

Build failed in Jenkins: Hadoop-Common-trunk #511

See Changes: [tucu] MAPREDUCE-4470. Fix TestCombineFileInputFormat.testForEmptyFile (ikatsov via tucu) [eli] HADOOP-8075. Lower native-hadoop library log from info to debug. Contributed by Hızır Sefa İrken [atm] MAPREDUCE-4577. H

I want to revise the source codes, which version is proper?

Hi, all I want to do some experiments with hadoop. I may revise the source codes of hadoop. Which version is stable for my work? Thanks, May