RE: About debugging HDFS and MapReduce...

2013-10-06 Thread Yoonmin Nam
Sorry for this inconvenience. I uploaded image file on our lab server. http://infolab.dgist.ac.kr/~ronymin/pictures/debug.png -Original Message- From: haosdent [mailto:haosd...@gmail.com] Sent: Monday, October 07, 2013 2:24 PM To: hdfs-dev@hadoop.apache.org; 남윤민 Subject: Re: About debug

Re: About debugging HDFS and MapReduce...

2013-10-06 Thread haosdent
I still couldn't see the image. The page shows that "The page you requested could not be found.". -- Best Regards, Haosong Huang Sent with Sparrow (http://www.sparrowmailapp.com/?sig) On Monday, October 7, 2013 at 12:38 PM, 남윤민 wrote: > Here is image I uploaded. > > Sorry for that! > > h

Re: Re: About debugging HDFS and MapReduce...

2013-10-06 Thread 남윤민
Here is image I uploaded. Sorry for that! http://mail.dgist.ac.kr/design/common/image/attaches//ronymin_167_inline0_6806441608437847.png --- Original Message --- >From : "Ted Yu" To : hdfs-dev@hadoop.apache.org Cc : hdfs-dev@hadoop.apache.org Date : 2013/10/07 월요일 오후 1:22:45 Subject : Re: Ab

Re: 2.1.2 (Was: Re: [VOTE] Release Apache Hadoop 2.1.1-beta)

2013-10-06 Thread Arun C Murthy
Looks like we are all clear now, I'll create an RC presently. Thanks everyone. Arun On Oct 1, 2013, at 8:59 PM, Arun C Murthy wrote: > Yes, sorry if it wasn't clear. > > As others seem to agree, I think we'll be better getting a protocol/api > stable GA done and then iterating on bugs etc. >

Re: About debugging HDFS and MapReduce...

2013-10-06 Thread Ted Yu
Your image didn't go through. You may want to upload it to image sharing site. What version of Hadoop are you using ? Thanks On Oct 6, 2013, at 8:56 PM, 남윤민 wrote: > Hello!! > My name is Yoonmin Nam from South Korea. > > Currently, I am trying to debug namenode and datanode using eclipse and

About debugging HDFS and MapReduce...

2013-10-06 Thread 남윤민
Hello!! My name is Yoonmin Nam from South Korea.Currently, I am trying to debug namenode and datanode using eclipse and fully-distributed environemnt in my lab. (1 master and 10 nodes)However, I can do debug but not fully, just some portion of source code of hadoop.This means I cannot see how so

Re: [Proposal] Pluggable Namespace

2013-10-06 Thread Mahadev Konar
Milind, Am I missing something here? This was supposed to be a discussion and am hoping thats why you started the thread. I don't see anywhere any conspiracy theory being considered or being talked about. Vinod asked some questions, if you can't or do not want to respond I suggest you skip emai

RE: [Proposal] Pluggable Namespace

2013-10-06 Thread Milind Bhandarkar
Vinod, I have received a few emails about concerns that this effort somehow conflicts with federated namenodes. Most of these emails are from folks who are directly or remotely associated with Hortonworks. Three weeks ago, I sent emails about this effort to a few Hadoop committers who are primar

[jira] [Created] (HDFS-5314) Do not expose CachePool type in AddCachePoolOp

2013-10-06 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-5314: -- Summary: Do not expose CachePool type in AddCachePoolOp Key: HDFS-5314 URL: https://issues.apache.org/jira/browse/HDFS-5314 Project: Hadoop HDFS

[jira] [Created] (HDFS-5313) NameNode hangs during startup trying to apply OP_ADD_PATH_BASED_CACHE_DIRECTIVE.

2013-10-06 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-5313: --- Summary: NameNode hangs during startup trying to apply OP_ADD_PATH_BASED_CACHE_DIRECTIVE. Key: HDFS-5313 URL: https://issues.apache.org/jira/browse/HDFS-5313 Project: H

RE: [Proposal] Pluggable Namespace

2013-10-06 Thread Milind Bhandarkar
Vinod, Block Pool management separation makes this effort easier. Even with that separation, the namespace implementation is still embedded within the namenode, federated or otherwise. This effort is much less ambitious. All it attempts to do is allow different namespace implementation. - milind

Re: [Proposal] Pluggable Namespace

2013-10-06 Thread Vinod Kumar Vavilapalli
In order to make federation happen, the block pool management was already separated. Isn't that the same as this effortt? Thanks, +Vinod On Oct 6, 2013, at 9:35 AM, Milind Bhandarkar wrote: > Federation is orthogonal with Pluggable Namespaces. That is, one can use > Federation if needed, even w

[jira] [Resolved] (HDFS-5272) DFSUtil#getInfoServer cleanup

2013-10-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-5272. -- Resolution: Duplicate > DFSUtil#getInfoServer cleanup > - > >

[jira] [Created] (HDFS-5312) Refactor DFSUtil#getInfoServer to return an URI

2013-10-06 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-5312: Summary: Refactor DFSUtil#getInfoServer to return an URI Key: HDFS-5312 URL: https://issues.apache.org/jira/browse/HDFS-5312 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-5309) Fix failing caching unit tests

2013-10-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-5309. --- Resolution: Fixed Fix Version/s: HDFS-4949 Thanks Chris, committed to branch. > Fix failing ca

RE: [Proposal] Pluggable Namespace

2013-10-06 Thread Milind Bhandarkar
Federation is orthogonal with Pluggable Namespaces. That is, one can use Federation if needed, even while a distributed K-V store is used on the backend. Limitations of Federated namenode for scaling namespace are well-documented in several places, including the Giraffa presentation. HBase is onl

[jira] [Resolved] (HDFS-3538) TestBlocksWithNotEnoughRacks fails

2013-10-06 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-3538. --- Resolution: Duplicate This is a duplicate of HDFS-3267. > TestBlocksWithNotEnoughRacks fails

Hadoop-Hdfs-trunk - Build # 1544 - Failure

2013-10-06 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1544/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 11537 lines...] main: [mkdir] Created dir: /home/jen

Build failed in Jenkins: Hadoop-Hdfs-trunk #1544

2013-10-06 Thread Apache Jenkins Server
See Changes: [jing9] HADOOP-10017. Fix NPE in DFSClient#getDelegationToken when doing Distcp from a secured cluster to an insecured cluster. Contributed by Haohui Mai. [brandonli] HDFS-5306. Datanode https port is not available at t

Build failed in Jenkins: Hadoop-Hdfs-0.23-Build #752

2013-10-06 Thread Apache Jenkins Server
See -- [...truncated 7677 lines...] [ERROR] symbol : class Parser [ERROR] location: package com.google.protobuf [ERROR]

Hadoop-Hdfs-0.23-Build - Build # 752 - Still Failing

2013-10-06 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/752/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7870 lines...] [ERROR] location: class com.google.pro