Re: How can I get FSNamesystem of running NameNode in cluster?

2013-12-09 Thread Harsh J
Hi Yoonmin, Yes, your conclusions here are correct. The FSNamesystem is an object internal to the NameNode server runtime. On Mon, Dec 9, 2013 at 8:49 PM, Yoonmin Nam wrote: > Oh, I see. However a minicluster cannot replace the namenode, right? > I knew that the minicluster is for testing compon

Re: Can NMs communicate among themselves?

2013-12-09 Thread Sandy Ryza
Hi Santosh, NodeManagers do not communicate with each other in YARN. -Sandy On Mon, Dec 9, 2013 at 5:42 PM, santosh kumar wrote: > Hi, > > The communication in YARN is b/w RM-NM or AM-RM from what I know. > Can Node Managers talk to each other? If so, how? > > Also what protocol or communicati

Re: [VOTE] Merge HDFS-2832 Heterogeneous Storage Phase 1 to trunk

2013-12-09 Thread Andrew Wang
Thanks for clarifying that Arpit. I'm a +0.9 since I haven't reviewed enough to +1, but everything thus far looks great. Andrew On Fri, Dec 6, 2013 at 5:35 PM, Chen He wrote: > +1 nice feature for HDFS > > > On Fri, Dec 6, 2013 at 7:32 PM, Arpit Agarwal >wrote: > > > Hi Andrew, > > > > Our pl

RE: How can I get FSNamesystem of running NameNode in cluster?

2013-12-09 Thread Yoonmin Nam
Oh, I see. However a minicluster cannot replace the namenode, right? I knew that the minicluster is for testing components of hadoop. Then, the only way of implementing some features which use namenode or datanode is just in internal of namenode or datanode. Am I right? Thanks! -Original Me

Re: How can I get FSNamesystem of running NameNode in cluster?

2013-12-09 Thread Daryn Sharp
Are you adding something internal to the NN? If not, you cannot get the namesystem instance via a client unless you are using a minicluster object. Daryn On Dec 9, 2013, at 7:11 AM, Yoonmin Nam wrote: > I want to get a running instance of FSNamesystem of HDFS. However, it is > somewhat compli

How can I get FSNamesystem of running NameNode in cluster?

2013-12-09 Thread Yoonmin Nam
I want to get a running instance of FSNamesystem of HDFS. However, it is somewhat complicated than I expected. If I can get NameNode instance of running cluster, then it can be solved because there is a method "getNamespace()". Is there anyone who know about this stuff? I thought that using Ser

[jira] [Created] (HADOOP-10155) Hadoop-crypto which includes native cipher implementation.

2013-12-09 Thread Yi Liu (JIRA)
Yi Liu created HADOOP-10155: --- Summary: Hadoop-crypto which includes native cipher implementation. Key: HADOOP-10155 URL: https://issues.apache.org/jira/browse/HADOOP-10155 Project: Hadoop Common

[jira] [Created] (HADOOP-10154) Provide cryptographic filesystem implementation and it's data IO.

2013-12-09 Thread Yi Liu (JIRA)
Yi Liu created HADOOP-10154: --- Summary: Provide cryptographic filesystem implementation and it's data IO. Key: HADOOP-10154 URL: https://issues.apache.org/jira/browse/HADOOP-10154 Project: Hadoop Common

[jira] [Created] (HADOOP-10153) Define Crypto policy interfaces and provide its default implementation.

2013-12-09 Thread Yi Liu (JIRA)
Yi Liu created HADOOP-10153: --- Summary: Define Crypto policy interfaces and provide its default implementation. Key: HADOOP-10153 URL: https://issues.apache.org/jira/browse/HADOOP-10153 Project: Hadoop Commo

[jira] [Created] (HADOOP-10152) Distributed file cipher InputStream and OutputStream which provide 1:1 mapping of plain text data and cipher data.

2013-12-09 Thread Yi Liu (JIRA)
Yi Liu created HADOOP-10152: --- Summary: Distributed file cipher InputStream and OutputStream which provide 1:1 mapping of plain text data and cipher data. Key: HADOOP-10152 URL: https://issues.apache.org/jira/browse/HADO

[jira] [Created] (HADOOP-10151) Implement a Buffer-Based Chiper InputStream and OutPutStream

2013-12-09 Thread Yi Liu (JIRA)
Yi Liu created HADOOP-10151: --- Summary: Implement a Buffer-Based Chiper InputStream and OutPutStream Key: HADOOP-10151 URL: https://issues.apache.org/jira/browse/HADOOP-10151 Project: Hadoop Common

Build failed in Jenkins: Hadoop-Common-trunk #976

2013-12-09 Thread Apache Jenkins Server
See -- [...truncated 59910 lines...] Adding reference: maven.local.repository [DEBUG] Initialize Maven Ant Tasks parsing buildfile jar:file:/home/jenkins/.m2/repository/org/apache/maven/plugins/maven-