Fwd: HDFS multi-tenancy and federation

Hi, I would like to know the following. 1) Can there be multiple namespaces in a single namenode? is it recommended? (I'm having a multi-tenant environment in mind) 2) Let's say I have a federated namespace/namenodes. There are two namenodes A /namespace A1 and namenode B/namespace B1, and have

Re: HDFS multi-tenancy and federation

Hi, Any help on this please? On Mon, Feb 3, 2014 at 12:14 PM, Shani Ranasinghe wrote: > > Hi, > I would like to know the following. > > 1) Can there be multiple namespaces in a single namenode? is it > recommended? (I'm having a multi-tenant environment in mind) &g

Questions on Namespace/namenode

Hi, I am Shani. I am currently doing a research on how to create multiple namespaces within the sasme namenode. I was looking at the code, and found some terms that I would like to have a better understanding on. 1) What is a Namesystem? 2) If I could have guidance on where to look for namespa

Re: Questions on Namespace/namenode

o running multiple namespaces within only > one NN is a risky. What do you want to achieve? > > It might help you a bit - HDFS Federation < > https://hadoop.apache.org/docs/r2.4.1/hadoop-project-dist/hadoop-hdfs/Federation.html > >. > > > On 07/21/2015 06:01 AM, Shan

hadoop 2.2.0 - test failure in released src pack

Hi, I am trying to run the src downloaded from http://archive.apache.org/dist/hadoop/core/hadoop-2.2.0/ for hadoop 2.2.0. I encounter the following test failure when a maven build is triggered with tests. However, builds fine without tests. Any idea on how to resolve this? Failed tests: testLoc

Re: hadoop 2.2.0 - test failure in released src pack

Hi, I got it working after modifying the pom file as explained in https://issues.apache.org/jira/secure/attachment/12614482/HADOOP-10110.patch . On Wed, Feb 5, 2014 at 4:18 PM, Shani Ranasinghe wrote: > Hi, > > I am trying to run the src downloaded from > http://archive.apache.org

Re: hadoop 2.2.0 - test failure in released src pack

at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:586) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209) ... 19 more On Wed, Feb 5, 2014 at 4:55 PM, Shani Ranasin

Is hadoop 2.4.1 for HDFS recommended for production?

Hi, I am planning to use hadoop 2.4.1 for my work, and was wondering if it is recommended for production? If not should I use the 2.2.0 GA release? WDYT? Regards, Shani Ranasinghe.

Re: HDFS multi-tenancy and federation

only 1 namespace at this time. I hope that > helps. > > Regards > Prav > > > On Wed, Feb 5, 2014 at 8:05 AM, Shani Ranasinghe > wrote: > >> Hi, >> >> Any help on this please? >> >> >> >> On Mon, Feb 3, 2014 at 12:14 PM, Shani Ranas

Re: HDFS multi-tenancy and federation

. I don't think it poses any security or restrictions on accesssing > the HDFS filesystem. I guess this link would help for your question 2 - > http://hadoop.apache.org/docs/r2.4.0/hadoop-project-dist/hadoop-hdfs/ViewFs.html > > > > > > On Tue, Jul 15, 2014 at 10:06

Using different security mechanism instead of Kerberos/Simple

Hi, While going through the code we learned that except for simple and kerberos, there seems not to be a way we could plug in our own authentication mechanism. Are there any plans in accommodating the change any soon? Also if to abstract out the security component, is there any way other than rep