Re: Questions on Namespace/namenode

2015-07-21 Thread Dmitry Salychev
Hi, Shani. NameNode is a HDFS bottleneck, so running multiple namespaces within only one NN is a risky. What do you want to achieve? It might help you a bit - HDFS Federation . On 07/21/2015 06:01 AM, Sha

Re: NameNode as a single point of failure

2015-07-06 Thread Dmitry Salychev
designed to have both data and metadata distributed and replicated: https://github.com/GiraffaFS/giraffa Thanks, --Konstantin On Thu, Jul 2, 2015 at 8:25 AM, Dmitry Salychev wrote: Hi, Esteban. Thanks for your reply. Thus, QJM automatic failover option is a cut-edge thing. Am I right? I think that

Re: NameNode as a single point of failure

2015-07-02 Thread Dmitry Salychev
work that will be in Hadoop 3 that will allow to have more than 1 stand-by NNs: https://issues.apache.org/jira/browse/HDFS-6440 cheers, esteban. -- Cloudera, Inc. On Thu, Jul 2, 2015 at 7:42 AM, Dmitry Salychev wrote: Sure, I did. It's actually not what I'm looking for. I don'

Re: NameNode as a single point of failure

2015-07-02 Thread Dmitry Salychev
Jul 2, 2015 11:50 AM, "Dmitry Salychev" wrote: Hello, HDFS Developers. I know that NN is a single point of failure of an entire HDFS cluster. If it fails, the cluster will be unavailable no matter how many DN there. I know that there is an initiative < http://www.wandisco.com/syste

NameNode as a single point of failure

2015-07-01 Thread Dmitry Salychev
Hello, HDFS Developers. I know that NN is a single point of failure of an entire HDFS cluster. If it fails, the cluster will be unavailable no matter how many DN there. I know that there is an initiative whic

Re: Standby node from HADOOP-4539

2014-09-10 Thread Dmitry Salychev
:47 PM, Dmitry Salychev wrote: Hi, guys. I am looking for "warm replacement" of NN. I know that "StreamEditsToBN" desing document planned "Warm standby provision" section, but has it been implemented? If it's not, what is the best place to start implementing the issue?

Standby node from HADOOP-4539

2014-09-08 Thread Dmitry Salychev
Hi, guys. I am looking for "warm replacement" of NN. I know that "StreamEditsToBN" desing document planned "Warm standby provision" section, but has it been implemented? If it's not, what is the best place to start implementing the issue?