[jira] [Created] (HDFS-3464) Deleting currentLedger and leaving 'inprogress_x' on exceptions can throw BKNoSuchLedgerExistsException later.

2012-05-25 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-3464:
-

 Summary: Deleting currentLedger and leaving 'inprogress_x'  on 
exceptions can throw BKNoSuchLedgerExistsException later.
 Key: HDFS-3464
 URL: https://issues.apache.org/jira/browse/HDFS-3464
 Project: Hadoop HDFS
  Issue Type: Sub-task
Affects Versions: 2.0.1-alpha, 3.0.0
Reporter: Uma Maheswara Rao G
Assignee: Uma Maheswara Rao G


HDFS-3058 will clean currentLedgers on exception.
In BookKeeperJournalManager, startLogSegment() is deleting the corresponding 
'inprogress_ledger' ledger on exception. Here leaving the 'inprogress_x' ledger 
metadata in ZooKeeper. When the other node becomes active, he will see the 
'inprogress_x' znode and tries to recoverLastTxId() it would throw exception, 
since there is no 'inprogress_ledger' exists. 
{noformat}
Caused by: 
org.apache.bookkeeper.client.BKException$BKNoSuchLedgerExistsException
at 
org.apache.bookkeeper.client.BookKeeper.openLedger(BookKeeper.java:393)
at 
org.apache.hadoop.contrib.bkjournal.BookKeeperJournalManager.recoverLastTxId(BookKeeperJournalManager.java:493)
{noformat}

As per the discussion in HDFS-3058, we will handle the coment as part of this 
JIRA.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (HDFS-3465) 2NN doesn't start with fs.defaultFS set to a viewfs URI unless service RPC address is also set

2012-05-25 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3465:
-

 Summary: 2NN doesn't start with fs.defaultFS set to a viewfs URI 
unless service RPC address is also set
 Key: HDFS-3465
 URL: https://issues.apache.org/jira/browse/HDFS-3465
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: name-node
Affects Versions: 2.0.0-alpha
Reporter: Eli Collins


Looks like the 2NN first tries servicerpc-address then falls back on 
fs.defaultFS, which won't work in the case of federation since fs.defaultFS 
doesn't refer to an RPC address. Instead, the 2NN should first check 
servicerpc-address, then rpc-address, then fall back on fs.defaultFS.

{noformat}
Exception in thread "main" java.lang.IllegalArgumentException: Invalid
URI for NameNode address (check fs.defaultFS): viewfs:/// has no
authority.
   at 
org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:315)
   at 
org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:303)
   at 
org.apache.hadoop.hdfs.server.namenode.NameNode.getServiceAddress(NameNode.java:296)
   at 
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.initialize(SecondaryNameNode.java:214)
   at 
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.(SecondaryNameNode.java:178)
   at 
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.main(SecondaryNameNode.java:582)
{noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (HDFS-3466) The SPNEGO filter for the NameNode should come out of the web keytab file

2012-05-25 Thread Owen O'Malley (JIRA)
Owen O'Malley created HDFS-3466:
---

 Summary: The SPNEGO filter for the NameNode should come out of the 
web keytab file
 Key: HDFS-3466
 URL: https://issues.apache.org/jira/browse/HDFS-3466
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: name-node, security
Affects Versions: 2.0.0-alpha, 1.1.0
Reporter: Owen O'Malley
Assignee: Owen O'Malley


Currently, the spnego filter uses the DFS_NAMENODE_KEYTAB_FILE_KEY to find the 
keytab. It should use the DFS_WEB_AUTHENTICATION_KERBEROS_KEYTAB_KEY to do it.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (HDFS-3467) NN is getting shutdown by throwing IllegalArgumentException

2012-05-25 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-3467:
--

 Summary: NN is getting shutdown by throwing 
IllegalArgumentException 
 Key: HDFS-3467
 URL: https://issues.apache.org/jira/browse/HDFS-3467
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: name-node
Affects Versions: 2.0.0-alpha, 2.0.1-alpha
Reporter: Brahma Reddy Battula


Scenario:
=
Configure fs.default.name
Format Namenode
Start NameNode.

Here it is getting shutdown ..like following..

{noformat}
2012-05-25 21:09:30,810 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: 
Exception in namenode join
java.lang.IllegalArgumentException: Invalid URI for NameNode address (check 
fs.defaultFS): file:/// has no authority.
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:295)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:283)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.getRpcServerAddress(NameNode.java:336)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.loginAsNameNodeUser(NameNode.java:388)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:400)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:570)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:551)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1114)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1170)
2012-05-25 21:09:30,812 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: 
SHUTDOWN_MSG: 
{noformat}

This is happening in hadoop-2.0.1 But it's not like that in trunk.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (HDFS-3468) Make BKJM-ZK session timeout configurable.

2012-05-25 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-3468:
-

 Summary: Make BKJM-ZK session timeout configurable.
 Key: HDFS-3468
 URL: https://issues.apache.org/jira/browse/HDFS-3468
 Project: Hadoop HDFS
  Issue Type: Sub-task
Affects Versions: 2.0.0-alpha
Reporter: Uma Maheswara Rao G
Assignee: Uma Maheswara Rao G


Currently BKJM-ZK session timeout has been hardcoded to 3000ms.
Considering ZKFC timeouts configurable, we should make this also configurable.

Unfortunale we can not compare both the values at runtime, because they both 
are different processes.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira