Hadoop-Hdfs-trunk - Build # 2069 - Still Failing

[Apache Jenkins Server]

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2069/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 8478 lines...]
[INFO] 
[INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ 
hadoop-hdfs-project ---
[INFO] 
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ 
hadoop-hdfs-project ---
[INFO] Skipping javadoc generation
[INFO] 
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project 
---
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.12.1:checkstyle (default-cli) @ 
hadoop-hdfs-project ---
[INFO] 
[INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ 
hadoop-hdfs-project ---
[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop HDFS  FAILURE [  03:02 h]
[INFO] Apache Hadoop HttpFS .. SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal . SKIPPED
[INFO] Apache Hadoop HDFS-NFS  SKIPPED
[INFO] Apache Hadoop HDFS Project  SUCCESS [  2.339 s]
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 03:03 h
[INFO] Finished at: 2015-03-19T14:37:19+00:00
[INFO] Final Memory: 57M/623M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-hdfs: There was a timeout or other error in the fork -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Updating HDFS-7929
Updating HDFS-7948
Updating HDFS-7953
Updating HDFS-7951
Updating HDFS-7950
Updating HDFS-7914
Updating HADOOP-10703
Updating MAPREDUCE-6277
Updating HDFS-7054
Updating HDFS-7943
Updating HADOOP-9329
Updating MAPREDUCE-5807
Updating HDFS-7945
Updating HDFS-7869
Updating HDFS-7722
Updating YARN-3351
Updating HDFS-7587
Updating HDFS-7697
Updating HDFS-7867
Updating YARN-3357
Sending e-mails to: hdfs-dev@hadoop.apache.org
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
4 tests failed.
FAILED:  
org.apache.hadoop.fs.viewfs.TestViewFsWithXAttrs.org.apache.hadoop.fs.viewfs.TestViewFsWithXAttrs

Error Message:
org/apache/hadoop/fs/ParentNotDirectoryException

Stack Trace:
java.lang.NoClassDefFoundError: org/apache/hadoop/fs/ParentNotDirectoryException
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:835)
at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:704)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:984)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:343)
at 
org.apache.hadoop.hdfs.DFSTestUtil.formatNameNode(DFSTestUtil.java:170)
at 
org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:973)
at 
org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:811)
at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:471)
at 
org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:430)
at 
org.apache.hadoop.fs.viewfs.TestViewFsWithXAttrs.clusterSetupAtBeginning(TestViewFsWithXAttrs.java:61)


FAILED:  
org.apache.hadoop.fs.viewfs.TestViewFsWithXAttrs.org.apache.hadoop.fs.viewfs.TestViewFsWithXAttrs

Error Message:
null

Stack Trace:
java.lang.NullPointerException: null
at 
org.apache.hadoop.fs.viewfs.TestViewFsWithXAttrs.ClusterShutdownAtEnd(TestViewFsWithXAttrs.java:73)


FAILED:  org.apache.hadoop.hdfs.server.balancer.TestBalancer.testUnknownDatanode

Err

Build failed in Jenkins: Hadoop-Hdfs-trunk #2069

[Apache Jenkins Server]

See 

Changes:

[harsh] MAPREDUCE-5807. Print usage for TeraSort job. Contributed by Rohith.

[wheat9] HDFS-7953. NN Web UI fails to navigate to paths that contain #. 
Contributed by kanaka kumar avvaru.

[arp] HDFS-7948. TestDataNodeHotSwapVolumes#testAddVolumeFailures failed on 
Windows. (Contributed by Xiaoyu Yao)

[jlowe] MAPREDUCE-6277. Job can post multiple history files if attempt loses 
connection to the RM. Contributed by Chang Li

[arp] HDFS-7950. Fix TestFsDatasetImpl#testAddVolumes failure on Windows. 
(Contributed by Xiaoyu Yao)

[arp] HDFS-7951. Fix NPE for 
TestFsDatasetImpl#testAddVolumeFailureReleasesInUseLock on Linux. (Contributed 
by Xiaoyu Yao)

[arp] Fix CHANGES.txt for HDFS-7722.

[wheat9] HDFS-7697. Mark the PB OIV tool as experimental. Contributed by Lei 
(Eddy) Xu.

[arp] HDFS-7914. TestJournalNode#testFailToStartWithBadConfig fails when the 
default dfs.journalnode.http-address port 8480 is in use. (Contributed by 
Xiaoyu Yao)

[wheat9] HDFS-7945. The WebHdfs system on DN does not honor the length 
parameter. Contributed by Haohui Mai.

[kasha] YARN-3351. AppMaster tracking URL is broken in HA. (Anubhav Dhoot via 
kasha)

[cmccabe] HDFS-7054. Make DFSOutputStream tracing more fine-grained (cmccabe)

[jing9] HDFS-7943. Append cannot handle the last block with length greater than 
the preferred block size. Contributed by Jing Zhao.

[cmccabe] HDFS-7929. inotify unable fetch pre-upgrade edit log segments once 
upgrade starts (Zhe Zhang via Colin P. McCabe)

[jing9] HDFS-7587. Edit log corruption can happen if append fails with a quota 
violation. Contributed by Jing Zhao.

[cmccabe] HADOOP-9329. document native build dependencies in BUILDING.txt 
(Vijay Bhat via Colin P. McCabe)

[wheat9] HADOOP-10703. HttpServer2 creates multiple authentication filters. 
Contributed by Benoy Antony.

[vinayakumarb] HDFS-7869. Update action param from 'start' to 'prepare' in 
rolling upgrade ( Contributed by J.Andreina)

[vinayakumarb] HDFS-7867. Update action param from 'start' to 'prepare' in 
rolling upgrade ( Contributed by J.Andreina) Updated JIRA id.

[devaraj] YARN-3357. Move TestFifoScheduler to FIFO package. Contributed by 
Rohith

--
[...truncated 8285 lines...]
"IPC Server handler 5 on 2" daemon prio=5 tid=132 timed_waiting
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
at 
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at 
org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:109)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2108)
"IPC Server listener on 53874" daemon prio=5 tid=209 runnable
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
at org.apache.hadoop.ipc.Server$Listener.run(Server.java:685)
"IPC Client (1129073395) connection to localhost/127.0.0.1:52473 from jenkins" 
daemon prio=5 tid=212 timed_waiting
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
at org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:944)
at org.apache.hadoop.ipc.Client$Connection.run(Client.java:989)
"refreshUsed-
 daemon prio=5 tid=345 timed_waiting
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at org.apache.hadoop.fs.DU$DURefreshThread.run(DU.java:115)
at java.lang.Thread.run(Thread.java:745)
"913909642@qtp-574648841-1 - Acceptor0 SelectChannelConnector@localhost:47832" 
daemon prio=5 tid=142 runnable
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at 
org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:498)
at org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:192)
at 
org.mortbay.jetty.nio.SelectChann

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #128

[Apache Jenkins Server]

See 

Changes:

[harsh] MAPREDUCE-5807. Print usage for TeraSort job. Contributed by Rohith.

[wheat9] HDFS-7953. NN Web UI fails to navigate to paths that contain #. 
Contributed by kanaka kumar avvaru.

[arp] HDFS-7948. TestDataNodeHotSwapVolumes#testAddVolumeFailures failed on 
Windows. (Contributed by Xiaoyu Yao)

[jlowe] MAPREDUCE-6277. Job can post multiple history files if attempt loses 
connection to the RM. Contributed by Chang Li

[arp] HDFS-7950. Fix TestFsDatasetImpl#testAddVolumes failure on Windows. 
(Contributed by Xiaoyu Yao)

[arp] HDFS-7951. Fix NPE for 
TestFsDatasetImpl#testAddVolumeFailureReleasesInUseLock on Linux. (Contributed 
by Xiaoyu Yao)

[arp] Fix CHANGES.txt for HDFS-7722.

[wheat9] HDFS-7697. Mark the PB OIV tool as experimental. Contributed by Lei 
(Eddy) Xu.

[arp] HDFS-7914. TestJournalNode#testFailToStartWithBadConfig fails when the 
default dfs.journalnode.http-address port 8480 is in use. (Contributed by 
Xiaoyu Yao)

[wheat9] HDFS-7945. The WebHdfs system on DN does not honor the length 
parameter. Contributed by Haohui Mai.

[kasha] YARN-3351. AppMaster tracking URL is broken in HA. (Anubhav Dhoot via 
kasha)

[cmccabe] HDFS-7054. Make DFSOutputStream tracing more fine-grained (cmccabe)

[jing9] HDFS-7943. Append cannot handle the last block with length greater than 
the preferred block size. Contributed by Jing Zhao.

[cmccabe] HDFS-7929. inotify unable fetch pre-upgrade edit log segments once 
upgrade starts (Zhe Zhang via Colin P. McCabe)

[jing9] HDFS-7587. Edit log corruption can happen if append fails with a quota 
violation. Contributed by Jing Zhao.

[cmccabe] HADOOP-9329. document native build dependencies in BUILDING.txt 
(Vijay Bhat via Colin P. McCabe)

[wheat9] HADOOP-10703. HttpServer2 creates multiple authentication filters. 
Contributed by Benoy Antony.

[vinayakumarb] HDFS-7869. Update action param from 'start' to 'prepare' in 
rolling upgrade ( Contributed by J.Andreina)

[vinayakumarb] HDFS-7867. Update action param from 'start' to 'prepare' in 
rolling upgrade ( Contributed by J.Andreina) Updated JIRA id.

[devaraj] YARN-3357. Move TestFifoScheduler to FIFO package. Contributed by 
Rohith

--
[...truncated 8722 lines...]
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:744)
"IPC Server handler 0 on 43599" daemon prio=5 tid=44 timed_waiting
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at 
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at 
org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:109)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2108)
"IPC Client (43774) connection to localhost/127.0.0.1:43599 from jenkins" 
daemon prio=5 tid=218 timed_waiting
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
at org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:944)
at org.apache.hadoop.ipc.Client$Connection.run(Client.java:989)
"1068945248@qtp-455888635-0" daemon prio=5 tid=151 timed_waiting
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
at 
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626)
"IPC Server handler 5 on 42719" daemon prio=5 tid=142 timed_waiting
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at 
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at 
org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:109)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2108)
"IPC Server Responder" daemon prio=5 tid=135 runnable
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at org.apache.hadoop.ipc.Server$Responder.doRunLoop(Server.java:859)
at org.apache.hadoop.ipc.Server$Responder.run(Server.java:842)
"refreshUsed-

Hadoop-Hdfs-trunk-Java8 - Build # 128 - Failure

[Apache Jenkins Server]

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/128/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 8915 lines...]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ 
hadoop-hdfs-project ---
[INFO] Not executing Javadoc as the project is not a Java classpath-capable 
package
[INFO] 
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project 
---
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.12.1:checkstyle (default-cli) @ 
hadoop-hdfs-project ---
[INFO] 
[INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ 
hadoop-hdfs-project ---
[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop HDFS  FAILURE [  03:04 h]
[INFO] Apache Hadoop HttpFS .. SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal . SKIPPED
[INFO] Apache Hadoop HDFS-NFS  SKIPPED
[INFO] Apache Hadoop HDFS Project  SUCCESS [  1.798 s]
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 03:04 h
[INFO] Finished at: 2015-03-19T14:39:15+00:00
[INFO] Final Memory: 50M/236M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-hdfs: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Hdfs-trunk-Java8/hadoop-hdfs-project/hadoop-hdfs/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Updating HDFS-7929
Updating HDFS-7948
Updating HDFS-7953
Updating HDFS-7951
Updating HDFS-7950
Updating HDFS-7914
Updating HADOOP-10703
Updating MAPREDUCE-6277
Updating HDFS-7054
Updating HDFS-7943
Updating HADOOP-9329
Updating MAPREDUCE-5807
Updating HDFS-7945
Updating HDFS-7869
Updating HDFS-7722
Updating YARN-3351
Updating HDFS-7587
Updating HDFS-7697
Updating HDFS-7867
Updating YARN-3357
Sending e-mails to: hdfs-dev@hadoop.apache.org
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
1 tests failed.
REGRESSION:  org.apache.hadoop.tracing.TestTracing.testWriteTraceHooks

Error Message:
timed out to get expected spans: Timed out waiting for condition. Thread 
diagnostics:
Timestamp: 2015-03-19 11:41:40,324

"IPC Server handler 8 on 35937" daemon prio=5 tid=321 timed_waiting
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at 
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at 
org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:109)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2108)
"refreshUsed-/home/jenkins/jenkins-slave/workspace/Hadoop-Hdfs-trunk-Java8/hadoop-hdfs-project/hadoop-hdfs/target/test/data/dfs/data/data3/current/BP-749286799-67.195.81.149-1426765296645"
 daemon prio=5 tid=354 timed_waiting
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at org.apache.hadoop.fs.DU$DURefreshThread.run(DU.java:115)
at java.lang.Thread.run(Thread.java:744)
"process reaper" daemon prio=10 tid=345 timed_waiting
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPool

[jira] [Created] (HDFS-7958) dfshealth_nonsecure.html should not be accessble in secure cluster.

[Y. SREENIVASULU REDDY (JIRA)]

Y. SREENIVASULU REDDY created HDFS-7958:
---

 Summary: dfshealth_nonsecure.html should not be accessble in 
secure cluster.
 Key: HDFS-7958
 URL: https://issues.apache.org/jira/browse/HDFS-7958
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: namenode
Affects Versions: 2.4.0
Reporter: Y. SREENIVASULU REDDY
Assignee: surendra singh lilhore


In secure environment (kerberous + https)
the following url should not be accessible.
{code}
https://nn1:25003/dfshealth_nonsecure.html#tab-overview
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Save the Date: Apache Hadoop Bug Bash / May 8th!

[Allen Wittenauer]

Hi folks,

There are ~6,000 Hadoop JIRA issues that have gone unaddressed, 
including ~900 with patches waiting to be reviewed.  Among other things, this 
lack of attention to our backlog is making the Hadoop project very unfriendly 
to contributors--which is ultimately very unhealthy for the project.

In hopes of resetting our community habits a bit, a bunch of us are 
organizing a "bug bash" of sorts on Friday May 8th, the day after HBase Con.  
We're thinking about holding an in-person event someplace in the San Francisco 
Bay Area... but we definitely want this to be a virtual event for participants 
around the world!

As details form, we'll let you know.  But we wanted to send an initial 
notice so you can save the date, and also share your ideas on how we can make 
this event successful. 


Thanks!

Re: Save the Date: Apache Hadoop Bug Bash / May 8th!

[Tsuyoshi Ozawa]

Hi Allen,

Thank you for the great suggestion. Let's do this!

Thanks,
- Tsuyoshi

On Fri, Mar 20, 2015 at 2:34 AM, Allen Wittenauer  wrote:
>
> Hi folks,
>
> There are ~6,000 Hadoop JIRA issues that have gone unaddressed, 
> including ~900 with patches waiting to be reviewed.  Among other things, this 
> lack of attention to our backlog is making the Hadoop project very unfriendly 
> to contributors--which is ultimately very unhealthy for the project.
>
> In hopes of resetting our community habits a bit, a bunch of us are 
> organizing a "bug bash" of sorts on Friday May 8th, the day after HBase Con.  
> We're thinking about holding an in-person event someplace in the San 
> Francisco Bay Area... but we definitely want this to be a virtual event for 
> participants around the world!
>
> As details form, we'll let you know.  But we wanted to send an 
> initial notice so you can save the date, and also share your ideas on how we 
> can make this event successful.
>
>
> Thanks!

[jira] [Created] (HDFS-7959) WebHdfs logging is missing on Datanode

[Kihwal Lee (JIRA)]

Kihwal Lee created HDFS-7959:


 Summary: WebHdfs logging is missing on Datanode
 Key: HDFS-7959
 URL: https://issues.apache.org/jira/browse/HDFS-7959
 Project: Hadoop HDFS
  Issue Type: Bug
Reporter: Kihwal Lee
Priority: Critical


After the conversion to netty, webhdfs requests are not logged on datanodes. 
The existing jetty log only logs the non-webhdfs requests that come through the 
internal proxy.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HDFS-7960) NameNode should prune storages that are no longer existed on DataNode

[Lei (Eddy) Xu (JIRA)]

Lei (Eddy) Xu created HDFS-7960:
---

 Summary: NameNode should prune storages that are no longer existed 
on DataNode
 Key: HDFS-7960
 URL: https://issues.apache.org/jira/browse/HDFS-7960
 Project: Hadoop HDFS
  Issue Type: Bug
Affects Versions: 2.6.0
Reporter: Lei (Eddy) Xu
Assignee: Lei (Eddy) Xu


NameNode should be able to remove storages that is not represented on DataNode. 
For example, hot swapped on that DataNode or DN restarted with less data dirs.  
It seems that once a datanode storage is removed from a datanode, those blocks 
on the storage will not be reconciled as gone from the Namenode until the 
namenode has been restarted.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HDFS-7961) Trigger full block report after hot swapping disk

[Lei (Eddy) Xu (JIRA)]

Lei (Eddy) Xu created HDFS-7961:
---

 Summary: Trigger full block report after hot swapping disk
 Key: HDFS-7961
 URL: https://issues.apache.org/jira/browse/HDFS-7961
 Project: Hadoop HDFS
  Issue Type: Bug
Affects Versions: 2.6.0
Reporter: Lei (Eddy) Xu
Assignee: Lei (Eddy) Xu
 Fix For: 3.0.0, 2.7.0


As discussed in HDFS-7960, NN could not remove the data storage metadata from 
its memory. 

DN should trigger a full block report immediately after running hot swapping 
drives.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HDFS-7962) Remove duplicated log in BlockManager

[Yi Liu (JIRA)]

Yi Liu created HDFS-7962:


 Summary: Remove duplicated log in BlockManager
 Key: HDFS-7962
 URL: https://issues.apache.org/jira/browse/HDFS-7962
 Project: Hadoop HDFS
  Issue Type: Improvement
Reporter: Yi Liu
Assignee: Yi Liu
Priority: Minor


There are few duplicated log in {{BlockManager}}.
Also do few refinement of log.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HDFS-7963) Fix expected tracing spans in TestTracing along with HDFS-7054

[Masatake Iwasaki (JIRA)]

Masatake Iwasaki created HDFS-7963:
--

 Summary: Fix expected tracing spans in TestTracing along with 
HDFS-7054
 Key: HDFS-7963
 URL: https://issues.apache.org/jira/browse/HDFS-7963
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: test
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
Priority: Minor






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)