[VOTE] Release Apache Hadoop 0.23.10

2013-12-02 Thread Thomas Graves
Hey Everyone, There have been lots of improvements and bug fixes that have went into branch-0.23 since the 0.23.9 release. We think its time to do a 0.23.10 so I have created a release candidate (rc0) for a Hadoop-0.23.10 release. The RC is available at: http://people.apache.org/~tgraves/hadoop-

Re: [VOTE] Merge HDFS-2832 Heterogeneous Storage Phase 1 to trunk

2013-12-02 Thread Jun Ping Du
58ab7d4ddcdae82926bf66e4052c31368b2abead87c7df110f > . > The changes involve ~6K changed lines of code, with a third of those > changes being to tests. > > Please see the test plan > > https://urldefense.proofpoint.com/v1/url?u=https://issues.apache.o

Re: [VOTE] Merge HDFS-2832 Heterogeneous Storage Phase 1 to trunk

2013-12-02 Thread Suresh Srinivas
achment/12615761/20131125-HeterogeneousStorage.pdf > . > The changes involve ~6K changed lines of code, with a third of those > changes being to tests. > > Please see the test plan > > https://issues.apache.org/jira/secure/attachment/12616642/20131202-HeterogeneousStorage-TestPla

[VOTE] Merge HDFS-2832 Heterogeneous Storage Phase 1 to trunk

2013-12-02 Thread Arpit Agarwal
t/12615761/20131125-HeterogeneousStorage.pdf. The changes involve ~6K changed lines of code, with a third of those changes being to tests. Please see the test plan https://issues.apache.org/jira/secure/attachment/12616642/20131202-HeterogeneousStorage-TestPlan.pdffor the details. Once the feature is m

[jira] [Created] (HDFS-5591) Checkpointing should use monotonic time when calculating period

2013-12-02 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-5591: - Summary: Checkpointing should use monotonic time when calculating period Key: HDFS-5591 URL: https://issues.apache.org/jira/browse/HDFS-5591 Project: Hadoop HDFS

[jira] [Created] (HDFS-5590) Sequential block ID may cause data loss when persistBlocks is set to false

2013-12-02 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-5590: --- Summary: Sequential block ID may cause data loss when persistBlocks is set to false Key: HDFS-5590 URL: https://issues.apache.org/jira/browse/HDFS-5590 Project: Hadoop HDFS

[jira] [Created] (HDFS-5589) Namenode loops caching and uncaching when data should be uncached

2013-12-02 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-5589: - Summary: Namenode loops caching and uncaching when data should be uncached Key: HDFS-5589 URL: https://issues.apache.org/jira/browse/HDFS-5589 Project: Hadoop HDFS

[jira] [Created] (HDFS-5588) Incorrect values of trash configuration and trash emptier state in namenode log

2013-12-02 Thread Adam Kawa (JIRA)
Adam Kawa created HDFS-5588: --- Summary: Incorrect values of trash configuration and trash emptier state in namenode log Key: HDFS-5588 URL: https://issues.apache.org/jira/browse/HDFS-5588 Project: Hadoop HDF

Re: Next releases

2013-12-02 Thread Arun C Murthy
On Nov 13, 2013, at 1:55 PM, Jason Lowe wrote: > > > +1 to limiting checkins of patch releases to Blockers/Criticals. If > necessary committers check into trunk/branch-2 only and defer to the patch > release manager for the patch release merge. Then there should be fewer > surprises for ev

Re: Next releases

2013-12-02 Thread Arun C Murthy
On Dec 2, 2013, at 10:31 AM, Arun C Murthy wrote: > Ok, looks like there are no objections. > > I'm starting the work to rename 2.2.1 to 2.3 now. Committers, please hold > commits till I send out the all clear. Done. I've renamed 2.3 -> 2.4 and 2.2.1 -> 2.3. I'll create the first RC for 2.3

Re: Next releases

2013-12-02 Thread Arun C Murthy
Ok, looks like there are no objections. I'm starting the work to rename 2.2.1 to 2.3 now. Committers, please hold commits till I send out the all clear. thanks, Arun On Nov 20, 2013, at 6:38 AM, Arun C Murthy wrote: > Jason, > > I'm glad to see we are converging. I'll update the Roadmap wik

[jira] [Created] (HDFS-5587) add debug information when NFS fails to start with duplicate user or group names

2013-12-02 Thread Brandon Li (JIRA)
Brandon Li created HDFS-5587: Summary: add debug information when NFS fails to start with duplicate user or group names Key: HDFS-5587 URL: https://issues.apache.org/jira/browse/HDFS-5587 Project: Hadoop

[jira] [Created] (HDFS-5586) Add quick-restart option for datanode

2013-12-02 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-5586: Summary: Add quick-restart option for datanode Key: HDFS-5586 URL: https://issues.apache.org/jira/browse/HDFS-5586 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-5585) Provide admin commands for data node upgrade

2013-12-02 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-5585: Summary: Provide admin commands for data node upgrade Key: HDFS-5585 URL: https://issues.apache.org/jira/browse/HDFS-5585 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-5584) Add OOB upgrade response and client-side logic for reads

2013-12-02 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-5584: Summary: Add OOB upgrade response and client-side logic for reads Key: HDFS-5584 URL: https://issues.apache.org/jira/browse/HDFS-5584 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-5583) Add OOB upgrade response and client-side logic for writes

2013-12-02 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-5583: Summary: Add OOB upgrade response and client-side logic for writes Key: HDFS-5583 URL: https://issues.apache.org/jira/browse/HDFS-5583 Project: Hadoop HDFS Issue Typ

Build failed in Jenkins: Hadoop-Hdfs-trunk #1600

2013-12-02 Thread Apache Jenkins Server
See Changes: [stevel] HADOOP-10135 writes to swift fs over partition size leave temp files and empty output file -- [...truncated 12396 lines...] Tests run: 10, Failures: 0, Errors: 0, Skipped

Hadoop-Hdfs-trunk - Build # 1600 - Failure

2013-12-02 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1600/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 12589 lines...] [INFO] Deleting /home/jenkins/jenkins-sl

Re: how to prevent JAVA HEAP OOM in shuffle process?

2013-12-02 Thread Adam Muise
Setting map memory at command line with the *new* api: hadoop jar hadoop-mapreduce-examples-2.2.0.2.0.6.0-76.jar wordcount -Dmapreduce.map.java.opts=-Xmx1024m /user/hdfs/ades /tmp/wordcount Setting map memory at command line with the *old* api: hadoop jar hadoop-mapreduce-examples-2.2.0.2.0.6.0-7

how to prevent JAVA HEAP OOM in shuffle process?

2013-12-02 Thread ch huang
hi,maillist: i recent get a problem,when i run MR job, it happened OOM in shuffle process,the options about MR is default,not changed,which option should i tuning? thanks

Build failed in Jenkins: Hadoop-Hdfs-0.23-Build #808

2013-12-02 Thread Apache Jenkins Server
See -- [...truncated 7699 lines...] [ERROR] symbol : class Parser [ERROR] location: package com.google.protobuf [ERROR]

Hadoop-Hdfs-0.23-Build - Build # 808 - Still Failing

2013-12-02 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/808/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7892 lines...] [ERROR] location: class com.google.pro