2.8 Release activities

2017-07-12 Thread Haohui Mai
Hi, Just curious -- what is the current status of the 2.8 release? It looks like the release process for some time. There are 5 or 6 blocker / critical bugs of the upcoming 2.8 release: https://issues.apache.org/jira/browse/YARN-6654?jql=project%20in%20(HDFS%2C%20HADOOP%2C%20MAPREDUCE%2C%20YARN)

Re: About 2.7.4 Release

2017-04-25 Thread Haohui Mai
It would be great to backport HDFS-9710 to 2.7.4 as this is one of the critical fixes on scalability. Maybe we should create a jira to track this? ~Haohui On Tue, Apr 25, 2017 at 12:06 AM, Akira Ajisaka wrote: > Ping > > I too can help with the release process. > > Now there are 0 blocker and 6

[jira] [Resolved] (HADOOP-9994) Incorrect ANT_HOME references in build.xml in branch-1

2017-04-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HADOOP-9994. Resolution: Won't Fix > Incorrect ANT_HOME references in build.xml in

[jira] [Created] (HADOOP-13136) shade protobuf in the hadoop-common jar

2016-05-12 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-13136: --- Summary: shade protobuf in the hadoop-common jar Key: HADOOP-13136 URL: https://issues.apache.org/jira/browse/HADOOP-13136 Project: Hadoop Common Issue Type

Re: 2.7.3 release plan

2016-04-03 Thread Haohui Mai
+1 on option 3. I volunteer to help on releasing 2.8.0 as 2.7.3 + HDFS-8578 and HDFS-8791. ~Haohui On Fri, Apr 1, 2016 at 2:54 PM, Chris Trezzo wrote: > A few thoughts: > > 1. To echo Andrew Wang, HDFS-8578 (parallel upgrades) should be a > prerequisite for HDFS-8791. Without that patch, upgrade

[jira] [Created] (HADOOP-12921) hadoop-minicluster should depend on hadoop-auth

2016-03-13 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-12921: --- Summary: hadoop-minicluster should depend on hadoop-auth Key: HADOOP-12921 URL: https://issues.apache.org/jira/browse/HADOOP-12921 Project: Hadoop Common

Re: node.js and more as dependencies

2016-03-02 Thread Haohui Mai
+1 on adding npm / gulp / mocha to be part of the build dependencies (not runtime). The main benefit is modularity -- for example, in the HDFS UI we manually duplicate the navigation bars and footer. We don't have unit tests for them due to the lack of infrastructure. In my opinion Introducing npm

Re: Introduce Apache Kerby to Hadoop

2016-02-29 Thread Haohui Mai
Steve Loughran wrote: > > > On 27 Feb 2016, at 19:02, Haohui Mai wrote: > > > > Have we evaluated GRPC? A robust RPC requires significant effort. > Migrating > > to GRPC can save ourselves a lot of headache. > > > > That's the google protobuf 3 b

Re: Introduce Apache Kerby to Hadoop

2016-02-27 Thread Haohui Mai
Have we evaluated GRPC? A robust RPC requires significant effort. Migrating to GRPC can save ourselves a lot of headache. Haohui On Sat, Feb 27, 2016 at 1:35 AM Andrew Purtell wrote: > I get a excited thinking about the prospect of better performance with > auth-conf QoP. HBase RPC is an increas

Re: Google Cloud Storage connector into Hadoop

2015-12-07 Thread Haohui Mai
Hi, Thanks for reaching out. It would be great to see this in the Hadoop ecosystem. In Hadoop we have AWS S3 support. IMO they address similar use cases thus I think that it should be relatively straightforward to adopt the code. The only catch in my head right now is to properly isolate depende

Re: Nightly Jenkins job for maintenance releases

2015-12-04 Thread Haohui Mai
that different from branch to branch, so the parameterized job might >> suffice for release purposes. >> >> Best, >> Andrew >> >> On Mon, Nov 30, 2015 at 9:58 AM, Haohui Mai wrote: >> >> > Hi, >> > >> > I'm helping Junping to

Nightly Jenkins job for maintenance releases

2015-11-30 Thread Haohui Mai
Hi, I'm helping Junping to get Hadoop 2.6.3 out of the door. Sanjin found out that there are some unit tests that are failing. I wonder, is it possible to set up some nightly Jenkins jobs for the maintenance lines so that we have better ideas on the quality of the releases? We can just turn it on

[jira] [Resolved] (HADOOP-12601) findbugs highlights problem with FsPermission

2015-11-25 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HADOOP-12601. - Resolution: Duplicate Fixed in HDFS-9451. > findbugs highlights problem with FsPermiss

[jira] [Created] (HADOOP-12592) Remove guava usage in the hdfs-client module

2015-11-23 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-12592: --- Summary: Remove guava usage in the hdfs-client module Key: HADOOP-12592 URL: https://issues.apache.org/jira/browse/HADOOP-12592 Project: Hadoop Common Issue

Re: continuing releases on Apache Hadoop 2.6.x

2015-11-18 Thread Haohui Mai
Hi, I can help on releasing 2.6.3. ~Haohui On Wed, Nov 18, 2015 at 8:20 AM, Chris Trezzo wrote: > Thanks Junping for the clarification! It was not my intention to violate > the rules. I would be happy to work with you and help you manage the > release in whatever way is most effective. > > Chr

[jira] [Created] (HADOOP-12579) Deprecate and remove WriteableRPCEngine

2015-11-17 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-12579: --- Summary: Deprecate and remove WriteableRPCEngine Key: HADOOP-12579 URL: https://issues.apache.org/jira/browse/HADOOP-12579 Project: Hadoop Common Issue Type

Re: [DISCUSS] Looking to a 2.8.0 release

2015-11-11 Thread Haohui Mai
ov 11, 2015 at 3:09 PM, Haohui Mai wrote: > bq. currently pulling in hadoop-client gives downstream apps > hadoop-hdfs-client, but not hadoop-hdfs server side, right? > > Right now hadoop-client pulls in hadoop-hdfs directly to ensure a > smooth transition. Maybe we can revisit the decis

Re: [DISCUSS] Looking to a 2.8.0 release

2015-11-11 Thread Haohui Mai
Loughran wrote: > >> On 11 Nov 2015, at 22:15, Haohui Mai wrote: >> >> bq. it basically makes the assumption that everyone recompiles for >> every minor release. >> >> I don't think that the statement holds. HDFS-6200 keeps classes in the >&

Re: [DISCUSS] Looking to a 2.8.0 release

2015-11-11 Thread Haohui Mai
bq. it basically makes the assumption that everyone recompiles for every minor release. I don't think that the statement holds. HDFS-6200 keeps classes in the same package. hdfs-client becomes a transitive dependency of the original hdfs jar. Applications continue to work without recompilation a

Re: Github integration for Hadoop

2015-11-10 Thread Haohui Mai
I have to some scripts that are tailored for the current git workflow, which is available at https://github.com/haohui/hdcli It's relatively straightforward to make it support github. ~Haohui On Tue, Nov 10, 2015 at 9:31 AM, Karthik Kambatla wrote: > Owen: Thanks for putting the documentation

Re: Github integration for Hadoop

2015-10-29 Thread Haohui Mai
+1 On Thu, Oct 29, 2015 at 10:55 AM, Hitesh Shah wrote: > +1 on supporting patch contributions through github pull requests. > > — Hitesh > > On Oct 29, 2015, at 10:47 AM, Owen O'Malley wrote: > >> All, >> For code & patch review, many of the newer projects are using the Github >> pull request

Re: hadoop-hdfs-client splitoff is going to break code

2015-10-23 Thread Haohui Mai
All tests that need to spin up a MiniDFSCluster will need to stay in hadoop-hdfs. Other client only tests are being moved to the hadoop-hdfs-client module, which is tracked in HDFS-9168. ~Haohui On Fri, Oct 23, 2015 at 2:14 PM, Kihwal Lee wrote: > I am not sure whether it was mentioned by anyone

[jira] [Created] (HADOOP-12507) Move retry policy to hadoop-common-client

2015-10-23 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-12507: --- Summary: Move retry policy to hadoop-common-client Key: HADOOP-12507 URL: https://issues.apache.org/jira/browse/HADOOP-12507 Project: Hadoop Common Issue Type

Re: Status: hadoop-common precommit

2015-10-22 Thread Haohui Mai
bq. It’s an extremely rare event that this type of re-ordering occurs, so risk/reward favors risk. Unfortunately HDFS-9214 requires building hadoop-hdfs-client before building hadoop-hdfs, which leads to the failure. Same problem for HADOOP-12500 as it introduces a new module hadoop-common-client.

Re: Status: hadoop-common precommit

2015-10-21 Thread Haohui Mai
It seems like changes that involve multiple modules are failing consistently. https://issues.apache.org/jira/browse/HDFS-9241?focusedCommentId=14968008&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14968008 https://issues.apache.org/jira/browse/HADOOP-12500?focusedC

[jira] [Created] (HADOOP-12500) Change pom.xml to create the hadoop-common-client project

2015-10-21 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-12500: --- Summary: Change pom.xml to create the hadoop-common-client project Key: HADOOP-12500 URL: https://issues.apache.org/jira/browse/HADOOP-12500 Project: Hadoop Common

[jira] [Created] (HADOOP-12499) Create a client jar for hadoop-common

2015-10-21 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-12499: --- Summary: Create a client jar for hadoop-common Key: HADOOP-12499 URL: https://issues.apache.org/jira/browse/HADOOP-12499 Project: Hadoop Common Issue Type

Re: hadoop-hdfs-client splitoff is going to break code

2015-10-14 Thread Haohui Mai
Option 2 sounds good to me. It might make sense to make hadoop-client directly depends on Hadoop-hdfs? Haohui On Wed, Oct 14, 2015 at 10:56 AM larry mccay wrote: > Interesting... > > As long as #2 provides full backward compatibility and the ability to > explicitly exclude the server dependenci

Re: [DISCUSS] About the details of JDK-8 support

2015-10-13 Thread Haohui Mai
Just to echo Steve's idea -- if we're seriously considering supporting JDK 8, maybe the first thing to do is to set up the jenkins to run with JDK 8? I'm happy to help. Does anyone know who I can talk to if I need to play around with all the Jenkins knob? ~Haohui On Tue, Oct 13, 2015 at 8:24 AM,

[jira] [Reopened] (HADOOP-12469) distcp shout not ignore the ignoreFailures option

2015-10-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai reopened HADOOP-12469: - Reopening the jira. Sorry for the noise -- I realized that I haven't posted my +1 on the

Re: CHANGES.TXT

2015-09-12 Thread Haohui Mai
CHANGES.txt is always a pain. *sigh* It seems that relying on human efforts to maintain the CHANGES.txt is error-prone and not sustainable. It is always a pain to fix them. I think aw has some scripts for option 2. I would like to propose option 3 which might be more robust: (1) do a git log on

[jira] [Created] (HADOOP-12405) Expose NN RPC via HTTP / HTTPS

2015-09-11 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-12405: --- Summary: Expose NN RPC via HTTP / HTTPS Key: HADOOP-12405 URL: https://issues.apache.org/jira/browse/HADOOP-12405 Project: Hadoop Common Issue Type: New

Location of the protobuf library on Jenkins machines

2015-09-04 Thread Haohui Mai
Hi, I wonder where the protobuf library is installed in the Jenkins machine? I'm aware of the Jenkins machines has protoc installed but I don't know where the headers and the libraries are installed. I'm looking into setting up Jenkins build for the HDFS-8707 branch which requires the header and

[jira] [Created] (HADOOP-11765) Signal congestion on the DataNode

2015-03-27 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11765: --- Summary: Signal congestion on the DataNode Key: HADOOP-11765 URL: https://issues.apache.org/jira/browse/HADOOP-11765 Project: Hadoop Common Issue Type: New

[jira] [Resolved] (HADOOP-11752) Failed to execute goal org.apache.hadoop:hadoop-maven-plugins:2.4.0:protoc (compile-protoc) on project hadoop-common: org.apache.maven.plugin.MojoExecutionException: p

2015-03-25 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HADOOP-11752. - Resolution: Invalid Target Version/s: 2.6.0, 2.4.0 (was: 2.4.0, 2.6.0) > Failed

[jira] [Created] (HADOOP-11748) Secrets for auth cookies can be specified in clear text

2015-03-25 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11748: --- Summary: Secrets for auth cookies can be specified in clear text Key: HADOOP-11748 URL: https://issues.apache.org/jira/browse/HADOOP-11748 Project: Hadoop Common

[jira] [Created] (HADOOP-11744) Support OAuth2 in Hadoop

2015-03-24 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11744: --- Summary: Support OAuth2 in Hadoop Key: HADOOP-11744 URL: https://issues.apache.org/jira/browse/HADOOP-11744 Project: Hadoop Common Issue Type: New Feature

[jira] [Created] (HADOOP-11726) Allow applications to access both secure and insecure clusters at the same time

2015-03-18 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11726: --- Summary: Allow applications to access both secure and insecure clusters at the same time Key: HADOOP-11726 URL: https://issues.apache.org/jira/browse/HADOOP-11726

[jira] [Resolved] (HADOOP-10367) Hadoop 2.2 Building error

2015-03-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HADOOP-10367. - Resolution: Invalid > Hadoop 2.2 Building er

[jira] [Resolved] (HADOOP-10795) unale to build hadoop 2.4.1(redhat5.8 x64)

2015-03-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HADOOP-10795. - Resolution: Invalid > unale to build hadoop 2.4.1(redhat5.8

[jira] [Resolved] (HADOOP-11192) Change old subversion links to git

2015-03-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HADOOP-11192. - Resolution: Invalid site.xml no longer contains the svn information. > Change old subvers

[jira] [Resolved] (HADOOP-11366) Fix findbug warnings after move to Java 7

2015-03-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HADOOP-11366. - Resolution: Duplicate It has been fixed in HADOOP-10477. > Fix findbug warnings after move

[jira] [Resolved] (HADOOP-11633) Convert remaining branch-2 .apt.vm files to markdown

2015-03-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HADOOP-11633. - Resolution: Fixed > Convert remaining branch-2 .apt.vm files to markd

[jira] [Created] (HADOOP-11716) Bump netty version to 4.1

2015-03-13 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11716: --- Summary: Bump netty version to 4.1 Key: HADOOP-11716 URL: https://issues.apache.org/jira/browse/HADOOP-11716 Project: Hadoop Common Issue Type: Bug

Request wiki access

2015-03-13 Thread Haohui Mai
Hi, I would like to create a wiki page https://wiki.apache.org/hadoop/GSoC2015 to record the ideas for GSoC 2015. Your help on granting me the permissions to edit the wiki is appreciated. Thanks, Haohui

[jira] [Resolved] (HADOOP-11712) Error : ExecuteStatement finished with operation state: CLOSED_STATE” :

2015-03-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HADOOP-11712. - Resolution: Not a Problem The jira system only logs bugs in the core hadoop. Please redirect

[jira] [Created] (HADOOP-11682) Move the native code for libhadoop into a dedicated directory

2015-03-05 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11682: --- Summary: Move the native code for libhadoop into a dedicated directory Key: HADOOP-11682 URL: https://issues.apache.org/jira/browse/HADOOP-11682 Project: Hadoop Common

[jira] [Created] (HADOOP-11679) Create build infrastructure for the native RPC client

2015-03-05 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11679: --- Summary: Create build infrastructure for the native RPC client Key: HADOOP-11679 URL: https://issues.apache.org/jira/browse/HADOOP-11679 Project: Hadoop Common

[jira] [Resolved] (HADOOP-10477) Clean up findbug warnings found by findbugs 3.0.0

2015-02-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HADOOP-10477. - Resolution: Fixed We fixed all new warnings for findbugs 3.0.0. Thanks everybody for the hard

[jira] [Resolved] (HADOOP-11443) hadoop.auth cookie has invalid Expires if used with non-US default Locale

2014-12-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HADOOP-11443. - Resolution: Duplicate Since we have moved to Java 7, we can use the {{Cookie}} class form Java

Re: Upgrading findbugs

2014-12-18 Thread Haohui Mai
So far we made great progress on fixing findbugs warnings. We're free of findbugs warnings in hdfs, nfs, and a couple other sub projects. There are two findbugs warnings left in hadoop-common. I saw there are some progresses on the YARN side as well. Thanks very much for the contributors (Brandon

[jira] [Resolved] (HADOOP-11389) Clean up byte to string encoding issues in hadoop-common

2014-12-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HADOOP-11389. - Resolution: Fixed I've committed the patch to trunk and branch-2. > Clean up byte t

[jira] [Reopened] (HADOOP-11389) Clean up byte to string encoding issues in hadoop-common

2014-12-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai reopened HADOOP-11389: - > Clean up byte to string encoding issues in hadoop-com

[jira] [Resolved] (HADOOP-11389) Clean up byte to string encoding issues in hadoop-common

2014-12-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HADOOP-11389. - Resolution: Fixed > Clean up byte to string encoding issues in hadoop-com

[jira] [Created] (HADOOP-11389) Clean up byte to string encoding issues in hadoop-common

2014-12-10 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11389: --- Summary: Clean up byte to string encoding issues in hadoop-common Key: HADOOP-11389 URL: https://issues.apache.org/jira/browse/HADOOP-11389 Project: Hadoop Common

[jira] [Created] (HADOOP-11388) Remove deprecated o.a.h.metrics.file.FileContext

2014-12-10 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11388: --- Summary: Remove deprecated o.a.h.metrics.file.FileContext Key: HADOOP-11388 URL: https://issues.apache.org/jira/browse/HADOOP-11388 Project: Hadoop Common

[jira] [Created] (HADOOP-11387) Simplify NetUtils#canonicalizeHost()

2014-12-09 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11387: --- Summary: Simplify NetUtils#canonicalizeHost() Key: HADOOP-11387 URL: https://issues.apache.org/jira/browse/HADOOP-11387 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-11385) Cross site scripting attack on JMXJSONServlet

2014-12-09 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11385: --- Summary: Cross site scripting attack on JMXJSONServlet Key: HADOOP-11385 URL: https://issues.apache.org/jira/browse/HADOOP-11385 Project: Hadoop Common Issue

Upgrading findbugs

2014-12-08 Thread Haohui Mai
Hi, The recent changes on moving to Java 7 triggers a bug in findbug ( http://sourceforge.net/p/findbugs/bugs/918), which causes all pre-commit runs (e.g., HADOOP-11287) to fail. The current version of findbugs (1.3.9) used by Hadoop is released in 2009. Given that: (1) The current bug that we h

[jira] [Created] (HADOOP-11365) Use Java 7's HttpCookie class to handle Secure and HttpOnly flag

2014-12-08 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11365: --- Summary: Use Java 7's HttpCookie class to handle Secure and HttpOnly flag Key: HADOOP-11365 URL: https://issues.apache.org/jira/browse/HADOOP-11365 Project: H

[jira] [Created] (HADOOP-11357) Print information of the build enviornment in test-patch.sh

2014-12-05 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11357: --- Summary: Print information of the build enviornment in test-patch.sh Key: HADOOP-11357 URL: https://issues.apache.org/jira/browse/HADOOP-11357 Project: Hadoop Common

Re: Switching to Java 7

2014-12-01 Thread Haohui Mai
Hi Steve, I think the pre-commit Jenkins are running Java 6, they need to be switched to Java 7 as well. Haohui > On Dec 1, 2014, at 5:41 AM, Steve Loughran wrote: > > I'm planning to flip the Javac language & JVM settings to java 7 this week > > https://issues.apache.org/jira/browse/HADOOP-

[jira] [Resolved] (HADOOP-11297) how to get all the details of live node and dead node using hadoop api in java

2014-11-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HADOOP-11297. - Resolution: Invalid > how to get all the details of live node and dead node using hadoop api

[jira] [Created] (HADOOP-11287) Simplify UGI#reloginFromKeytab for Java 7+

2014-11-09 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11287: --- Summary: Simplify UGI#reloginFromKeytab for Java 7+ Key: HADOOP-11287 URL: https://issues.apache.org/jira/browse/HADOOP-11287 Project: Hadoop Common Issue

Re: Guava

2014-11-09 Thread Haohui Mai
Guava did make the lives of Hadoop development easier in many cases -- What I've been consistently hearing is that the version of Guava used is Hadoop is so old that it starts to hurt the application developers. I appreciate the value of Guava -- things like CacheMap are fairly difficult to implem

[jira] [Created] (HADOOP-11269) Add java 8 profile for hadoop-annotations

2014-11-04 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11269: --- Summary: Add java 8 profile for hadoop-annotations Key: HADOOP-11269 URL: https://issues.apache.org/jira/browse/HADOOP-11269 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-11268) Update BUILDING.txt to remove the workaround for tools.jar

2014-11-04 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11268: --- Summary: Update BUILDING.txt to remove the workaround for tools.jar Key: HADOOP-11268 URL: https://issues.apache.org/jira/browse/HADOOP-11268 Project: Hadoop Common

[jira] [Created] (HADOOP-11246) Move jenkins to Java 7

2014-10-29 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11246: --- Summary: Move jenkins to Java 7 Key: HADOOP-11246 URL: https://issues.apache.org/jira/browse/HADOOP-11246 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-11219) Upgrade to netty 4

2014-10-22 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11219: --- Summary: Upgrade to netty 4 Key: HADOOP-11219 URL: https://issues.apache.org/jira/browse/HADOOP-11219 Project: Hadoop Common Issue Type: Improvement

[jira] [Created] (HADOOP-11028) Use Java 7 HttpCookie to implement hadoop.auth cookie

2014-08-29 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11028: --- Summary: Use Java 7 HttpCookie to implement hadoop.auth cookie Key: HADOOP-11028 URL: https://issues.apache.org/jira/browse/HADOOP-11028 Project: Hadoop Common

[jira] [Reopened] (HADOOP-8719) Workaround for kerberos-related log errors upon running any hadoop command on OSX

2014-07-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai reopened HADOOP-8719: Reopen this issue since it breaks secure set ups running under Mac OS X. Secure cluster won'

[jira] [Created] (HADOOP-10748) HttpServer2 should not load JspServlet

2014-06-24 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-10748: --- Summary: HttpServer2 should not load JspServlet Key: HADOOP-10748 URL: https://issues.apache.org/jira/browse/HADOOP-10748 Project: Hadoop Common Issue Type

[jira] [Reopened] (HADOOP-10717) Missing JSP support in Jetty, 'NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet' when user want to start namenode.

2014-06-18 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai reopened HADOOP-10717: - > Missing JSP support in Jetty, 'NO JSP Support for /, did

[jira] [Resolved] (HADOOP-10717) Missing JSP support in Jetty, 'NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet' when user want to start namenode.

2014-06-18 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HADOOP-10717. - Resolution: Invalid > Missing JSP support in Jetty, 'NO JSP Support for /, did

[jira] [Created] (HADOOP-10563) Remove the dependency of jsp in trunk

2014-05-01 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-10563: --- Summary: Remove the dependency of jsp in trunk Key: HADOOP-10563 URL: https://issues.apache.org/jira/browse/HADOOP-10563 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-10551) Consolidate the logic of path resolution in FSDirectory

2014-04-29 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-10551: --- Summary: Consolidate the logic of path resolution in FSDirectory Key: HADOOP-10551 URL: https://issues.apache.org/jira/browse/HADOOP-10551 Project: Hadoop Common

Re: Text cmd in webhdfs

2014-04-25 Thread Haohui Mai
I suggest to build a separate tool streaming from a fs instead of baking it into webhdfs. One goal in webhdfs is to minimize the dependency of both the webhdfs server and the client so that other projects easily adopt it. If hadoop fs is too slow, it might be a good idea to build a new tool that r

[jira] [Created] (HADOOP-10487) Racy code in UserGroupInformation#ensureInitialized()

2014-04-09 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-10487: --- Summary: Racy code in UserGroupInformation#ensureInitialized() Key: HADOOP-10487 URL: https://issues.apache.org/jira/browse/HADOOP-10487 Project: Hadoop Common

[jira] [Created] (HADOOP-10486) Remove typedbytes support from hadoop-streaming

2014-04-08 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-10486: --- Summary: Remove typedbytes support from hadoop-streaming Key: HADOOP-10486 URL: https://issues.apache.org/jira/browse/HADOOP-10486 Project: Hadoop Common

[jira] [Created] (HADOOP-10485) Remove dead classes in hadoop-streaming

2014-04-08 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-10485: --- Summary: Remove dead classes in hadoop-streaming Key: HADOOP-10485 URL: https://issues.apache.org/jira/browse/HADOOP-10485 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-10484) Remove o.a.h.conf.Reconfig*

2014-04-08 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-10484: --- Summary: Remove o.a.h.conf.Reconfig* Key: HADOOP-10484 URL: https://issues.apache.org/jira/browse/HADOOP-10484 Project: Hadoop Common Issue Type: Improvement

[jira] [Created] (HADOOP-10482) Fix new findbugs warnings in hadoop-common

2014-04-08 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-10482: --- Summary: Fix new findbugs warnings in hadoop-common Key: HADOOP-10482 URL: https://issues.apache.org/jira/browse/HADOOP-10482 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-10481) Fix new findbugs warnings in hadoop-auth

2014-04-08 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-10481: --- Summary: Fix new findbugs warnings in hadoop-auth Key: HADOOP-10481 URL: https://issues.apache.org/jira/browse/HADOOP-10481 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-10480) Fix new findbugs warnings in hadoop-hdfs

2014-04-08 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-10480: --- Summary: Fix new findbugs warnings in hadoop-hdfs Key: HADOOP-10480 URL: https://issues.apache.org/jira/browse/HADOOP-10480 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-10479) Fix new findbugs warnings in hadoop-minikdc

2014-04-08 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-10479: --- Summary: Fix new findbugs warnings in hadoop-minikdc Key: HADOOP-10479 URL: https://issues.apache.org/jira/browse/HADOOP-10479 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-10478) Fix new findbugs warnings in hadoop-maven-plugins

2014-04-08 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-10478: --- Summary: Fix new findbugs warnings in hadoop-maven-plugins Key: HADOOP-10478 URL: https://issues.apache.org/jira/browse/HADOOP-10478 Project: Hadoop Common

[jira] [Created] (HADOOP-10477) Clean up findbug warnings found by findbugs 2.0.2

2014-04-08 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-10477: --- Summary: Clean up findbug warnings found by findbugs 2.0.2 Key: HADOOP-10477 URL: https://issues.apache.org/jira/browse/HADOOP-10477 Project: Hadoop Common

[jira] [Created] (HADOOP-10476) Bumping the findbugs version to 2.5.3

2014-04-08 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-10476: --- Summary: Bumping the findbugs version to 2.5.3 Key: HADOOP-10476 URL: https://issues.apache.org/jira/browse/HADOOP-10476 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-10474) Move o.a.h.record to hadoop-streaming

2014-04-08 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-10474: --- Summary: Move o.a.h.record to hadoop-streaming Key: HADOOP-10474 URL: https://issues.apache.org/jira/browse/HADOOP-10474 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-10468) TestMetricsSystemImpl.testMultiThreadedPublish fails intermediately

2014-04-07 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-10468: --- Summary: TestMetricsSystemImpl.testMultiThreadedPublish fails intermediately Key: HADOOP-10468 URL: https://issues.apache.org/jira/browse/HADOOP-10468 Project: Hadoop

Re: Plans of moving towards JDK7 in trunk

2014-04-07 Thread Haohui Mai
It looks to me that the majority of this thread welcomes JDK7. Just to reiterate, there are two separate questions here: 1. When should hadoop-trunk can be only built on top of JDK7? 2. When should hadoop-branch-2 can be only built on top of JDK7? The answers of the above questions directly imply

Re: Plans of moving towards JDK7 in trunk

2014-04-04 Thread Haohui Mai
ong, but I think that's enough. The work should be minimal. ~Haohui On Fri, Apr 4, 2014 at 3:43 PM, Sangjin Lee wrote: > Please don't forget the mac os build on JDK 7. :) > > > On Fri, Apr 4, 2014 at 3:15 PM, Haohui Mai wrote: > > > I'm referring to the lat

Re: Plans of moving towards JDK7 in trunk

2014-04-04 Thread Haohui Mai
gard? > > Thanks > > > On Fri, Apr 4, 2014 at 2:29 PM, Haohui Mai wrote: > > > Hi, > > > > There have been multiple discussions on deprecating supports of JDK6 and > > moving towards JDK7. It looks to me that the consensus is that now hadoop > > is r

Plans of moving towards JDK7 in trunk

2014-04-04 Thread Haohui Mai
Hi, There have been multiple discussions on deprecating supports of JDK6 and moving towards JDK7. It looks to me that the consensus is that now hadoop is ready to drop the support of JDK6 and to move towards JDK7. Based on the consensus, I wonder whether it is a good time to start the migration.

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-03 Thread Haohui Mai
HDFS-6180 seems to be a blocker of 2.4. I'll post a patch later today. ~Haohui On Thu, Apr 3, 2014 at 3:47 PM, Azuryy wrote: > Did you tested RM failover on Hive? There is bug. > > > Sent from my iPhone5s > > > On 2014年4月4日, at 2:12, Xuan Gong wrote: > > > > +1 non-binding > > > > Built from

[jira] [Created] (HADOOP-10453) Do not use AuthenticatedURL in hadoop core

2014-03-31 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-10453: --- Summary: Do not use AuthenticatedURL in hadoop core Key: HADOOP-10453 URL: https://issues.apache.org/jira/browse/HADOOP-10453 Project: Hadoop Common Issue

Re: very old dependencies

2014-03-28 Thread Haohui Mai
Given the fact that Java 6 is EOL for a while, I wonder, when is a good time to drop the support of java 6 in trunk? New functionalities in JDK7 such as file system watcher can simplify the implementation of the name node and the data node in HDFS. On Fri, Mar 28, 2014 at 10:30 AM, Steve Loughra

[jira] [Resolved] (HADOOP-10439) Fix compilation error in branch-2 after HADOOP-10426

2014-03-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HADOOP-10439. - Resolution: Fixed Fix Version/s: 2.5.0 I've committed it to branch-2. Thanks [~sze

[jira] [Created] (HADOOP-10439) Fix compilation error in branch-2 after HADOOP-10426

2014-03-26 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-10439: --- Summary: Fix compilation error in branch-2 after HADOOP-10426 Key: HADOOP-10439 URL: https://issues.apache.org/jira/browse/HADOOP-10439 Project: Hadoop Common

[jira] [Created] (HADOOP-10379) Protect authentication cookies with the HttpOnly and Secure flags

2014-03-03 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-10379: --- Summary: Protect authentication cookies with the HttpOnly and Secure flags Key: HADOOP-10379 URL: https://issues.apache.org/jira/browse/HADOOP-10379 Project: Hadoop

  1   2   >