[jira] [Resolved] (HADOOP-17312) S3AInputStream to be resilient to faiures in abort(); translate AWS Exceptions

2020-10-30 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HADOOP-17312. Resolution: Duplicate > S3AInputStream to be resilient to faiures in abort(); transl

[jira] [Created] (HADOOP-17338) Intermittent S3AInputStream failures: Premature end of Content-Length delimited message body etc

2020-10-30 Thread Yongjun Zhang (Jira)
Yongjun Zhang created HADOOP-17338: -- Summary: Intermittent S3AInputStream failures: Premature end of Content-Length delimited message body etc Key: HADOOP-17338 URL: https://issues.apache.org/jira/browse/HADOOP

Re: [VOTE] Merge HDFS-12943 branch to trunk - Consistent Reads from Standby

2018-12-12 Thread Yongjun Zhang
insert calls back into the call queue. That's > > completely unacceptable. A buggy or malicious client can easily cause > > livelock in the IPC layer with handlers only looping on calls that never > > satisfy the condition. Why is this not implemented via > RetriableExcepti

Re: [VOTE] Merge HDFS-12943 branch to trunk - Consistent Reads from Standby

2018-12-05 Thread Yongjun Zhang
Great work guys. Wonder if we can elaborate what's impact of not having #2 fixed, and why #2 is not needed for the feature to complete? 2. Need to fix automatic failover with ZKFC. Currently it does not doesn't know about ObserverNodes trying to convert them to SBNs. Thanks. --Yongjun On Wed, D

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-09-09 Thread Yongjun Zhang
hadoop.apache.org/releases.html page. > > I just did it, FYI: https://svn.apache.org/viewvc?view=revision&revision= > 1837967 > > Thanks > +Vinod > > > On May 31, 2018, at 10:48 PM, Yongjun Zhang wrote: > > Greetings all, > > I've created the first re

[jira] [Created] (HADOOP-15720) rpcTimeout may not have been applied correctly

2018-09-04 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-15720: -- Summary: rpcTimeout may not have been applied correctly Key: HADOOP-15720 URL: https://issues.apache.org/jira/browse/HADOOP-15720 Project: Hadoop Common

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-07-10 Thread Yongjun Zhang
--Yongjun On Mon, Jul 9, 2018 at 2:08 PM, Jonathan Eagles wrote: > Thank you, Yongjun Zhang for resolving this issue for me. I have verified > the 3.0.3 build is now working for me for tez to specify as a hadoop > dependency. > > As for release procedure, can someone comment o

[jira] [Created] (HADOOP-15590) Two gpg related errors when doing hadoop release

2018-07-09 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-15590: -- Summary: Two gpg related errors when doing hadoop release Key: HADOOP-15590 URL: https://issues.apache.org/jira/browse/HADOOP-15590 Project: Hadoop Common

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-07-09 Thread Yongjun Zhang
today and now 2.9.1 is pushed to the mvn repo. >> >> You can double check it. I suspect sometimes Nexus may fail to notify >> user when this is unexpected failures. >> >> >> >> >> >> Bests, >> >> Sammi >> >> *From:* Yongj

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-16 Thread Yongjun Zhang
can resume the build with the > command > [ERROR] mvn -rf :hadoop-shim > > Not seeing the artifact published here as well. > https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-project > > On Tue, Jun 12, 2018 at 6:44 PM, Yongjun Zhang > wrote: > >> Thank

[jira] [Created] (HADOOP-15538) Possible dead lock in Client

2018-06-13 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-15538: -- Summary: Possible dead lock in Client Key: HADOOP-15538 URL: https://issues.apache.org/jira/browse/HADOOP-15538 Project: Hadoop Common Issue Type: Bug

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-12 Thread Yongjun Zhang
Verified that various queue config properties for CS are refreshable > - Verified streaming jobs work as expected > - Verified that user weights work as expected > - Verified that FairOrderingPolicy in a CS queue will evenly assign > resources > - Verified running yarn shell applicatio

[jira] [Created] (HADOOP-15530) RPC could stuck at senderFuture.get()

2018-06-11 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-15530: -- Summary: RPC could stuck at senderFuture.get() Key: HADOOP-15530 URL: https://issues.apache.org/jira/browse/HADOOP-15530 Project: Hadoop Common Issue

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-08 Thread Yongjun Zhang
istributed HDFS with KMS >>- Ran basic hdfs commands with encryption >>- Sanity checked webui and logs >> >> >> >> -Xiao >> >> On Fri, Jun 8, 2018 at 10:34 AM, Brahma Reddy Battula < >> brahmareddy.batt...@hotmail.com> wrote: >>

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-08 Thread Yongjun Zhang
Hello, PMC votes are needed for release, can I get some help from PMCs? Really appreciate it! --Yongjun On Thu, Jun 7, 2018 at 6:15 PM, Yongjun Zhang wrote: > Thank you all very much for the testing, feedback and discussion! > > I was able to build outside docker, by following

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-07 Thread Yongjun Zhang
BTW, thanks Allen and Steve for discussing and suggestion about the site build problem I hit earlier, I did the following step mvn install -DskipTests before doing the steps Nanda listed helped to solve the problems. --Yongjun On Thu, Jun 7, 2018 at 6:15 PM, Yongjun Zhang wrote: > Th

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-07 Thread Yongjun Zhang
Thank you all very much for the testing, feedback and discussion! I was able to build outside docker, by following the steps Nanda described, I saw the same problem; then I tried 3.0.2 released a while back, it has the same issue. As Allen pointed out, it seems the steps to build site are not cor

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-06 Thread Yongjun Zhang
bu Asanuma > wrote: > >> Sorry, I forgot to write my vote in the last message. >> >> +1 (non-binding) >> >> Regards, >> Takanobu >> >> > -Original Message- >> > From: Takanobu Asanuma [mailto:tasan...@yahoo-corp.jp] >> >

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-02 Thread Yongjun Zhang
Hi Gabor, I got the git tag in, it's release-3.0.3-RC0. Would you please give it a try? It should correspond to commit 37fd7d752db73d984dc31e0cdfd590d252f5e075 Author: Yongjun Zhang Date: Wed May 30 00:07:33 2018 -0700 Update version to 3.0.3 to prepare for 3.0.3 release T

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-02 Thread Yongjun Zhang
t; - basic sanity check of NN, RM UI > > > > Thanks, > > Ajay > > > > On 6/2/18, 12:45 AM, "Shashikant Banerjee" < > sbaner...@hortonworks.com> > > wrote: > > > > Hi Yongjun, > >

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-01 Thread Yongjun Zhang
jobs work as expected > - Verified that user weights work as expected > - Verified that FairOrderingPolicy in a CS queue will evenly assign > resources > - Verified running yarn shell application runs as expected > > > > > > > > On Friday, June 1, 2018,

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-01 Thread Yongjun Zhang
>> https://issues.apache.org/jira/issues/?filter=12343997 > > Even after logging in, I am not able to see any jiras. > It says "The requested filter doesn't exist or is private." > > On Fri, Jun 1, 2018 at 10:41 AM, Yongjun Zhang > wrote: > >> Thank

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-01 Thread Yongjun Zhang
ems to be private. I can't see the >> blocker list. >> https://issues.apache.org/jira/issues/?filter=12343997 >> >> Meanwhile , I will be working on testing the release. >> >> Thanks >> Shashi >> On 6/1/18, 11:18 AM, "Yongjun Zhang" wr

[VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-05-31 Thread Yongjun Zhang
Greetings all, I've created the first release candidate (RC0) for Apache Hadoop 3.0.3. This is our next maintenance release to follow up 3.0.2. It includes about 249 important fixes and improvements, among which there are 8 blockers. See https://issues.apache.org/jira/issues/?filter=12343997 The

Re: Apache Hadoop 3.0.3 Release plan

2018-05-31 Thread Yongjun Zhang
rther. Sorry for the inconvenience. --Yongjun On Wed, May 30, 2018 at 11:49 AM, Yongjun Zhang wrote: > Hi, > > The build issues are all solved, and I have cut the 3.0.3 branch and close > to get a build out. Since it's taking me a bit more time (I expect to send > vote invitation

Re: Apache Hadoop 3.0.3 Release plan

2018-05-30 Thread Yongjun Zhang
Sorry, forgot to mention Junping Du, who also helped me a lot. Many thanks Junping! Thanks. --Yongjun On Wed, May 30, 2018 at 11:49 AM, Yongjun Zhang wrote: > Hi, > > The build issues are all solved, and I have cut the 3.0.3 branch and close > to get a build out. Since it'

Re: Apache Hadoop 3.0.3 Release plan

2018-05-30 Thread Yongjun Zhang
ndrew Wang, Eddy Xu who helped when I tried to solve the build issues. At this point, please be aware of the existence of branch-3.0, branch-3.0.3. Best, --Yongjun On Sat, May 26, 2018 at 11:52 PM, Yongjun Zhang wrote: > HI, > > I did build before cut branch and hit some issues, h

Re: Apache Hadoop 3.0.3 Release plan

2018-05-26 Thread Yongjun Zhang
HI, I did build before cut branch and hit some issues, have not got to the bottom, will cut branch after the build issues are resolved. Thanks. --Yongjun On Sat, May 26, 2018 at 1:46 PM, Yongjun Zhang wrote: > Hi All, > > I will be working on cutting the 3.0.3 branch and trying a bu

Re: Apache Hadoop 3.0.3 Release plan

2018-05-26 Thread Yongjun Zhang
Hi All, I will be working on cutting the 3.0.3 branch and trying a build today. Thanks. --Yongjun On Wed, May 23, 2018 at 3:31 PM, Yongjun Zhang wrote: > Thanks Eric. Sounds good. I may try to see if I can do the branching/RC > sooner. > > --Yongjun > > > On Wed, Ma

Re: Apache Hadoop 3.0.3 Release plan

2018-05-23 Thread Yongjun Zhang
> too early. > > Echoing Eric Payne, I think we should wait to cut the branch until we are > actually creating the RC to vote on (i.e. on May 29 or 30 if the vote is to > be on May 30). > > Eric > > > > On Wed, May 23, 2018 at 4:11 PM, Yongjun Zhang > wrote: >

Re: Apache Hadoop 3.0.3 Release plan

2018-05-23 Thread Yongjun Zhang
in 3.0.3 release. This is a fix that > will enable HBase to use Hadoop 3.0.x in the production line. > > thanks > Vrushali > > > On Tue, May 8, 2018 at 10:24 AM, Yongjun Zhang > wrote: > >> Thanks Wei-Chiu and Haibo for the feedback! >> >> Good thing is th

Re: [ANNOUNCE] Apache Hadoop 2.9.1 Release

2018-05-19 Thread Yongjun Zhang
please > refer to CHANGES [2] and RELEASENOTES [3]. > - For download, please got to download page[4] > > Thank you all for contributing to the Apache Hadoop 2.9.1. > > > Last, thanks Yongjun Zhang, Junping Du, Andrew Wang and Chris Douglas for > your help and support. > &

Re: Apache Hadoop 3.0.3 Release plan

2018-05-08 Thread Yongjun Zhang
>> downstream projects can't pick it up (after the fact that HBase is one of >> the most important projects around Hadoop). >> >> On Mon, May 7, 2018 at 1:19 PM, Yongjun Zhang >> wrote: >> >> > Hi Eric, >> > >> > Thanks for the

Re: Apache Hadoop 3.0.3 Release plan

2018-05-07 Thread Yongjun Zhang
-Eric Payne > > > > > > On Monday, May 7, 2018, 12:09:00 AM CDT, Yongjun Zhang < > yjzhan...@apache.org> wrote: > > > > > > Hi All, > > > > We have released Apache Hadoop 3.0.2 in April of this year [1]. Since then, > there are quite some

Apache Hadoop 3.0.3 Release plan

2018-05-06 Thread Yongjun Zhang
Hi All, > We have released Apache Hadoop 3.0.2 in April of this year [1]. Since then, there are quite some commits done to branch-3.0. To further improve the quality of release, we plan to do 3.0.3 release now. The focus of 3.0.3 will be fixing blockers (3), critical bugs (17) and bug fixes (~130)

Re: [ANNOUNCE] Apache Hadoop 3.0.0 GA is released

2017-12-20 Thread Yongjun Zhang
Congratulations Andrew and all, a great milestone! Thanks Andrew for driving it! --Yongjun On Tue, Dec 19, 2017 at 9:10 AM, Jonathan Kelly wrote: > Thanks, Andrew! > > On Mon, Dec 18, 2017 at 4:54 PM Andrew Wang > wrote: > > > Thanks for the spot, I just pushed a correct tag. I can't delete th

[jira] [Resolved] (HADOOP-14262) rpcTimeOut is not set up correctly in Client thus client doesn't time out

2017-08-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HADOOP-14262. Resolution: Duplicate > rpcTimeOut is not set up correctly in Client thus client does

[jira] [Created] (HADOOP-14526) Examine code base for cases that exception is thrown from finally block

2017-06-14 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-14526: -- Summary: Examine code base for cases that exception is thrown from finally block Key: HADOOP-14526 URL: https://issues.apache.org/jira/browse/HADOOP-14526

[jira] [Resolved] (HADOOP-14496) Logs for KMS delegation token lifecycle

2017-06-06 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HADOOP-14496. Resolution: Duplicate > Logs for KMS delegation token lifecy

[jira] [Created] (HADOOP-14496) Logs for KMS delegation token lifecycle

2017-06-06 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-14496: -- Summary: Logs for KMS delegation token lifecycle Key: HADOOP-14496 URL: https://issues.apache.org/jira/browse/HADOOP-14496 Project: Hadoop Common Issue

[jira] [Resolved] (HADOOP-14407) DistCp - Introduce a configurable copy buffer size

2017-05-25 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HADOOP-14407. Resolution: Fixed > DistCp - Introduce a configurable copy buffer s

Re: Jenkins test failure

2017-05-17 Thread Yongjun Zhang
Regards, > Akira > > On 2017/05/17 18:38, Yongjun Zhang wrote: > >> Hi, >> >> I saw quite a few jenkins test failure for patches uploaded to jira, >> >> For example, >> https://builds.apache.org/job/PreCommit-HADOOP-Build/12347/console >> >&g

Jenkins test failure

2017-05-17 Thread Yongjun Zhang
Hi, I saw quite a few jenkins test failure for patches uploaded to jira, For example, https://builds.apache.org/job/PreCommit-HADOOP-Build/12347/console apache-yetus-2971eff/yetus-project/pom.xml Modes: Sentinel MultiJDK Jenkins Robot Docker ResetRepo UnitTests Processing: HADOOP-14407 HA

[jira] [Reopened] (HADOOP-14407) DistCp - Introduce a configurable copy buffer size

2017-05-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reopened HADOOP-14407: > DistCp - Introduce a configurable copy buffer s

[jira] [Resolved] (HADOOP-14407) DistCp - Introduce a configurable copy buffer size

2017-05-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HADOOP-14407. Resolution: Information Provided > DistCp - Introduce a configurable copy buffer s

[jira] [Created] (HADOOP-14333) HADOOP-14104 changed DFSClient API isHDFSEncryptionEnabled, impacted hacky hive code

2017-04-20 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-14333: -- Summary: HADOOP-14104 changed DFSClient API isHDFSEncryptionEnabled, impacted hacky hive code Key: HADOOP-14333 URL: https://issues.apache.org/jira/browse/HADOOP-14333

[jira] [Created] (HADOOP-14322) Incorrect host info may be reported in failover message

2017-04-18 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-14322: -- Summary: Incorrect host info may be reported in failover message Key: HADOOP-14322 URL: https://issues.apache.org/jira/browse/HADOOP-14322 Project: Hadoop Common

[jira] [Resolved] (HADOOP-14198) Should have a way to let PingInputStream to abort

2017-03-31 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HADOOP-14198. Resolution: Duplicate > Should have a way to let PingInputStream to ab

[jira] [Created] (HADOOP-14262) rpcTimeOut is not set up correctly in Client thus client doesn't time out

2017-03-31 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-14262: -- Summary: rpcTimeOut is not set up correctly in Client thus client doesn't time out Key: HADOOP-14262 URL: https://issues.apache.org/jira/browse/HADOOP-

[jira] [Created] (HADOOP-14198) Should have a way to let PingInputStream to abort

2017-03-18 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-14198: -- Summary: Should have a way to let PingInputStream to abort Key: HADOOP-14198 URL: https://issues.apache.org/jira/browse/HADOOP-14198 Project: Hadoop Common

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-24 Thread Yongjun Zhang
Thanks Andrew much for the work here! +1 (binding). - Downloaded both binary and src tarballs - Verified md5 checksum and signature for both - Built from source tarball - Deployed 2 pseudo clusters, one with the released tarball and the other with what I built from source, and did the following

[jira] [Created] (HADOOP-13720) Add more info to "token ... is expired" message

2016-10-13 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-13720: -- Summary: Add more info to "token ... is expired" message Key: HADOOP-13720 URL: https://issues.apache.org/jira/browse/HADOOP-13720 Project: Had

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

2016-10-07 Thread Yongjun Zhang
Hi Sangjin, Thanks a lot for your work here. My +1 (binding). - Downloaded both binary and src tarballs - Verified md5 checksum and signature for both - Build from source tarball - Deployed 2 pseudo clusters, one with the released tarball and the other with what I built from source, and did the

[jira] [Created] (HADOOP-13339) MetricsSourceAdapter#updateAttrCache may throw NPE due to NULL lastRecs

2016-07-04 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-13339: -- Summary: MetricsSourceAdapter#updateAttrCache may throw NPE due to NULL lastRecs Key: HADOOP-13339 URL: https://issues.apache.org/jira/browse/HADOOP-13339

Re: CHANGES.txt is gone from trunk, branch-2, branch-2.8

2016-03-03 Thread Yongjun Zhang
That's nice, thanks Andrew and Allen. --Yongjun On Thu, Mar 3, 2016 at 9:11 PM, Andrew Wang wrote: > Hi all, > > With the inclusion of HADOOP-12651 going back to branch-2.8, CHANGES.txt > and release notes are now generated by Yetus. I've gone ahead and deleted > the manually updated CHANGES.tx

Re: Looking to a Hadoop 3 release

2016-02-19 Thread Yongjun Zhang
Thanks Andrew for initiating the effort! +1 on pushing 3.x with extended alpha cycle, and continuing the more stable 2.x releases. --Yongjun On Thu, Feb 18, 2016 at 5:58 PM, Andrew Wang wrote: > Hi Kai, > > Sure, I'm open to it. It's a new major release, so we're allowed to make > these kinds

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

2016-02-10 Thread Yongjun Zhang
Thanks Junping and Allen. It'd be nice to have HDFS-9629 but I'm ok with option 2, given the fact that the issue is not critical (and will be addressed in all future releases), and the concern Allen raised. Best, --Yongjun On Wed, Feb 10, 2016 at 8:37 AM, Allen Wittenauer wrote: > > > On Feb

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

2016-02-07 Thread Yongjun Zhang
Thanks Junping again for working on this release. +1 (binding), - Downloaded source tarball and binary tarball - Verified signature and checksum for both source and binary tarballs - Compiled and built a single node cluster - Run HDFS shell commands to create files - Run distcp job between this n

Propose adding one extra step to the release process when creating RC

2016-02-04 Thread Yongjun Zhang
HI, Would like to bring this to your attention: Per the discussion in HDFS-9629, we think it'd be helpful to add an extra step in the release process when creating RC. The purpose of this extra step is to update the release year in Web UI footer. I have created https://issues.apache.org/jira/bro

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

2016-02-03 Thread Yongjun Zhang
Hi Junping, Thanks a lot for leading the effort on 2.6.4. We were discussing in HDFS-9629, and have agreement on adding an additional step in the release process to update the year in the webui footer. See https://issues.apache.org/jira/browse/HDFS-9629?focusedCommentId=15130043&page=com.atlassi

Re: [UPDATE] New ASF git policy on force-pushes / Tags / Stale branches

2016-01-14 Thread Yongjun Zhang
good enough for handling them IMO. > > Thanks > +Vinod > > > On Jan 14, 2016, at 8:07 PM, Yongjun Zhang wrote: > > > > I assume we will have at least a committer review of any force-push. Say, > > if the commit history already has x, y, z, now we need to force pu

Re: [UPDATE] New ASF git policy on force-pushes / Tags / Stale branches

2016-01-14 Thread Yongjun Zhang
Thanks Vinod and Akira.. I assume we will have at least a committer review of any force-push. Say, if the commit history already has x, y, z, now we need to force push with x', we'd better not torget y and z, and if there is conflict putting in y and z after x', the conflict is better reviewed. M

[jira] [Created] (HADOOP-12604) Exception may be swallowed in KMSClientProvider

2015-11-26 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-12604: -- Summary: Exception may be swallowed in KMSClientProvider Key: HADOOP-12604 URL: https://issues.apache.org/jira/browse/HADOOP-12604 Project: Hadoop Common

[jira] [Created] (HADOOP-12517) Findbugs reported 0 issues, but summary

2015-10-27 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-12517: -- Summary: Findbugs reported 0 issues, but summary Key: HADOOP-12517 URL: https://issues.apache.org/jira/browse/HADOOP-12517 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-12103) Small refactoring of DelegationTokenAuthenticationFilter to allow code sharing

2015-06-18 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-12103: -- Summary: Small refactoring of DelegationTokenAuthenticationFilter to allow code sharing Key: HADOOP-12103 URL: https://issues.apache.org/jira/browse/HADOOP-12103

Re: set up jenkins test for branch-2

2015-06-15 Thread Yongjun Zhang
us help on quality. Thanks. --Yongjun On Mon, Jun 15, 2015 at 7:21 AM, Allen Wittenauer wrote: > > On Jun 14, 2015, at 1:00 PM, Yongjun Zhang wrote: > > > From time to time we saw changes that work fine in trunk but not > branch-2, > > and we don't catch the issue in

set up jenkins test for branch-2

2015-06-14 Thread Yongjun Zhang
Hi, We touched this topic before but it was put on hold. I'd like to bring it to our attention again. >From time to time we saw changes that work fine in trunk but not branch-2, and we don't catch the issue in a timely manner. The difference between trunk and branch-2 is sufficient to justify per

Re: REMINDER! REGISTRATIONS CLOSING 5/6!

2015-05-08 Thread Yongjun Zhang
Thanks Allen a lot for organizing the Haoop Bug Bash, very happy to see many folks by face! Wish you all a nice weekend! --Yongjun On Tue, May 5, 2015 at 9:31 PM, Allen Wittenauer wrote: > > On May 5, 2015, at 8:10 PM, Allen Wittenauer wrote: > > > * We’ll be closing registrat

Re: Save the Date: Apache Hadoop Bug Bash / May 8th!

2015-03-20 Thread Yongjun Zhang
Great idea Allen, big +1! Thanks. --Yongjun On Thu, Mar 19, 2015 at 11:06 AM, Tsuyoshi Ozawa wrote: > Hi Allen, > > Thank you for the great suggestion. Let's do this! > > Thanks, > - Tsuyoshi > > On Fri, Mar 20, 2015 at 2:34 AM, Allen Wittenauer > wrote: > > > > Hi folks, > > > > Ther

Re: about CHANGES.txt

2015-03-17 Thread Yongjun Zhang
t;> smartishd) "no identification of what type of commit it was without > hooking > >> into JIRA anyway." This would be in the format of the commit message > >>> > >>> Either way I think would be an improvement. > >>> Thanks for your i

Re: about CHANGES.txt

2015-03-17 Thread Yongjun Zhang
CHANGES.txt from JIRA and/or git as part of making a > > release. Or just dropping it altogether. Keeping it under version > > control creates lot of false conflicts whenever submitting a patch and > > generally makes committing minor changes unpleasant. > > > > Colin &g

Re: about CHANGES.txt

2015-03-14 Thread Yongjun Zhang
low quality of our notes…) Anyway, here’s what I’ve been > building/using as changes.txt and release notes: > > https://github.com/aw-altiscale/hadoop-release-metadata > > I try to update these every day. :) > > On Mar 13, 2015, at 4:07 PM, Yongjun Zhang wrote: > > > T

Re: about CHANGES.txt

2015-03-13 Thread Yongjun Zhang
3:01 PM, Sean Busbey wrote: > > > So long as you include the issue number, you can automate pulling the > type > > from jira directly instead of putting it in the message. > > > > On Fri, Mar 13, 2015 at 4:49 PM, Yongjun Zhang > > wrote: > > > > >

Re: about CHANGES.txt

2015-03-13 Thread Yongjun Zhang
Thanks Sean, that'd be even better! --Yongjun On Fri, Mar 13, 2015 at 3:01 PM, Sean Busbey wrote: > So long as you include the issue number, you can automate pulling the type > from jira directly instead of putting it in the message. > > On Fri, Mar 13, 2015 at 4:49 PM, Yongj

about CHANGES.txt

2015-03-13 Thread Yongjun Zhang
Hi, I found that changing CHANGES.txt when committing a jira is error prone because of the different sections in the file, and sometimes we forget about changing this file. After all, git log would indicate the history of a branch. I wonder if we could switch to a new method: 1. When committing,

Re: Looking to a Hadoop 3 release

2015-03-05 Thread Yongjun Zhang
Thanks all. There is an open issue HDFS-6962 (ACLs inheritance conflicts with umaskmode), for which the incompatibility appears to make it not suitable for 2.x and it's targetted 3.0, please see: https://issues.apache.org/jira/browse/HDFS-6962?focusedCommentId=14335418&page=com.atlassian.jira.plu

Re: Looking to a Hadoop 3 release

2015-03-02 Thread Yongjun Zhang
Thanks Andrew for the proposal. +1, and I will be happy to help. --Yongjun On Mon, Mar 2, 2015 at 3:19 PM, Andrew Wang wrote: > Hi devs, > > It's been a year and a half since 2.x went GA, and I think we're about due > for a 3.x release. > Notably, there are two incompatible changes I'd like

Re: 2.7 status

2015-03-01 Thread Yongjun Zhang
Hi, Thanks for working on 2.7 release. Currently the fallback from KerberosAuthenticator to PseudoAuthenticator is enabled by default in a hardcoded way. HAOOP-10895 changes the default and requires applications (such as oozie) to set a config property or call an API to enable the fallback. Thi

[jira] [Created] (HADOOP-11597) Factor OSType out from Shell: change in common

2015-02-15 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-11597: -- Summary: Factor OSType out from Shell: change in common Key: HADOOP-11597 URL: https://issues.apache.org/jira/browse/HADOOP-11597 Project: Hadoop Common

[jira] [Created] (HADOOP-11598) Factor OSType out from Shell: changes in tools

2015-02-15 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-11598: -- Summary: Factor OSType out from Shell: changes in tools Key: HADOOP-11598 URL: https://issues.apache.org/jira/browse/HADOOP-11598 Project: Hadoop Common

[jira] [Created] (HADOOP-11551) Let nightly jenkins jobs run the tool of HADOOP-11045 and include the result in the job report

2015-02-05 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-11551: -- Summary: Let nightly jenkins jobs run the tool of HADOOP-11045 and include the result in the job report Key: HADOOP-11551 URL: https://issues.apache.org/jira/browse/HADOOP

Re: Erratic Jenkins behavior

2015-02-05 Thread Yongjun Zhang
Thanks Kihwal for bringing this up. Seems related to: https://issues.apache.org/jira/browse/HADOOP-11084 Hi Andrew/Arpit/Colin/Steve, you guys worked on this jira before, any insight about the issue Kihwal described? Thanks. --Yongjun On Thu, Feb 5, 2015 at 9:49 AM, Kihwal Lee wrote: > I a

[jira] [Created] (HADOOP-11549) flaky test detection tool failed to handle special control character

2015-02-04 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-11549: -- Summary: flaky test detection tool failed to handle special control character Key: HADOOP-11549 URL: https://issues.apache.org/jira/browse/HADOOP-11549 Project

[jira] [Resolved] (HADOOP-11453) Invalid mapping can be inserted to nfs's id-name map

2014-12-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HADOOP-11453. Resolution: Invalid > Invalid mapping can be inserted to nfs's id-

[jira] [Created] (HADOOP-11453) Invalid mapping can be inserted to nfs's id-name map

2014-12-29 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-11453: -- Summary: Invalid mapping can be inserted to nfs's id-name map Key: HADOOP-11453 URL: https://issues.apache.org/jira/browse/HADOOP-11453 Project: Hadoop C

supportability JIRAs

2014-12-17 Thread Yongjun Zhang
Hi, When creating jira, there is a "Labels" entry where we could label the jira as supportability. It would help to do this, so we could possibly give priority to fix them for better supportability, especially for those JIRAs that tend to be small but very high-impact for end users. The types of

Re: a friendly suggestion for developers when uploading patches

2014-12-16 Thread Yongjun Zhang
ick them in a dir > > specific > > > > to that JIRA; I can work out what the highest number is and increment > > it > > > by > > > > one for creating a new one...yet retain the whole patch history > > locally. > > > > > > > > I

[jira] [Resolved] (HADOOP-11408) TestRetryCacheWithHA.testUpdatePipeline failed in trunk

2014-12-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HADOOP-11408. Resolution: Duplicate > TestRetryCacheWithHA.testUpdatePipeline failed in tr

[jira] [Created] (HADOOP-11408) TestRetryCacheWithHA.testUpdatePipeline failed in trunk

2014-12-15 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-11408: -- Summary: TestRetryCacheWithHA.testUpdatePipeline failed in trunk Key: HADOOP-11408 URL: https://issues.apache.org/jira/browse/HADOOP-11408 Project: Hadoop Common

Re: a friendly suggestion for developers when uploading patches

2014-12-13 Thread Yongjun Zhang
On Thu, Dec 4, 2014 at 10:18 AM, Tsuyoshi OZAWA > wrote: > > > > Thanks Yongjun and Harsh for updating Wiki! > > > > Thanks, > > - Tsuyoshi > > > > On Thu, Dec 4, 2014 at 9:43 AM, Yongjun Zhang > wrote: > > > Thanks Harsh, I just made a

Re: submitting a hadoop patch doesn't trigger jenkins test run

2014-12-11 Thread Yongjun Zhang
Sorry my bad, I named Andrew Wang for Andrew Bayer in my last mail, both of them helped anyways:-) So thanks to all for the help on this matter! --Yongjun On Thu, Dec 11, 2014 at 3:38 PM, Yongjun Zhang wrote: > Many thanks to Ted Yu, Steve Loughran and Andrew Wang for replying in the >

Re: submitting a hadoop patch doesn't trigger jenkins test run

2014-12-11 Thread Yongjun Zhang
Many thanks to Ted Yu, Steve Loughran and Andrew Wang for replying in the jira and Steve/Andrew for making the related changes! --Yongjun On Thu, Dec 11, 2014 at 12:41 PM, Yongjun Zhang wrote: > Hi, > > I wonder if anyone can help on resolving HADOOP-11320 > <https://issues.

Re: submitting a hadoop patch doesn't trigger jenkins test run

2014-12-11 Thread Yongjun Zhang
Hi, I wonder if anyone can help on resolving HADOOP-11320 <https://issues.apache.org/jira/browse/HADOOP-11320> to increase timeout for jenkins test of crossing-subproject patches? Thanks a lot, --Yongjun On Tue, Dec 2, 2014 at 10:10 AM, Yongjun Zhang wrote: > Hi, > > Thank

Re: a friendly suggestion for developers when uploading patches

2014-12-04 Thread Yongjun Zhang
ble to edit after a relogin. > > On Wed, Dec 3, 2014 at 1:43 AM, Yongjun Zhang wrote: > > Thanks Allen, Andrew and Tsuyoshi. > > > > My wiki user name is YongjunZhang, I will appreciate it very much if > > someone can give me the permission to edit the wiki pages. Thanks

Re: a friendly suggestion for developers when uploading patches

2014-12-02 Thread Yongjun Zhang
> > > https://wiki.apache.org/hadoop/HowToContribute#Naming_your_patch > > > > On Dec 2, 2014, at 10:01 AM, Tsuyoshi OZAWA > > wrote: > > > > >> .[branchName.].patch* > > > > > > +1 for this format. Thanks for starting the discussion, Y

Re: submitting a hadoop patch doesn't trigger jenkins test run

2014-12-02 Thread Yongjun Zhang
lits is the way to do this... There are also > some patches that are completely mechanical and don't really require the > involvement of YARN / HDFS committer, even if they change that project. > For example, fixing a misspelling in the name of a hadoop-common API. > > Colin >

[jira] [Reopened] (HADOOP-11320) Submitting a hadoop patch doesn't trigger jenkins test run

2014-12-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reopened HADOOP-11320: > Submitting a hadoop patch doesn't trigger jenkins

Re: a friendly suggestion for developers when uploading patches

2014-12-02 Thread Yongjun Zhang
> > > +1.The "different color for newest patch" doesn't work very well if you > > > are color blind, so I do appreciate a revision number in the name. > > > > > > From: Yongjun Zhang > > > To: common-dev@hadoop.apache.org > > > Sent:

Re: a friendly suggestion for developers when uploading patches

2014-11-25 Thread Yongjun Zhang
m/umbrant/dotfiles/blob/master/bin/fetch-patch > > On Tue, Nov 25, 2014 at 5:44 PM, Harsh J wrote: > > > For the same filename, you can observe also that the JIRA colors the > > latest one to be different than the older ones automatically - this is > > what I rely on

Re: submitting a hadoop patch doesn't trigger jenkins test run

2014-11-25 Thread Yongjun Zhang
Thanks all for the feedback. To summarize (and I have a suggestion at the end of this email), there are two scenarios: 1. A change that span multiple *bigger* projects. r.g. hadoop, hbase. 2. A change that span multiple *sub* projects* within hadoop, e.g., common, hdfs, yarn For 1, it's

  1   2   >