Re: [jira] [Created] (HDFS-9220) ChecksumException after writing less than 512 bytes

2015-10-09 Thread Yongjun Zhang
Thanks Daniel, mind putting your comments in HDFS-9220? --Yongjun On Fri, Oct 9, 2015 at 10:11 AM, Daniel Templeton wrote: > I saw a similar issue, and it went away when I backed out HDFS-4660 and > HDFS-8722. Might be the same issue. > > On 10/9/15 6:02 AM, Bogdan Raducanu (JIRA) wrote: > >>

Re: [UPDATE] New ASF git policy on force-pushes / Tags / Stale branches

2016-01-14 Thread Yongjun Zhang
Thanks Vinod and Akira.. I assume we will have at least a committer review of any force-push. Say, if the commit history already has x, y, z, now we need to force push with x', we'd better not torget y and z, and if there is conflict putting in y and z after x', the conflict is better reviewed. M

Re: [UPDATE] New ASF git policy on force-pushes / Tags / Stale branches

2016-01-14 Thread Yongjun Zhang
good enough for handling them IMO. > > Thanks > +Vinod > > > On Jan 14, 2016, at 8:07 PM, Yongjun Zhang wrote: > > > > I assume we will have at least a committer review of any force-push. Say, > > if the commit history already has x, y, z, now we need to force pu

Re: If primary replica is unresponsive, hsync() hangs

2017-09-11 Thread Yongjun Zhang
Thanks for finding the issue Wei-Chiu. I agree hsync should be handling DN failure similarly as write-pipeline recovery, as you stated. If it's not doing that, it should be fixed. --Yongjun On Mon, Sep 11, 2017 at 10:53 AM, Wei-Chiu Chuang wrote: > Hello my dear HDFS dev colleagues, > > It app

Re: [ANNOUNCE] Apache Hadoop 3.0.0 GA is released

2017-12-20 Thread Yongjun Zhang
Congratulations Andrew and all, a great milestone! Thanks Andrew for driving it! --Yongjun On Tue, Dec 19, 2017 at 9:10 AM, Jonathan Kelly wrote: > Thanks, Andrew! > > On Mon, Dec 18, 2017 at 4:54 PM Andrew Wang > wrote: > > > Thanks for the spot, I just pushed a correct tag. I can't delete th

Apache Hadoop 3.0.3 Release plan

2018-05-06 Thread Yongjun Zhang
Hi All, > We have released Apache Hadoop 3.0.2 in April of this year [1]. Since then, there are quite some commits done to branch-3.0. To further improve the quality of release, we plan to do 3.0.3 release now. The focus of 3.0.3 will be fixing blockers (3), critical bugs (17) and bug fixes (~130)

Re: Apache Hadoop 3.0.3 Release plan

2018-05-07 Thread Yongjun Zhang
-Eric Payne > > > > > > On Monday, May 7, 2018, 12:09:00 AM CDT, Yongjun Zhang < > yjzhan...@apache.org> wrote: > > > > > > Hi All, > > > > We have released Apache Hadoop 3.0.2 in April of this year [1]. Since then, > there are quite some

Re: Apache Hadoop 3.0.3 Release plan

2018-05-08 Thread Yongjun Zhang
>> downstream projects can't pick it up (after the fact that HBase is one of >> the most important projects around Hadoop). >> >> On Mon, May 7, 2018 at 1:19 PM, Yongjun Zhang >> wrote: >> >> > Hi Eric, >> > >> > Thanks for the

Re: [ANNOUNCE] Apache Hadoop 2.9.1 Release

2018-05-19 Thread Yongjun Zhang
please > refer to CHANGES [2] and RELEASENOTES [3]. > - For download, please got to download page[4] > > Thank you all for contributing to the Apache Hadoop 2.9.1. > > > Last, thanks Yongjun Zhang, Junping Du, Andrew Wang and Chris Douglas for > your help and support. > &

Re: Apache Hadoop 3.0.3 Release plan

2018-05-23 Thread Yongjun Zhang
in 3.0.3 release. This is a fix that > will enable HBase to use Hadoop 3.0.x in the production line. > > thanks > Vrushali > > > On Tue, May 8, 2018 at 10:24 AM, Yongjun Zhang > wrote: > >> Thanks Wei-Chiu and Haibo for the feedback! >> >> Good thing is th

Re: Apache Hadoop 3.0.3 Release plan

2018-05-23 Thread Yongjun Zhang
> too early. > > Echoing Eric Payne, I think we should wait to cut the branch until we are > actually creating the RC to vote on (i.e. on May 29 or 30 if the vote is to > be on May 30). > > Eric > > > > On Wed, May 23, 2018 at 4:11 PM, Yongjun Zhang > wrote: >

Re: Apache Hadoop 3.0.3 Release plan

2018-05-26 Thread Yongjun Zhang
Hi All, I will be working on cutting the 3.0.3 branch and trying a build today. Thanks. --Yongjun On Wed, May 23, 2018 at 3:31 PM, Yongjun Zhang wrote: > Thanks Eric. Sounds good. I may try to see if I can do the branching/RC > sooner. > > --Yongjun > > > On Wed, Ma

Re: Apache Hadoop 3.0.3 Release plan

2018-05-26 Thread Yongjun Zhang
HI, I did build before cut branch and hit some issues, have not got to the bottom, will cut branch after the build issues are resolved. Thanks. --Yongjun On Sat, May 26, 2018 at 1:46 PM, Yongjun Zhang wrote: > Hi All, > > I will be working on cutting the 3.0.3 branch and trying a bu

Re: Apache Hadoop 3.0.3 Release plan

2018-05-30 Thread Yongjun Zhang
ndrew Wang, Eddy Xu who helped when I tried to solve the build issues. At this point, please be aware of the existence of branch-3.0, branch-3.0.3. Best, --Yongjun On Sat, May 26, 2018 at 11:52 PM, Yongjun Zhang wrote: > HI, > > I did build before cut branch and hit some issues, h

Re: Apache Hadoop 3.0.3 Release plan

2018-05-30 Thread Yongjun Zhang
Sorry, forgot to mention Junping Du, who also helped me a lot. Many thanks Junping! Thanks. --Yongjun On Wed, May 30, 2018 at 11:49 AM, Yongjun Zhang wrote: > Hi, > > The build issues are all solved, and I have cut the 3.0.3 branch and close > to get a build out. Since it'

Re: Apache Hadoop 3.0.3 Release plan

2018-05-31 Thread Yongjun Zhang
rther. Sorry for the inconvenience. --Yongjun On Wed, May 30, 2018 at 11:49 AM, Yongjun Zhang wrote: > Hi, > > The build issues are all solved, and I have cut the 3.0.3 branch and close > to get a build out. Since it's taking me a bit more time (I expect to send > vote invitation

[VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-05-31 Thread Yongjun Zhang
Greetings all, I've created the first release candidate (RC0) for Apache Hadoop 3.0.3. This is our next maintenance release to follow up 3.0.2. It includes about 249 important fixes and improvements, among which there are 8 blockers. See https://issues.apache.org/jira/issues/?filter=12343997 The

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-01 Thread Yongjun Zhang
ems to be private. I can't see the >> blocker list. >> https://issues.apache.org/jira/issues/?filter=12343997 >> >> Meanwhile , I will be working on testing the release. >> >> Thanks >> Shashi >> On 6/1/18, 11:18 AM, "Yongjun Zhang" wr

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-01 Thread Yongjun Zhang
>> https://issues.apache.org/jira/issues/?filter=12343997 > > Even after logging in, I am not able to see any jiras. > It says "The requested filter doesn't exist or is private." > > On Fri, Jun 1, 2018 at 10:41 AM, Yongjun Zhang > wrote: > >> Thank

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-01 Thread Yongjun Zhang
jobs work as expected > - Verified that user weights work as expected > - Verified that FairOrderingPolicy in a CS queue will evenly assign > resources > - Verified running yarn shell application runs as expected > > > > > > > > On Friday, June 1, 2018,

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-02 Thread Yongjun Zhang
t; - basic sanity check of NN, RM UI > > > > Thanks, > > Ajay > > > > On 6/2/18, 12:45 AM, "Shashikant Banerjee" < > sbaner...@hortonworks.com> > > wrote: > > > > Hi Yongjun, > >

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-02 Thread Yongjun Zhang
Hi Gabor, I got the git tag in, it's release-3.0.3-RC0. Would you please give it a try? It should correspond to commit 37fd7d752db73d984dc31e0cdfd590d252f5e075 Author: Yongjun Zhang Date: Wed May 30 00:07:33 2018 -0700 Update version to 3.0.3 to prepare for 3.0.3 release T

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-06 Thread Yongjun Zhang
bu Asanuma > wrote: > >> Sorry, I forgot to write my vote in the last message. >> >> +1 (non-binding) >> >> Regards, >> Takanobu >> >> > -Original Message- >> > From: Takanobu Asanuma [mailto:tasan...@yahoo-corp.jp] >> >

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-07 Thread Yongjun Zhang
Thank you all very much for the testing, feedback and discussion! I was able to build outside docker, by following the steps Nanda described, I saw the same problem; then I tried 3.0.2 released a while back, it has the same issue. As Allen pointed out, it seems the steps to build site are not cor

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-07 Thread Yongjun Zhang
BTW, thanks Allen and Steve for discussing and suggestion about the site build problem I hit earlier, I did the following step mvn install -DskipTests before doing the steps Nanda listed helped to solve the problems. --Yongjun On Thu, Jun 7, 2018 at 6:15 PM, Yongjun Zhang wrote: > Th

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-08 Thread Yongjun Zhang
Hello, PMC votes are needed for release, can I get some help from PMCs? Really appreciate it! --Yongjun On Thu, Jun 7, 2018 at 6:15 PM, Yongjun Zhang wrote: > Thank you all very much for the testing, feedback and discussion! > > I was able to build outside docker, by following

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-08 Thread Yongjun Zhang
istributed HDFS with KMS >>- Ran basic hdfs commands with encryption >>- Sanity checked webui and logs >> >> >> >> -Xiao >> >> On Fri, Jun 8, 2018 at 10:34 AM, Brahma Reddy Battula < >> brahmareddy.batt...@hotmail.com> wrote: >>

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-12 Thread Yongjun Zhang
Verified that various queue config properties for CS are refreshable > - Verified streaming jobs work as expected > - Verified that user weights work as expected > - Verified that FairOrderingPolicy in a CS queue will evenly assign > resources > - Verified running yarn shell applicatio

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-16 Thread Yongjun Zhang
can resume the build with the > command > [ERROR] mvn -rf :hadoop-shim > > Not seeing the artifact published here as well. > https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-project > > On Tue, Jun 12, 2018 at 6:44 PM, Yongjun Zhang > wrote: > >> Thank

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-07-09 Thread Yongjun Zhang
today and now 2.9.1 is pushed to the mvn repo. >> >> You can double check it. I suspect sometimes Nexus may fail to notify >> user when this is unexpected failures. >> >> >> >> >> >> Bests, >> >> Sammi >> >> *From:* Yongj

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-07-10 Thread Yongjun Zhang
--Yongjun On Mon, Jul 9, 2018 at 2:08 PM, Jonathan Eagles wrote: > Thank you, Yongjun Zhang for resolving this issue for me. I have verified > the 3.0.3 build is now working for me for tez to specify as a hadoop > dependency. > > As for release procedure, can someone comment o

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-09-09 Thread Yongjun Zhang
hadoop.apache.org/releases.html page. > > I just did it, FYI: https://svn.apache.org/viewvc?view=revision&revision= > 1837967 > > Thanks > +Vinod > > > On May 31, 2018, at 10:48 PM, Yongjun Zhang wrote: > > Greetings all, > > I've created the first re

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

2016-02-03 Thread Yongjun Zhang
Hi Junping, Thanks a lot for leading the effort on 2.6.4. We were discussing in HDFS-9629, and have agreement on adding an additional step in the release process to update the year in the webui footer. See https://issues.apache.org/jira/browse/HDFS-9629?focusedCommentId=15130043&page=com.atlassi

Propose adding one extra step to the release process when creating RC

2016-02-04 Thread Yongjun Zhang
HI, Would like to bring this to your attention: Per the discussion in HDFS-9629, we think it'd be helpful to add an extra step in the release process when creating RC. The purpose of this extra step is to update the release year in Web UI footer. I have created https://issues.apache.org/jira/bro

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

2016-02-07 Thread Yongjun Zhang
Thanks Junping again for working on this release. +1 (binding), - Downloaded source tarball and binary tarball - Verified signature and checksum for both source and binary tarballs - Compiled and built a single node cluster - Run HDFS shell commands to create files - Run distcp job between this n

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

2016-02-10 Thread Yongjun Zhang
Thanks Junping and Allen. It'd be nice to have HDFS-9629 but I'm ok with option 2, given the fact that the issue is not critical (and will be addressed in all future releases), and the concern Allen raised. Best, --Yongjun On Wed, Feb 10, 2016 at 8:37 AM, Allen Wittenauer wrote: > > > On Feb

Re: Looking to a Hadoop 3 release

2016-02-19 Thread Yongjun Zhang
Thanks Andrew for initiating the effort! +1 on pushing 3.x with extended alpha cycle, and continuing the more stable 2.x releases. --Yongjun On Thu, Feb 18, 2016 at 5:58 PM, Andrew Wang wrote: > Hi Kai, > > Sure, I'm open to it. It's a new major release, so we're allowed to make > these kinds

Re: CHANGES.txt is gone from trunk, branch-2, branch-2.8

2016-03-03 Thread Yongjun Zhang
That's nice, thanks Andrew and Allen. --Yongjun On Thu, Mar 3, 2016 at 9:11 PM, Andrew Wang wrote: > Hi all, > > With the inclusion of HADOOP-12651 going back to branch-2.8, CHANGES.txt > and release notes are now generated by Yetus. I've gone ahead and deleted > the manually updated CHANGES.tx

Re: Save the Date: Apache Hadoop Bug Bash / May 8th!

2015-03-20 Thread Yongjun Zhang
Great idea Allen, big +1! Thanks. --Yongjun On Thu, Mar 19, 2015 at 11:06 AM, Tsuyoshi Ozawa wrote: > Hi Allen, > > Thank you for the great suggestion. Let's do this! > > Thanks, > - Tsuyoshi > > On Fri, Mar 20, 2015 at 2:34 AM, Allen Wittenauer > wrote: > > > > Hi folks, > > > > Ther

fsck output compatibility question with regard to HDFS-7281

2015-04-23 Thread Yongjun Zhang
Hi, For HDFS-7281, we are making a change in fsck report: Before the change: CORRUPT FILES:29 MISSING BLOCKS: 29 MISSING SIZE: 576920501 B CORRUPT BLOCKS: 29 ... Default replication factor:3 Average block replication: 2.7412367 Corrupt blocks:

Re: fsck output compatibility question with regard to HDFS-7281

2015-04-24 Thread Yongjun Zhang
es. > > --Chris Nauroth > > > > > On 4/24/15, 1:02 AM, "Allen Wittenauer" wrote: > > > > >On Apr 24, 2015, at 5:53 AM, Yongjun Zhang wrote: > > > >> > >> Basically we are adding two additional lines to the report (as > >>

Re: fsck output compatibility question with regard to HDFS-7281

2015-04-24 Thread Yongjun Zhang
ing > existing fields/beans is incompatible. > > --Chris Nauroth > > > > > On 4/24/15, 11:19 AM, "Yongjun Zhang" wrote: > > >Thanks Allen and Chris! > > > >What about adding new entries to jmx report? Somehow I had the impression > >that if

Re: REMINDER! REGISTRATIONS CLOSING 5/6!

2015-05-08 Thread Yongjun Zhang
Thanks Allen a lot for organizing the Haoop Bug Bash, very happy to see many folks by face! Wish you all a nice weekend! --Yongjun On Tue, May 5, 2015 at 9:31 PM, Allen Wittenauer wrote: > > On May 5, 2015, at 8:10 PM, Allen Wittenauer wrote: > > > * We’ll be closing registrat

set up jenkins test for branch-2

2015-06-14 Thread Yongjun Zhang
Hi, We touched this topic before but it was put on hold. I'd like to bring it to our attention again. >From time to time we saw changes that work fine in trunk but not branch-2, and we don't catch the issue in a timely manner. The difference between trunk and branch-2 is sufficient to justify per

Re: set up jenkins test for branch-2

2015-06-15 Thread Yongjun Zhang
us help on quality. Thanks. --Yongjun On Mon, Jun 15, 2015 at 7:21 AM, Allen Wittenauer wrote: > > On Jun 14, 2015, at 1:00 PM, Yongjun Zhang wrote: > > > From time to time we saw changes that work fine in trunk but not > branch-2, > > and we don't catch the issue in

Re: Issue in handling checksum errors in write pipeline

2016-07-30 Thread Yongjun Zhang
Hi Brahma, Thanks for reporting the issue. If your problem is really a network issue, then your proposed solution sounds reasonable to me, and it's different than what HDFS-6937 intends to solve. I think we can create a new jira for your issue. Here is why: HDFS-6937's scenario is that we keep r

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

2016-10-07 Thread Yongjun Zhang
Hi Sangjin, Thanks a lot for your work here. My +1 (binding). - Downloaded both binary and src tarballs - Verified md5 checksum and signature for both - Build from source tarball - Deployed 2 pseudo clusters, one with the released tarball and the other with what I built from source, and did the

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-24 Thread Yongjun Zhang
Thanks Andrew much for the work here! +1 (binding). - Downloaded both binary and src tarballs - Verified md5 checksum and signature for both - Built from source tarball - Deployed 2 pseudo clusters, one with the released tarball and the other with what I built from source, and did the following

Jenkins test failure

2017-05-17 Thread Yongjun Zhang
Hi, I saw quite a few jenkins test failure for patches uploaded to jira, For example, https://builds.apache.org/job/PreCommit-HADOOP-Build/12347/console apache-yetus-2971eff/yetus-project/pom.xml Modes: Sentinel MultiJDK Jenkins Robot Docker ResetRepo UnitTests Processing: HADOOP-14407 HA

Re: Jenkins test failure

2017-05-17 Thread Yongjun Zhang
Regards, > Akira > > On 2017/05/17 18:38, Yongjun Zhang wrote: > >> Hi, >> >> I saw quite a few jenkins test failure for patches uploaded to jira, >> >> For example, >> https://builds.apache.org/job/PreCommit-HADOOP-Build/12347/console >> >&g

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

2014-08-10 Thread Yongjun Zhang
+1 (non-binding), pending the document issue Akira found out + downloaded src tarball and did build + deployed two pseudo-distributed clusters + ran some sample mapreduce job on one cluster + ran basic distcp test between the two clusters Thanks. --Yongjun On Sun, Aug 10, 2014 at 9:35 PM, Akira

Re: Thinking ahead to hadoop-2.6

2014-10-19 Thread Yongjun Zhang
Thanks Arun for the info and reminder. Hi Alejandro, HADOOP-10895 is a blocker in the list Arun sent out and it's currently owned by you. I wonder whether you will have time to work on. If not, would you mind reassigning it to me and I will spend time on it? Thanks. --Yongjun On Tue, Oct 14,

Re: Thinking ahead to hadoop-2.6

2014-10-23 Thread Yongjun Zhang
Hi, I posted a patch to hadoop-10895 couple of days back. Wonder if anyone could help doing a review? Thanks a lot. --Yongjun On Sun, Oct 19, 2014 at 11:35 AM, Yongjun Zhang wrote: > Thanks Arun for the info and reminder. > > Hi Alejandro, > > HADOOP-10895 is a blocker in the

Re: Thinking ahead to hadoop-2.6

2014-10-24 Thread Yongjun Zhang
Thanks Steve, hope I can get help from other folks. --Yongjun On Fri, Oct 24, 2014 at 2:28 AM, Steve Loughran wrote: > On 24 October 2014 06:44, Yongjun Zhang wrote: > > > hadoop-10895 > > > having been working w/ kerberos recently I know I'm not in a position to

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Yongjun Zhang
Thanks Arun for leading the 2.6 release effort. +1 (non-binding) - Downloaded rc1 source and did build - Created two single-node clusters running 2.6 - Ran sample mapreduce job - Ran distcp between two clusters --Yongjun On Thu, Nov 13, 2014 at 3:08 PM, Arun C Murthy wrote: > Folks, > > I've

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Yongjun Zhang
Hi Suresh, I did review HDFS-6833 and the patch Shinichi provided a while back. It's not really directly related to replication factor. The problem reported there is, DirectoryScanner tries to register with NN blocks already scheduled to be deleted as regular blocks, due to the delay in block remo

Re: Controlling the block placement and the file placement in HDFS writes

2014-12-19 Thread Yongjun Zhang
Hi, FYI, A relevant jira HDFS-6133 tries to tell Balancer not to move around the blocks stored at the favored nodes that application selected. I reviewed the patch, and the latest on looks good to me. Hope some committers can pick it up and push it forward. Thanks. --Yongjun On Fri, Dec 19, 2

Re: Erratic Jenkins behavior

2015-02-05 Thread Yongjun Zhang
Thanks Kihwal for bringing this up. Seems related to: https://issues.apache.org/jira/browse/HADOOP-11084 Hi Andrew/Arpit/Colin/Steve, you guys worked on this jira before, any insight about the issue Kihwal described? Thanks. --Yongjun On Thu, Feb 5, 2015 at 9:49 AM, Kihwal Lee wrote: > I a

Re: 2.7 status

2015-03-01 Thread Yongjun Zhang
Hi, Thanks for working on 2.7 release. Currently the fallback from KerberosAuthenticator to PseudoAuthenticator is enabled by default in a hardcoded way. HAOOP-10895 changes the default and requires applications (such as oozie) to set a config property or call an API to enable the fallback. Thi

Re: Looking to a Hadoop 3 release

2015-03-02 Thread Yongjun Zhang
Thanks Andrew for the proposal. +1, and I will be happy to help. --Yongjun On Mon, Mar 2, 2015 at 3:19 PM, Andrew Wang wrote: > Hi devs, > > It's been a year and a half since 2.x went GA, and I think we're about due > for a 3.x release. > Notably, there are two incompatible changes I'd like

Re: Looking to a Hadoop 3 release

2015-03-05 Thread Yongjun Zhang
Thanks all. There is an open issue HDFS-6962 (ACLs inheritance conflicts with umaskmode), for which the incompatibility appears to make it not suitable for 2.x and it's targetted 3.0, please see: https://issues.apache.org/jira/browse/HDFS-6962?focusedCommentId=14335418&page=com.atlassian.jira.plu

Re: [VOTE] Merge HDFS-12943 branch to trunk - Consistent Reads from Standby

2018-12-05 Thread Yongjun Zhang
Great work guys. Wonder if we can elaborate what's impact of not having #2 fixed, and why #2 is not needed for the feature to complete? 2. Need to fix automatic failover with ZKFC. Currently it does not doesn't know about ObserverNodes trying to convert them to SBNs. Thanks. --Yongjun On Wed, D

Re: [VOTE] Merge HDFS-12943 branch to trunk - Consistent Reads from Standby

2018-12-12 Thread Yongjun Zhang
insert calls back into the call queue. That's > > completely unacceptable. A buggy or malicious client can easily cause > > livelock in the IPC layer with handlers only looping on calls that never > > satisfy the condition. Why is this not implemented via > RetriableExcepti

[jira] [Created] (HDFS-9351) No checkNNStartup() is called when fsck calls FSNamesystem.getSnapshottableDirs()

2015-10-30 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9351: --- Summary: No checkNNStartup() is called when fsck calls FSNamesystem.getSnapshottableDirs() Key: HDFS-9351 URL: https://issues.apache.org/jira/browse/HDFS-9351 Project

[jira] [Created] (HDFS-9404) Findbugs issue reported in BlockRecoveryWorker$RecoveryTaskContiguous.recover()

2015-11-09 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9404: --- Summary: Findbugs issue reported in BlockRecoveryWorker$RecoveryTaskContiguous.recover() Key: HDFS-9404 URL: https://issues.apache.org/jira/browse/HDFS-9404 Project

[jira] [Resolved] (HDFS-8906) Non Authenticated Data node Allowed to Join HDFS

2015-11-18 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HDFS-8906. - Resolution: Won't Fix Hi [~JJHoward], Thanks for reporting the issue, I'm closing it

[jira] [Created] (HDFS-9474) TestPipelinesFailover would fail if ifconfig is not available

2015-11-27 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9474: --- Summary: TestPipelinesFailover would fail if ifconfig is not available Key: HDFS-9474 URL: https://issues.apache.org/jira/browse/HDFS-9474 Project: Hadoop HDFS

[jira] [Created] (HDFS-9519) Some coding improvement in SecondaryNameNode#main

2015-12-07 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9519: --- Summary: Some coding improvement in SecondaryNameNode#main Key: HDFS-9519 URL: https://issues.apache.org/jira/browse/HDFS-9519 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-9532) Detailed exception info is lost in reportTo method of ErrorReportAction and ReportBadBlockAction

2015-12-09 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9532: --- Summary: Detailed exception info is lost in reportTo method of ErrorReportAction and ReportBadBlockAction Key: HDFS-9532 URL: https://issues.apache.org/jira/browse/HDFS-9532

[jira] [Created] (HDFS-9540) Handle SafeModeException in ReportBadBlockAction#reportTo

2015-12-10 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9540: --- Summary: Handle SafeModeException in ReportBadBlockAction#reportTo Key: HDFS-9540 URL: https://issues.apache.org/jira/browse/HDFS-9540 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-9540) Handle SafeModeException in ReportBadBlockAction#reportTo

2015-12-11 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HDFS-9540. - Resolution: Not A Problem > Handle SafeModeException in ReportBadBlockAction#repor

[jira] [Created] (HDFS-9569) Change msg issused before loading fsimage to Info from debug for better supportability

2015-12-16 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9569: --- Summary: Change msg issused before loading fsimage to Info from debug for better supportability Key: HDFS-9569 URL: https://issues.apache.org/jira/browse/HDFS-9569

[jira] [Created] (HDFS-9652) TestStartup.testImageChecksum is broken by HDFS-9569

2016-01-14 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9652: --- Summary: TestStartup.testImageChecksum is broken by HDFS-9569 Key: HDFS-9652 URL: https://issues.apache.org/jira/browse/HDFS-9652 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-9660) TestBlockScanner.testScanRateLimit fails intermittently

2016-01-18 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9660: --- Summary: TestBlockScanner.testScanRateLimit fails intermittently Key: HDFS-9660 URL: https://issues.apache.org/jira/browse/HDFS-9660 Project: Hadoop HDFS

[jira] [Created] (HDFS-9664) TestRollingUpgrade.testRollback failed frequently

2016-01-19 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9664: --- Summary: TestRollingUpgrade.testRollback failed frequently Key: HDFS-9664 URL: https://issues.apache.org/jira/browse/HDFS-9664 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-5685) DistCp will fail to copy with -delete switch

2013-12-18 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-5685: --- Summary: DistCp will fail to copy with -delete switch Key: HDFS-5685 URL: https://issues.apache.org/jira/browse/HDFS-5685 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-5749) Access time of HDFS directories stays at 1969-12-31

2014-01-09 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-5749: --- Summary: Access time of HDFS directories stays at 1969-12-31 Key: HDFS-5749 URL: https://issues.apache.org/jira/browse/HDFS-5749 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-5767) Nfs implementation assumes userName userId mapping to be unique, which is not true sometimes

2014-01-14 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-5767: --- Summary: Nfs implementation assumes userName userId mapping to be unique, which is not true sometimes Key: HDFS-5767 URL: https://issues.apache.org/jira/browse/HDFS-5767

[jira] [Resolved] (HDFS-5749) Access time of HDFS directories stays at 1969-12-31

2014-01-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HDFS-5749. - Resolution: Not A Problem > Access time of HDFS directories stays at 1969-12

[jira] [Created] (HDFS-5830) WebHdfsFileSystem.getFileBlockLocations throws IllegalArgumentException when accessing another cluster.

2014-01-24 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-5830: --- Summary: WebHdfsFileSystem.getFileBlockLocations throws IllegalArgumentException when accessing another cluster. Key: HDFS-5830 URL: https://issues.apache.org/jira/browse/HDFS

[jira] [Created] (HDFS-12404) Name of config introduced by HDFS-12357 need to be changed from authorization.provider to attribute.provider

2017-09-07 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-12404: Summary: Name of config introduced by HDFS-12357 need to be changed from authorization.provider to attribute.provider Key: HDFS-12404 URL: https://issues.apache.org/jira/browse

[jira] [Resolved] (HDFS-12294) Let distcp to bypass external attribute provider when calling getFileStatus etc at source cluster

2017-09-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HDFS-12294. -- Resolution: Won't Fix > Let distcp to bypass external attribute provider when

[jira] [Resolved] (HDFS-12296) Add a field to FsServerDefaults to tell if external attribute provider is enabled

2017-09-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HDFS-12296. -- Resolution: Won't Fix > Add a field to FsServerDefaults to tell if external attribute

[jira] [Created] (HDFS-12866) Recursive delete of a large directory or snapshot makes namenode unresponsive

2017-11-28 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-12866: Summary: Recursive delete of a large directory or snapshot makes namenode unresponsive Key: HDFS-12866 URL: https://issues.apache.org/jira/browse/HDFS-12866 Project

[jira] [Created] (HDFS-13100) Handle IllegalArgumentException in when GETSERVERDEFAULTS is not implemented in webhdfs.

2018-02-01 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-13100: Summary: Handle IllegalArgumentException in when GETSERVERDEFAULTS is not implemented in webhdfs. Key: HDFS-13100 URL: https://issues.apache.org/jira/browse/HDFS-13100

[jira] [Created] (HDFS-13101) Yet another fsimage corruption related to snapshot

2018-02-01 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-13101: Summary: Yet another fsimage corruption related to snapshot Key: HDFS-13101 URL: https://issues.apache.org/jira/browse/HDFS-13101 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-13115) Handle inode of a given inodeId already deleted

2018-02-06 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-13115: Summary: Handle inode of a given inodeId already deleted Key: HDFS-13115 URL: https://issues.apache.org/jira/browse/HDFS-13115 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-13315) Add a test for the issue reported in HDFS-11481 which is fixed by HDFS-10997.

2018-03-19 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-13315: Summary: Add a test for the issue reported in HDFS-11481 which is fixed by HDFS-10997. Key: HDFS-13315 URL: https://issues.apache.org/jira/browse/HDFS-13315 Project

[jira] [Created] (HDFS-13663) Should throw exception when incorrect block size is set

2018-06-07 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-13663: Summary: Should throw exception when incorrect block size is set Key: HDFS-13663 URL: https://issues.apache.org/jira/browse/HDFS-13663 Project: Hadoop HDFS

[jira] [Created] (HDFS-9670) DistCp throws NPE when source is root "/"

2016-01-20 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9670: --- Summary: DistCp throws NPE when source is root "/" Key: HDFS-9670 URL: https://issues.apache.org/jira/browse/HDFS-9670 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-9697) NN fails to restart due to corrupt fsimage

2016-01-25 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9697: --- Summary: NN fails to restart due to corrupt fsimage Key: HDFS-9697 URL: https://issues.apache.org/jira/browse/HDFS-9697 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-9697) NN fails to restart due to corrupt fsimage caused by snapshot handling

2016-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HDFS-9697. - Resolution: Duplicate > NN fails to restart due to corrupt fsimage caused by snapshot handl

[jira] [Resolved] (HDFS-9696) Garbage snapshot records lingering forever

2016-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HDFS-9696. - Resolution: Duplicate Hi [~kihwal], Thanks a lot for reporting the issue here. Upon investigation

[jira] [Created] (HDFS-9751) Add a step in the release process to update the release year in Web UI footer

2016-02-03 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9751: --- Summary: Add a step in the release process to update the release year in Web UI footer Key: HDFS-9751 URL: https://issues.apache.org/jira/browse/HDFS-9751 Project

[jira] [Created] (HDFS-9764) DistCp doesn't print arg value for -numListstatusThreads

2016-02-04 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9764: --- Summary: DistCp doesn't print arg value for -numListstatusThreads Key: HDFS-9764 URL: https://issues.apache.org/jira/browse/HDFS-9764 Project: Hadoop

[jira] [Created] (HDFS-9820) Improve distcp to support efficient restore

2016-02-17 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9820: --- Summary: Improve distcp to support efficient restore Key: HDFS-9820 URL: https://issues.apache.org/jira/browse/HDFS-9820 Project: Hadoop HDFS Issue Type: New

[jira] [Created] (HDFS-9889) Update balancer/mover document about HDFS-6133 feature

2016-03-02 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9889: --- Summary: Update balancer/mover document about HDFS-6133 feature Key: HDFS-9889 URL: https://issues.apache.org/jira/browse/HDFS-9889 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-9939) Possible performance improvement by increasing buf size in DecompressorStream in HDFS

2016-03-10 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9939: --- Summary: Possible performance improvement by increasing buf size in DecompressorStream in HDFS Key: HDFS-9939 URL: https://issues.apache.org/jira/browse/HDFS-9939

[jira] [Created] (HDFS-10211) Add more info to DelegationTokenIdentifier#toString for better supportability

2016-03-24 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-10211: Summary: Add more info to DelegationTokenIdentifier#toString for better supportability Key: HDFS-10211 URL: https://issues.apache.org/jira/browse/HDFS-10211 Project

[jira] [Resolved] (HDFS-10211) Add more info to DelegationTokenIdentifier#toString for better supportability

2016-03-24 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HDFS-10211. -- Resolution: Duplicate > Add more info to DelegationTokenIdentifier#toString for bet

  1   2   3   >