Re: [Announcement] DiDi HDFS successfully upgraded from 2.7.2 to 3.2.0

2019-12-09 Thread Weiwei Yang
Awesome! You guys rock!! Any plan to upgrade YARN to latest version too? -- Weiwei On Dec 9, 2019, 5:20 PM -0800, Hui Fei , wrote: > Hi Eric, > > It's Rolling Upgrade without downtime. We have a cluster with thousands of > nodes and 5 namespace, it takes 1 month to do the upgrade. Upgrading > Serv

Re: [DISCUSS] making Ozone a separate Apache project

2020-05-13 Thread Weiwei Yang
+1 Thanks, Marton for starting the discussion. One question, for the committers who contributed to Ozone before and got the committer-role in the past (like me), will they carry the committer-role to the new repo? On Wed, May 13, 2020 at 9:07 AM Dinesh Chitlangia wrote: > +1 > Thank you Marton f

Re: [ANNOUNCE] New Apache Hadoop Committer - He Xiaoqiao

2020-06-11 Thread Weiwei Yang
Congratulations Xiaoqiao! On Thu, Jun 11, 2020 at 11:20 AM Sree Vaddi wrote: > Congratulations, He Xiaoqiao. > > Thank you./Sree > > > > On Thursday, June 11, 2020, 9:54:32 AM PDT, Chao Sun < > sunc...@apache.org> wrote: > > Congrats Xiaoqiao! > > On Thu, Jun 11, 2020 at 9:36 AM Ayush Saxen

Re: [VOTE] Moving Ozone to a separated Apache project

2020-09-25 Thread Weiwei Yang
+1 Weiwei On Friday, September 25, 2020, Dinesh Chitlangia wrote: > +1 > > Thanks, > Dinesh > > On Fri, Sep 25, 2020 at 2:00 AM Elek, Marton wrote: > > > Hi all, > > > > Thank you for all the feedback and requests, > > > > As we discussed in the previous thread(s) [1], Ozone is proposed to be

Improvement on DN HB lock

2017-11-02 Thread Weiwei Yang
Hi everyone Here is a JIRA discussing about improving DN HB lock https://issues.apache.org/jira/browse/HDFS-7060 , it seems folks who participated the discussion both agreed on reducing the use of dataset log but the ticket goes to stale for a while. Recently we hit the issue in a 450 nodes cl

Re: Apache Hadoop 2.8.3 Release Plan

2017-11-21 Thread Weiwei Yang
Agree with Konstantin. This two issues has been opened for a while but could not reach a consensus on the fix, hope this gets enough attention from the community and get them resolved. Thanks -- Weiwei On 22 Nov 2017, 11:18 AM +0800, Konstantin Shvachko , wrote: I would consider these two blo

Re: [DISCUSS] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-11-29 Thread Weiwei Yang
Hi Sunil +1 from my side. Actually we have applied some of these patches to our production cluster since Sep this year, on over 2000+ nodes and it works nicely. +1 for the merge. I am pretty sure this feature will help a lot of users, especially those on cloud. Thanks for getting this done, gre

Re: [VOTE] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-12-04 Thread Weiwei Yang
+1 (non-binding) Thanks for getting this done Sunil. -- Weiwei On 5 Dec 2017, 4:06 AM +0800, Eric Payne , wrote: +1. Thanks Sunil for the work on this branch. Eric From: Sunil G ; Hdfs-dev ; Hadoop Common ; "mapreduce-...@hadoop.apache.org" http://mail-archives.apache.org/mod_mbox/hadoop-yarn

Re: [ANNOUNCE] Apache Hadoop 3.0.0 GA is released

2017-12-14 Thread Weiwei Yang
Hi Andrew Congratulations on the 3.0 GA, another mile stone of Hadoop history. Thanks for driving this release, excellent work! Took a look at the release notes, also seems nice. But one question, who is maintaining https://wiki.apache.org/hadoop/PoweredBy? Some of info is quite out of date, wo

Re: [DISCUSS] Merge YARN-6592 to trunk

2018-01-25 Thread Weiwei Yang
+1, thanks for getting to this milestone Arun. I’ve done some basic validations on a 4 nodes cluster, with some general affinity/anti-affinty/cardinality constraints, it worked. I’ve also reviewed the doc, it’s in good shape and very illustrative. Thanks. -- Weiwei On 26 Jan 2018, 10:44 AM +08

Re: [VOTE] Merge YARN-6592 feature branch to trunk

2018-01-26 Thread Weiwei Yang
+1 We are also looking forward to this : ) -- Weiwei On 27 Jan 2018, 9:16 AM +0800, Wangda Tan , wrote: +1 On Sat, Jan 27, 2018 at 2:05 AM, Chris Douglas mailto:cdoug...@apache.org>> wrote: +1 Looking forward to this. -C On Fri, Jan 26, 2018 at 7:28 AM, Arun Suresh mailto:asur...@apache.org>>

Re: [NOTICE] branch-3.1 created. 3.1.0 code freeze started.

2018-02-10 Thread Weiwei Yang
Hi Wangda I am a bit confused about the branches, I am expecting something like following  branch-3.1.0: 3.1.0  branch-3.1: 3.1.x  trunk: 3.2.x Code freezes in branch-3.1.0 which only allows blocks. However, did you mean you created branch-3.1 for 3.1.0? In this case, what branch should be used

Re: [VOTE] Adopt HDSL as a new Hadoop subproject

2018-03-20 Thread Weiwei Yang
+1 (non-binding) I really like this proposal and thanks for all the discussions. -- Weiwei On 21 Mar 2018, 8:39 AM +0800, Arpit Agarwal , wrote: +1 (binding) Arpit On 3/20/18, 11:21 AM, "Owen O'Malley" wrote: All, Following our discussions on the previous thread (Merging branch HDFS-7240 to

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC0)

2018-03-29 Thread Weiwei Yang
Hi Wangda While testing the build, we found a bug https://issues.apache.org/jira/browse/YARN-8085, it might cause NPE during RM fail-over. I think that needs to be included in 3.1.0. We have run some other tests, and they look good so far. This includes - Some basic teragen/terasort/DS jobs - V

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

2018-04-01 Thread Weiwei Yang
Hi Wangda +1 (non-binding) - Smoke tests with teragen/terasort/DS jobs - Various of metrics, UI displays validation, compatible tests - Tested GPU resource-type - Verified RM fail-over, app-recovery - Verified 2 threads async-scheduling - Enabled placement constraints, tested affinity/anti-affini

Re: [VOTE] Merge HDDS (HDFS-7240) *code* into trunk

2018-04-16 Thread Weiwei Yang
+1 -- Weiwei On 17 Apr 2018, 8:59 AM +0800, Jitendra Pandey , wrote: dopt HDDS/Ozone as a sub-project of Hadoop, here is the formal vote for code merge.

Re: Apache Hadoop 3.1.1 release plan

2018-05-10 Thread Weiwei Yang
Hi Wangda I would propose to have https://issues.apache.org/jira/browse/YARN-8015 included in 3.1.1. Once this is done, we get both intra and inter placement constraint covered so users could start to explore this feature. Otherwise the functionality is pretty limited. It has been Patch Availa

Re: HADOOP-14163 proposal for new hadoop.apache.org

2018-09-02 Thread Weiwei Yang
> > > >>> I got multiple valuable feedback and I improved the proposed site > > >>> according to the comments. Allen had some concerns about the used > > >>> technologies (hugo vs. mvn-site) and I answered all the questions > > why > > >>> I think mvn-site is the best for documentation and hugo is best > > for > > >>> generating site. > > >>> > > >>> > > >>> I would like to finish this effort/jira: I would like to start a > > >>> discussion about using this proposed version and approach as a > new > > >>> site of Apache Hadoop. Please let me know what you think. > > >>> > > >>> > > >>> Thanks a lot, > > >>> Marton > > >>> > > >>> > > - > > >>> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > >>> For additional commands, e-mail: > common-dev-h...@hadoop.apache.org > > >>> > > >> > > >> > > >> > > - > > >> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > >> For additional commands, e-mail: > common-dev-h...@hadoop.apache.org > > >> > > > > > > > - > > > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > > > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > > > > - > > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > > > > > > > > > -- Weiwei Yang

Re: [Discuss] Merge discussion for Node attribute support feature YARN-3409

2018-09-04 Thread Weiwei Yang
nfiguration > details. This feature works from end-to-end and we tested this in our local > cluster. Branch code is run against trunk and tracked via [4]. > > We would love to get your thoughts before opening a voting thread. > > Special thanks to a team of folks who worked hard and

Re: [Vote] Merge discussion for Node attribute support feature YARN-3409

2018-09-09 Thread Weiwei Yang
est from AM. > > >> Manager implementation will help to store and recover Node Attributes. > > >> This > > >> works with existing placement constraints. > > >> > > >> *Regarding to API stability:* > > >> > > >> All newl

Re: [DISCUSS] Move to gitbox

2018-12-10 Thread Weiwei Yang
; To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > > > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > > > > > > > --------- > > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > > > > > > > - > To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > -- Weiwei Yang

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC1

2019-01-10 Thread Weiwei Yang
ve done few testing with my pseudo cluster. My +1 to start. > > > > > > > > Regards, > > > > Sunil > > > > > > > > [1] > > > > > https://lists.apache.org/thread.html/68c1745dcb65602aecce6f7e6b7f0af3d974b1bf0048e7823e58b06f@%3Cyarn-dev.hadoop.apache.org%3E > > > > [2] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.2.0) > > AND fixVersion not in (3.1.0, 3.0.0, 3.0.0-beta1) AND status = Resolved > > ORDER BY fixVersion ASC > > > Wilfred Spiegelenburg | Software Engineer > cloudera.com <https://www.cloudera.com/> > > > > > > > > -- Weiwei Yang

Re: [DISCUSS] Making submarine to different release model like Ozone

2019-01-31 Thread Weiwei Yang
Thanks for proposing this Wangda, my +1 as well. It is amazing to see the progress made in Submarine last year, the community grows fast and quiet collaborative. I can see the reasons to get it release faster in its own cycle. And at the same time, the Ozone way works very well. — Weiwei On Feb

Re: [VOTE] Propose to start new Hadoop sub project "submarine"

2019-02-04 Thread Weiwei Yang
+1 Weiwei -- Weiwei On Feb 5, 2019, 2:11 AM +0800, Steve Loughran , wrote: > +1, binding > > > On 1 Feb 2019, at 22:15, Wangda Tan wrote: > > > > Hi all, > > > > According to positive feedbacks from the thread [1] > > > > This is vote thread to start a new subproject named "hadoop-submarine" > >

Re: [VOTE] Release Apache Hadoop Submarine 0.2.0 - RC0

2019-06-21 Thread Weiwei Yang
+1 (binding) Thanks Weiwei On Jun 21, 2019, 5:33 AM +0800, Wangda Tan , wrote: +1 Binding. Tested in local cluster and reviewed docs. Thanks! On Wed, Jun 19, 2019 at 3:20 AM Sunil Govindan wrote: +1 binding - tested in local cluster. - tried tony run time as well - doc seems fine now. - Suni

Re: Agenda & More Information about Hadoop Community Meetup @ Palo Alto, June 26

2019-06-25 Thread Weiwei Yang
Thanks Wangda. Will this event be recorded? It will be extremely helpful for people who are unable to join to catch up. Thanks Weiwei On Jun 26, 2019, 4:12 AM +0800, Wangda Tan , wrote: A friendly reminder, The meetup will take place tomorrow at 9:00 AM PDT to 4:00 PM PDT. The address is: 395 P

[ANNOUNCE] New Apache Hadoop Committer - Tao Yang

2019-07-15 Thread Weiwei Yang
Hi Dear Apache Hadoop Community It's my pleasure to announce that Tao Yang has been elected as an Apache Hadoop committer, this is to recognize his contributions to Apache Hadoop YARN project. Congratulations and welcome on board! Weiwei (On behalf of the Apache Hadoop PMC)

Re: [VOTE] Force "squash and merge" option for PR merge on github UI

2019-07-16 Thread Weiwei Yang
Thanks Marton, +1 on this. Weiwei On Jul 17, 2019, 2:07 PM +0800, Elek, Marton , wrote: > Hi, > > Github UI (ui!) helps to merge Pull Requests to the proposed branch. > There are three different ways to do it [1]: > > 1. Keep all the different commits from the PR branch and create one > additiona

Re: Aug Hadoop Community Meetup in China

2019-07-18 Thread Weiwei Yang
Hi Junping Thanks for organizing this event ! Just finished the survey, looking forward to meet folks in the coming meet up. Thanks Weiwei On Jul 18, 2019, 3:28 PM +0800, 俊平堵 , wrote: > Hi, all! > > I am glad to let you know that we are organizing > Hadoop Contributors Meetup in China on Aug. > >

Re: Aug Hadoop Community Meetup in China

2019-07-23 Thread Weiwei Yang
Hi Junping Thanks. I would like to get a slot to talk about our new open source project: YuniKorn. Thanks Weiwei On Jul 23, 2019, 5:08 PM +0800, 俊平堵 , wrote: > Thanks for these positive feedbacks! The local community has voted the date > and location to be 8/10, Beijing. So please book your tim

Re: [VOTE] Move Submarine source code, documentation, etc. to a separate Apache Git repo

2019-08-26 Thread Weiwei Yang
+1 Thanks Weiwei On Aug 27, 2019, 9:40 AM +0800, Xun Liu , wrote: > +1 (non-binding) > This is the best news. > > Peter Bacsko 于2019年8月27日周二 上午4:59写道: > > > +1 (non-binding) > > > > On Sat, Aug 24, 2019 at 4:06 AM Wangda Tan wrote: > > > > > Hi devs, > > > > > > This is a voting thread to move S

Re: [DISCUSS] Separate Hadoop Core trunk and Hadoop Ozone trunk source tree

2019-09-17 Thread Weiwei Yang
+1 (binding) Thanks Weiwei On Wed, Sep 18, 2019 at 6:35 AM Wangda Tan wrote: > +1 (binding). > > From my experiences of Submarine project, I think moving to a separate repo > helps. > > - Wangda > > On Tue, Sep 17, 2019 at 11:41 AM Subru Krishnan wrote: > > > +1 (binding). > > > > IIUC, there

Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0

2019-09-18 Thread Weiwei Yang
+1 (binding) Downloaded tarball, setup a pseudo cluster manually Verified basic HDFS operations, copy/view files Verified basic YARN operations, run sample DS jobs Verified basic YARN restful APIs, e.g cluster/nodes info etc Set and verified YARN node-attributes, including CLI Thanks Weiwei On Se

Re: [VOTE] Release Hadoop-3.1.3-RC0

2019-09-19 Thread Weiwei Yang
+1 (binding) - Downloaded source, setup a single node cluster - Verified basic HDFS operations, put/get/cat etc - Verified basic YARN restful apis, cluster/nodes/scheduler, all seem good - Run several distributed shell job Thanks Weiwei On Sep 19, 2019, 4:28 PM +0800, Sunil Govindan , wrote: > +1

[jira] [Created] (HDFS-9152) Get input/output error while copying 800 small files to NFS Gateway mount point

2015-09-27 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-9152: - Summary: Get input/output error while copying 800 small files to NFS Gateway mount point Key: HDFS-9152 URL: https://issues.apache.org/jira/browse/HDFS-9152 Project

[jira] [Created] (HDFS-9653) Expose the number of blocks pending deletion through dfsadmin report command

2016-01-14 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-9653: - Summary: Expose the number of blocks pending deletion through dfsadmin report command Key: HDFS-9653 URL: https://issues.apache.org/jira/browse/HDFS-9653 Project: Hadoop

[jira] [Created] (HDFS-12389) Ozone: oz commandline list calls should return valid JSON format output

2017-09-03 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12389: -- Summary: Ozone: oz commandline list calls should return valid JSON format output Key: HDFS-12389 URL: https://issues.apache.org/jira/browse/HDFS-12389 Project: Hadoop

[jira] [Resolved] (HDFS-12367) Ozone: Too many open files error while running corona

2017-09-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-12367. Resolution: Duplicate I think this issue no longer happens to me, closing it as a dup to HDFS-12382

[jira] [Created] (HDFS-12391) Ozone: TestKSMSQLCli is not working as expected

2017-09-04 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12391: -- Summary: Ozone: TestKSMSQLCli is not working as expected Key: HDFS-12391 URL: https://issues.apache.org/jira/browse/HDFS-12391 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-11922) Ozone: KSM: Garbage collect deleted blocks

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-11922. Resolution: Done Fix Version/s: HDFS-7240 Target Version/s: HDFS-7240 > Ozone:

[jira] [Created] (HDFS-12415) Ozone: TestXceiverClientManager occasionally fails

2017-09-11 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12415: -- Summary: Ozone: TestXceiverClientManager occasionally fails Key: HDFS-12415 URL: https://issues.apache.org/jira/browse/HDFS-12415 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12440) Ozone: TestAllocateContainer fails on jenkins

2017-09-12 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12440: -- Summary: Ozone: TestAllocateContainer fails on jenkins Key: HDFS-12440 URL: https://issues.apache.org/jira/browse/HDFS-12440 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-12440) Ozone: TestAllocateContainer fails on jenkins

2017-09-13 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-12440. Resolution: Duplicate Fix Version/s: HDFS-7240 > Ozone: TestAllocateContainer fails

[jira] [Created] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-09-13 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12443: -- Summary: Ozone: Improve SCM block deletion throttling algorithm Key: HDFS-12443 URL: https://issues.apache.org/jira/browse/HDFS-12443 Project: Hadoop HDFS

[jira] [Reopened] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-09-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reopened HDFS-11156: > Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST

[jira] [Created] (HDFS-12459) Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-09-14 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12459: -- Summary: Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API Key: HDFS-12459 URL: https://issues.apache.org/jira/browse/HDFS-12459 Project: Hadoop HDFS

[jira] [Created] (HDFS-12463) Ozone: Fix TestXceiverClientMetrics#testMetrics

2017-09-14 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12463: -- Summary: Ozone: Fix TestXceiverClientMetrics#testMetrics Key: HDFS-12463 URL: https://issues.apache.org/jira/browse/HDFS-12463 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-12461) Ozone: Ozone data placement is not even

2017-09-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-12461. Resolution: Not A Problem Assignee: Weiwei Yang Fix Version/s: HDFS-7240 > Oz

[jira] [Created] (HDFS-12477) Ozone: Some minor text improvement in SCM web UI

2017-09-17 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12477: -- Summary: Ozone: Some minor text improvement in SCM web UI Key: HDFS-12477 URL: https://issues.apache.org/jira/browse/HDFS-12477 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-12488) Ozone: OzoneRestClient has no notion of configuration

2017-09-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12488: -- Summary: Ozone: OzoneRestClient has no notion of configuration Key: HDFS-12488 URL: https://issues.apache.org/jira/browse/HDFS-12488 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12489) Ozone: OzoneRestClientException swallows exceptions which makes client hard to debug failures

2017-09-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12489: -- Summary: Ozone: OzoneRestClientException swallows exceptions which makes client hard to debug failures Key: HDFS-12489 URL: https://issues.apache.org/jira/browse/HDFS-12489

[jira] [Created] (HDFS-12492) Ozone: ListVolume output misses some attributes

2017-09-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12492: -- Summary: Ozone: ListVolume output misses some attributes Key: HDFS-12492 URL: https://issues.apache.org/jira/browse/HDFS-12492 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-12500) Ozone: add logger for oz shell commands and move error stack traces to DEBUG level

2017-09-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12500: -- Summary: Ozone: add logger for oz shell commands and move error stack traces to DEBUG level Key: HDFS-12500 URL: https://issues.apache.org/jira/browse/HDFS-12500 Project

[jira] [Created] (HDFS-12503) Ozone: some UX improvements to oz_debug

2017-09-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12503: -- Summary: Ozone: some UX improvements to oz_debug Key: HDFS-12503 URL: https://issues.apache.org/jira/browse/HDFS-12503 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-12504) Ozone: Improve SQLCLI performance

2017-09-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12504: -- Summary: Ozone: Improve SQLCLI performance Key: HDFS-12504 URL: https://issues.apache.org/jira/browse/HDFS-12504 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-12506) Ozone: ListBucket is too slow

2017-09-20 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12506: -- Summary: Ozone: ListBucket is too slow Key: HDFS-12506 URL: https://issues.apache.org/jira/browse/HDFS-12506 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-12524) Ozone: Record number of keys scanned and hinted for getRangeKVs call

2017-09-21 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12524: -- Summary: Ozone: Record number of keys scanned and hinted for getRangeKVs call Key: HDFS-12524 URL: https://issues.apache.org/jira/browse/HDFS-12524 Project: Hadoop HDFS

[jira] [Reopened] (HDFS-12415) Ozone: TestXceiverClientManager and TestAllocateContainer occasionally fails

2017-09-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reopened HDFS-12415: > Ozone: TestXceiverClientManager and TestAllocateContainer occasionally fa

[jira] [Created] (HDFS-12539) Ozone: refactor some functions in KSMMetadataManagerImpl to be more readable and reusable

2017-09-24 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12539: -- Summary: Ozone: refactor some functions in KSMMetadataManagerImpl to be more readable and reusable Key: HDFS-12539 URL: https://issues.apache.org/jira/browse/HDFS-12539

[jira] [Created] (HDFS-12540) Ozone: node status text reported by SCM is a confusing

2017-09-24 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12540: -- Summary: Ozone: node status text reported by SCM is a confusing Key: HDFS-12540 URL: https://issues.apache.org/jira/browse/HDFS-12540 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12546) Ozone: DB listing operation performance improvement

2017-09-25 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12546: -- Summary: Ozone: DB listing operation performance improvement Key: HDFS-12546 URL: https://issues.apache.org/jira/browse/HDFS-12546 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-12401) Ozone: TestBlockDeletingService#testBlockDeletionTimeout sometimes timeout

2017-10-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-12401. Resolution: Cannot Reproduce > Ozone: TestBlockDeletingService#testBlockDeletionTimeout someti

[jira] [Created] (HDFS-12684) Ozone: SCM metrics NodeCount is overlapping with node manager metrics

2017-10-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12684: -- Summary: Ozone: SCM metrics NodeCount is overlapping with node manager metrics Key: HDFS-12684 URL: https://issues.apache.org/jira/browse/HDFS-12684 Project: Hadoop HDFS

[jira] [Created] (HDFS-12701) More fine-grained locks in ShortCircuitCache

2017-10-24 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12701: -- Summary: More fine-grained locks in ShortCircuitCache Key: HDFS-12701 URL: https://issues.apache.org/jira/browse/HDFS-12701 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-12744) More logs when short-circuit read is failed and disabled

2017-10-29 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12744: -- Summary: More logs when short-circuit read is failed and disabled Key: HDFS-12744 URL: https://issues.apache.org/jira/browse/HDFS-12744 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-12757) DeadLock Happened Between DFSOutputStream and LeaseRenewer when LeaseRenewer#renew SocketTimeException

2017-11-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-12757. Resolution: Duplicate > DeadLock Happened Between DFSOutputStream and LeaseRenewer w

[jira] [Created] (HDFS-12770) Add doc about how to disable client socket cache

2017-11-03 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12770: -- Summary: Add doc about how to disable client socket cache Key: HDFS-12770 URL: https://issues.apache.org/jira/browse/HDFS-12770 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-12936) java.lang.OutOfMemoryError: unable to create new native thread

2017-12-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-12936. Resolution: Not A Bug > java.lang.OutOfMemoryError: unable to create new native thr

[jira] [Created] (HDFS-13351) Revert HDFS-11156 from branch-2

2018-03-26 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-13351: -- Summary: Revert HDFS-11156 from branch-2 Key: HDFS-13351 URL: https://issues.apache.org/jira/browse/HDFS-13351 Project: Hadoop HDFS Issue Type: Task

[jira] [Created] (HDFS-9682) Fix a typo "aplication" in webhdfs document

2016-01-21 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-9682: - Summary: Fix a typo "aplication" in webhdfs document Key: HDFS-9682 URL: https://issues.apache.org/jira/browse/HDFS-9682 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-9152) Get input/output error while copying 800 small files to NFS Gateway mount point

2016-03-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-9152. --- Resolution: Cannot Reproduce > Get input/output error while copying 800 small files to NFS Gate

[jira] [Created] (HDFS-10198) File browser web UI should split to pages when files/dirs are too many

2016-03-22 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-10198: -- Summary: File browser web UI should split to pages when files/dirs are too many Key: HDFS-10198 URL: https://issues.apache.org/jira/browse/HDFS-10198 Project: Hadoop

[jira] [Resolved] (HDFS-10198) File browser web UI should split to pages when files/dirs are too many

2016-03-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-10198. Resolution: Duplicate Fix Version/s: 2.8.0 > File browser web UI should split to pages w

[jira] [Created] (HDFS-10440) Add more information to DataNode web UI

2016-05-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-10440: -- Summary: Add more information to DataNode web UI Key: HDFS-10440 URL: https://issues.apache.org/jira/browse/HDFS-10440 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-10493) Add links to datanode web UI in namenode datanodes page

2016-06-06 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-10493: -- Summary: Add links to datanode web UI in namenode datanodes page Key: HDFS-10493 URL: https://issues.apache.org/jira/browse/HDFS-10493 Project: Hadoop HDFS

[jira] [Created] (HDFS-10569) A bug causes OutOfIndex error in BlockListAsLongs

2016-06-23 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-10569: -- Summary: A bug causes OutOfIndex error in BlockListAsLongs Key: HDFS-10569 URL: https://issues.apache.org/jira/browse/HDFS-10569 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-10581) Redundant table on Datanodes page when there is no nodes under decomissioning

2016-06-27 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-10581: -- Summary: Redundant table on Datanodes page when there is no nodes under decomissioning Key: HDFS-10581 URL: https://issues.apache.org/jira/browse/HDFS-10581 Project

[jira] [Created] (HDFS-10583) Add Utilities/conf links to HDFS UI

2016-06-27 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-10583: -- Summary: Add Utilities/conf links to HDFS UI Key: HDFS-10583 URL: https://issues.apache.org/jira/browse/HDFS-10583 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-10588) False alarm in namenode log - ERROR - Disk Balancer is not enabled

2016-06-28 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-10588: -- Summary: False alarm in namenode log - ERROR - Disk Balancer is not enabled Key: HDFS-10588 URL: https://issues.apache.org/jira/browse/HDFS-10588 Project: Hadoop HDFS

[jira] [Created] (HDFS-11156) WebHDFS GET_BLOCK_LOCATIONS

2016-11-18 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11156: -- Summary: WebHDFS GET_BLOCK_LOCATIONS Key: HDFS-11156 URL: https://issues.apache.org/jira/browse/HDFS-11156 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-11166) Doc for GET_BLOCK_LOCATIONS is missing in webhdfs API

2016-11-22 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11166: -- Summary: Doc for GET_BLOCK_LOCATIONS is missing in webhdfs API Key: HDFS-11166 URL: https://issues.apache.org/jira/browse/HDFS-11166 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-11413) HDFS fsck command shows health as corrupt for '/'

2017-02-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-11413. Resolution: Not A Bug > HDFS fsck command shows health as corrupt

[jira] [Created] (HDFS-11550) Ozone: Add a check to prevent removing a container that has keys in it

2017-03-20 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11550: -- Summary: Ozone: Add a check to prevent removing a container that has keys in it Key: HDFS-11550 URL: https://issues.apache.org/jira/browse/HDFS-11550 Project: Hadoop

[jira] [Created] (HDFS-11567) Support update container

2017-03-23 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11567: -- Summary: Support update container Key: HDFS-11567 URL: https://issues.apache.org/jira/browse/HDFS-11567 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11569) Ozone: Implement listKey function for KeyManager

2017-03-23 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11569: -- Summary: Ozone: Implement listKey function for KeyManager Key: HDFS-11569 URL: https://issues.apache.org/jira/browse/HDFS-11569 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11581) Ozone: Support force delete a container

2017-03-27 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11581: -- Summary: Ozone: Support force delete a container Key: HDFS-11581 URL: https://issues.apache.org/jira/browse/HDFS-11581 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11585) Ozone: Support force update a container

2017-03-27 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11585: -- Summary: Ozone: Support force update a container Key: HDFS-11585 URL: https://issues.apache.org/jira/browse/HDFS-11585 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11625) Ozone: Replace hard coded datanode data dir in test code with getStorageDir to fix UT failures

2017-04-05 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11625: -- Summary: Ozone: Replace hard coded datanode data dir in test code with getStorageDir to fix UT failures Key: HDFS-11625 URL: https://issues.apache.org/jira/browse/HDFS-11625

[jira] [Created] (HDFS-11655) Ozone: CLI: Guarantees user runs ozone commands has appropriate permission

2017-04-13 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11655: -- Summary: Ozone: CLI: Guarantees user runs ozone commands has appropriate permission Key: HDFS-11655 URL: https://issues.apache.org/jira/browse/HDFS-11655 Project: Hadoop

[jira] [Created] (HDFS-11658) Ozone: SCM daemon is unable to be started via CLI

2017-04-17 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11658: -- Summary: Ozone: SCM daemon is unable to be started via CLI Key: HDFS-11658 URL: https://issues.apache.org/jira/browse/HDFS-11658 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11668) Ozone: misc improvements for SCM CLI

2017-04-18 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11668: -- Summary: Ozone: misc improvements for SCM CLI Key: HDFS-11668 URL: https://issues.apache.org/jira/browse/HDFS-11668 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11675: -- Summary: Ozone: SCM CLI: Implement delete container command Key: HDFS-11675 URL: https://issues.apache.org/jira/browse/HDFS-11675 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-04-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11676: -- Summary: Ozone: SCM CLI: Implement close container command Key: HDFS-11676 URL: https://issues.apache.org/jira/browse/HDFS-11676 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11677) OZone: SCM CLI: Implement get container command

2017-04-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11677: -- Summary: OZone: SCM CLI: Implement get container command Key: HDFS-11677 URL: https://issues.apache.org/jira/browse/HDFS-11677 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11678) Ozone: SCM CLI: Implement get container metrics command

2017-04-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11678: -- Summary: Ozone: SCM CLI: Implement get container metrics command Key: HDFS-11678 URL: https://issues.apache.org/jira/browse/HDFS-11678 Project: Hadoop HDFS

[jira] [Created] (HDFS-11679) Ozone: SCM CLI: Implement list container command

2017-04-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11679: -- Summary: Ozone: SCM CLI: Implement list container command Key: HDFS-11679 URL: https://issues.apache.org/jira/browse/HDFS-11679 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11680) Ozone: SCM CLI: Implement info container command

2017-04-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11680: -- Summary: Ozone: SCM CLI: Implement info container command Key: HDFS-11680 URL: https://issues.apache.org/jira/browse/HDFS-11680 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11716) Revisit delete container API

2017-04-27 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11716: -- Summary: Revisit delete container API Key: HDFS-11716 URL: https://issues.apache.org/jira/browse/HDFS-11716 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11725) Ozone: Revise create container CLI specification and implementation

2017-04-29 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11725: -- Summary: Ozone: Revise create container CLI specification and implementation Key: HDFS-11725 URL: https://issues.apache.org/jira/browse/HDFS-11725 Project: Hadoop HDFS

[jira] [Created] (HDFS-11740) Ozone: Improve the time interval to run different DatanodeStateMachine state tasks

2017-05-02 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11740: -- Summary: Ozone: Improve the time interval to run different DatanodeStateMachine state tasks Key: HDFS-11740 URL: https://issues.apache.org/jira/browse/HDFS-11740 Project

  1   2   >