HDFS/HDDS unit tests running failed in Jenkins precommit building

2018-11-08 Thread Lin,Yiqun(vip.com)
Hi developers, Recently, I found following error frequently appeared in HDFS/HDDS Jenkins building. The link: https://builds.apache.org/job/PreCommit-HDDS-Build/1632/artifact/out/patch-unit-hadoop-ozone_ozone-manager.txt [ERROR] ExecutionException The forked VM terminated without properly sayin

答复: [ANNOUNCE] Apache Hadoop Ozone 0.2.1-alpha release

2018-10-04 Thread Lin,Yiqun(vip.com)
It's great to see this release. But I caught a broken url when read more information from the page you gave https://hadoop.apache.org/ozone. The steps: 1).Click download page: https://hadoop.apache.org/ozone/downloads/ 2).Click Announcement button 3).Click Documentation button, will redirect to a

答复: NN run progressively slower

2018-09-29 Thread Lin,Yiqun(vip.com)
og for Excessive Spew ( there are some jira's which are fixed later to 2.6.0) like decommission nodes,... v) Any recursive calls are very frequently? -Original Message- From: Lin,Yiqun(vip.com) [mailto:yiqun01@vipshop.com] Sent: Wednesday, September 26, 2018 10:26 AM To: Wei-Chiu Chuang

答复: NN run progressively slower

2018-09-25 Thread Lin,Yiqun(vip.com)
o take a heap dump and analyze what's in there? There were quite some NN scalability and GC improvements between CDH5.5 ~ CDH5.8 time frame. We have customers at/beyond your scale in your version but I don't think I've heard similar symptoms. Regards On Tue, Sep 25, 2018 at 2:

答复: NN run progressively slower

2018-09-25 Thread Lin,Yiqun(vip.com)
9月26日 1:11 收件人: 林意群[运营中心] 抄送: Hdfs-dev 主题: Re: NN run progressively slower Are you using CMS? How big is young gen? How often does the NN do young gen collection when it is slow? On Tue, Sep 25, 2018 at 4:04 AM Lin,Yiqun(vip.com<http://vip.com>) mailto:yiqun01@vipshop.com>> wr

NN run progressively slower

2018-09-25 Thread Lin,Yiqun(vip.com)
Hi hdfs developers: We meet a bad problem after rolling upgrade our hadoop version from 2.5.0-cdh5.3.2 to 2.6.0-cdh5.13.1. The problem is that we find NN running slow periodically (around a week). Concretely to say, For example, we startup NN on Monday, it will run fast. But time coming to Week

答复: [DISCUSS] Alpha Release of Ozone

2018-08-06 Thread Lin,Yiqun(vip.com)
+1, looking forward to seeing the Ozone/HDDS, : ). -邮件原件- 发件人: Anu Engineer [mailto:aengin...@hortonworks.com] 发送时间: 2018年8月7日 6:51 收件人: Elek, Marton; common-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org; hdfs-dev@hadoop.apache.org 主题: Re: [DISCUSS] A

答复: [VOTE] reset/force push to clean up inadvertent merge commit pushed to trunk

2018-07-05 Thread Lin,Yiqun(vip.com)
+1. -邮件原件- 发件人: Subru Krishnan [mailto:su...@apache.org] 发送时间: 2018年7月6日 5:59 收件人: Wei-Chiu Chuang 抄送: Rohith Sharma K S; Subramaniam Krishnan; yarn-...@hadoop.apache.org; Hdfs-dev; Hadoop Common; mapreduce-...@hadoop.apache.org 主题: Re: [VOTE] reset/force push to clean up inadvertent merg

答复: [DISCUSS] Merge Storage Policy Satisfier (SPS) [HDFS-10285] feature branch to trunk

2018-06-27 Thread Lin,Yiqun(vip.com)
Hi Uma, Seeing the discussion under JIRA HDFS-10285, external SPS running will be a recommend way for the users, right? As you also mentioned, there are some additional works need to test and be integrated. One more question from me, that maybe also cared by other developers, what's the major d

答复: HADOOP-15124 review

2018-06-26 Thread Lin,Yiqun(vip.com)
Hi Igor, It’s not appropriate to ask for a review request in dev mailing list. Dev mailing list is mainly used for discussing and answering user’s questions. You can ask for the review under specific JIRA, that will be seen by committers or others. If they have time, they will help take the rev

答复: Regarding Hadoop Erasure Coding architecture

2018-06-14 Thread Lin,Yiqun(vip.com)
Hi Chaitanya, I suppose you can get more details that you wanted to know from EC design doc attached in JIRA HDFS-7285(https://issues.apache.org/jira/browse/HDFS-7285). Hope this makes sense to you. Thanks Yiqun -邮件原件- 发件人: Chaitanya M V S [mailto:chaitanya.mvs2...@gmail.com] 发送时间: 201