答复: NN run progressively slower

2018-09-29 Thread Lin,Yiqun(vip.com)
og for Excessive Spew ( there are some jira's which are fixed later to 2.6.0) like decommission nodes,... v) Any recursive calls are very frequently? -Original Message- From: Lin,Yiqun(vip.com) [mailto:yiqun01@vipshop.com] Sent: Wednesday, September 26, 2018 10:26 AM To: Wei-Chiu Chuang

答复: NN run progressively slower

2018-09-25 Thread Lin,Yiqun(vip.com)
Hi Wei-Chiu, At the beginning, we have noted HDFS-9260 which changing the structure of the stored blocks. With multiple adding/removing under this structure, there will be a performance degradation. But we think this will reach a stable state, and HDFS-9260 isn’t the root cause from our point o

答复: NN run progressively slower

2018-09-25 Thread Lin,Yiqun(vip.com)
Hi Kiwal, following are my responses. Yes, we are using CMS, young gen size 36GB (maybe a little large), old gen 84 GB (0.75 threshold triggering full gc), total heap size 120GB. NN do young gen collection every 30~40s one time. Thanks Yiqun 发件人: Kihwal Lee [mailto:kih...@oath.com] 发送时间: 2018年9