Re: [Virtual MEETUP]: Migration to Hadoop 3

2020-08-26 Thread epa...@apache.org
Hello. Just a reminder that today I would like to invite you all to discuss your experiences migrating from Hadoop 2 to Hadoop 3. -Eric On Monday, August 24, 2020, 1:58:37 PM CDT, epa...@apache.org wrote: Hello everyone! We are considering migrating to Hadoop 3, and we would be very interest

[jira] [Created] (HDFS-15539) When disallowing snapshot on a dir, throw exception if its snapshot root is not empty

2020-08-26 Thread Siyao Meng (Jira)
Siyao Meng created HDFS-15539: - Summary: When disallowing snapshot on a dir, throw exception if its snapshot root is not empty Key: HDFS-15539 URL: https://issues.apache.org/jira/browse/HDFS-15539 Project

[jira] [Created] (HDFS-15540) Directories protected from delete can still be moved to the trash

2020-08-26 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-15540: Summary: Directories protected from delete can still be moved to the trash Key: HDFS-15540 URL: https://issues.apache.org/jira/browse/HDFS-15540 Project: Hado

Re: [Virtual MEETUP]: Migration to Hadoop 3

2020-08-26 Thread Brahma Reddy Battula
Hi Eric, check the following references for the same. 01/02/2020 Didi talked about their large scale HDFS cluster upgrade experience. Slides: https://drive.google.com/open?id=1iwJ1asalYfgnOCBuE-RfeG-NpSocjIcy Recording: https://cloudera.zoom.us/rec/share/7MF_dLX0339OY5391xvkZP8NLrXieaa8gyZK-fYJ

Re: [Virtual MEETUP]: Migration to Hadoop 3

2020-08-26 Thread Brahma Reddy Battula
One more update from me. We didn't face any issues with YARN, for HDFS you can have a look at the following jira's. https://issues.apache.org/jira/browse/HDFS-13596 https://issues.apache.org/jira/browse/HDFS-14396 https://issues.apache.org/jira/browse/HDFS-14509 Following jira is incompatible fo

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2020-08-26 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/38/ No changes - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hado

Re: [Virtual MEETUP]: Migration to Hadoop 3

2020-08-26 Thread epa...@apache.org
Thank you! This will be very helpful. And I really appreciate your participation in todays meeting. -Eric On Wednesday, August 26, 2020, 12:36:38 PM CDT, Brahma Reddy Battula wrote: Hi Eric, check the following references for the same. 01/02/2020 Didi talked about their large scale HDFS clu

Re: Mandarin Hadoop online sync this week

2020-08-26 Thread Wei-Chiu Chuang
This week's summary: 8/26 Mandarin online sync Weichiu, Xiaoiao, Baoloongmao, Hui, wuweiwei,, Leon Gao, Lisheng Sun, Jinglun, zhoubin86 Leon shared a DataNode improvement proposal at Uber. Different storage density. Balance disk IO among different disk size. Problem: archive disk’s IO utilizat

Re: [Virtual MEETUP]: Migration to Hadoop 3

2020-08-26 Thread Wei-Chiu Chuang
Thanks Brahma, Eric, do you have a target Hadoop 3 release line in mind? The "unofficial" plan here at Cloudera is to rebase our current dev codebase from Hadoop 3.1.1 to 3.3 some time later. The Hadoop 3.1 code line will approach its 3rd anniversary by this year's end so perhaps we can start to

Re: [DISCUSS] fate of branch-2.9

2020-08-26 Thread Wei-Chiu Chuang
Bump up this thread after 6 months. Is anyone still interested in the 2.9 release line? Or are we good to start the EOL process? The 2.9.2 was released in Nov 2018. I'd really like to see the community to converge to fewer release lines and make more frequent releases in each line. Thanks, Weich

[jira] [Created] (HDFS-15541) Disallow making a Snapshottable directory unsnapshottable if it has no empty snapshot trash directory

2020-08-26 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDFS-15541: -- Summary: Disallow making a Snapshottable directory unsnapshottable if it has no empty snapshot trash directory Key: HDFS-15541 URL: https://issues.apache.org/jira/brow

Re: [Virtual MEETUP]: Migration to Hadoop 3

2020-08-26 Thread Sunil Govindan
Hi folks great to see the participation and thanks all for joining! @Wei-Chiu Chuang 3.1 is one of the stable line along with 3.2 As we are moving to a stable 3.3, we should start to visit the fate of 3.1 by end of this year and early next year. Thanks Sunil On Thu, Aug 27, 2020 at 11:17 AM We

[jira] [Created] (HDFS-15542) Add identified snapshot corruption tests for ordered snapshot deletion

2020-08-26 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDFS-15542: -- Summary: Add identified snapshot corruption tests for ordered snapshot deletion Key: HDFS-15542 URL: https://issues.apache.org/jira/browse/HDFS-15542 Proj

[jira] [Resolved] (HDFS-15541) Disallow making a Snapshottable directory unsnapshottable if it has no empty snapshot trash directory

2020-08-26 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDFS-15541. Fix Version/s: 3.4.0 Resolution: Duplicate > Disallow making a Snapshottable