Re: [Virtual MEETUP]: Migration to Hadoop 3

2020-08-26 Thread epa...@apache.org
Hello. Just a reminder that today I would like to invite you all to discuss your experiences migrating from Hadoop 2 to Hadoop 3. -Eric On Monday, August 24, 2020, 1:58:37 PM CDT, epa...@apache.org wrote: Hello everyone! We are considering migrating to Hadoop 3, and we would be very interest

[jira] [Resolved] (HADOOP-17224) Install Intel ISA-L library in Dockerfile

2020-08-26 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HADOOP-17224. --- Fix Version/s: 3.4.0 Resolution: Fixed Merged to trunk. Thanks for reviewing

[jira] [Created] (HADOOP-17230) JAVA_HOME with spaces not supported

2020-08-26 Thread Wayne Seguin (Jira)
Wayne Seguin created HADOOP-17230: - Summary: JAVA_HOME with spaces not supported Key: HADOOP-17230 URL: https://issues.apache.org/jira/browse/HADOOP-17230 Project: Hadoop Common Issue Type: B

Re: [Virtual MEETUP]: Migration to Hadoop 3

2020-08-26 Thread Brahma Reddy Battula
Hi Eric, check the following references for the same. 01/02/2020 Didi talked about their large scale HDFS cluster upgrade experience. Slides: https://drive.google.com/open?id=1iwJ1asalYfgnOCBuE-RfeG-NpSocjIcy Recording: https://cloudera.zoom.us/rec/share/7MF_dLX0339OY5391xvkZP8NLrXieaa8gyZK-fYJ

Re: [Virtual MEETUP]: Migration to Hadoop 3

2020-08-26 Thread Brahma Reddy Battula
One more update from me. We didn't face any issues with YARN, for HDFS you can have a look at the following jira's. https://issues.apache.org/jira/browse/HDFS-13596 https://issues.apache.org/jira/browse/HDFS-14396 https://issues.apache.org/jira/browse/HDFS-14509 Following jira is incompatible fo

[DISCUSS] GitHub PR link auto-posting to JIRA?

2020-08-26 Thread Mingliang Liu
Hi, I found that GitHub PR will not show up as "links" of the JIRA even if the PR subject starts with a JIRA number. Is this a known issue? I see this works for HBase projects, but not Hadoop. Thanks,

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2020-08-26 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/38/ No changes - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@

Re: [Virtual MEETUP]: Migration to Hadoop 3

2020-08-26 Thread epa...@apache.org
Thank you! This will be very helpful. And I really appreciate your participation in todays meeting. -Eric On Wednesday, August 26, 2020, 12:36:38 PM CDT, Brahma Reddy Battula wrote: Hi Eric, check the following references for the same. 01/02/2020 Didi talked about their large scale HDFS clu

[jira] [Created] (HADOOP-17231) empty getDefaultExtension() is ignored

2020-08-26 Thread Ruslan Dautkhanov (Jira)
Ruslan Dautkhanov created HADOOP-17231: -- Summary: empty getDefaultExtension() is ignored Key: HADOOP-17231 URL: https://issues.apache.org/jira/browse/HADOOP-17231 Project: Hadoop Common

Re: [DISCUSS] GitHub PR link auto-posting to JIRA?

2020-08-26 Thread Ayush Saxena
Hi Mingliang, I think this issue has been there for a couple of months, It used to work earlier IIRC. I tried checking a bit, I think ASF-GITHUB-BOT didn't have permissions, As of now I added it as HDFS-Contributor-1(temporarily) and I just saw one notification on HDFS-15025 from Github. Can you ch

Re: Mandarin Hadoop online sync this week

2020-08-26 Thread Wei-Chiu Chuang
This week's summary: 8/26 Mandarin online sync Weichiu, Xiaoiao, Baoloongmao, Hui, wuweiwei,, Leon Gao, Lisheng Sun, Jinglun, zhoubin86 Leon shared a DataNode improvement proposal at Uber. Different storage density. Balance disk IO among different disk size. Problem: archive disk’s IO utilizat

Re: [Virtual MEETUP]: Migration to Hadoop 3

2020-08-26 Thread Wei-Chiu Chuang
Thanks Brahma, Eric, do you have a target Hadoop 3 release line in mind? The "unofficial" plan here at Cloudera is to rebase our current dev codebase from Hadoop 3.1.1 to 3.3 some time later. The Hadoop 3.1 code line will approach its 3rd anniversary by this year's end so perhaps we can start to

Re: [DISCUSS] fate of branch-2.9

2020-08-26 Thread Wei-Chiu Chuang
Bump up this thread after 6 months. Is anyone still interested in the 2.9 release line? Or are we good to start the EOL process? The 2.9.2 was released in Nov 2018. I'd really like to see the community to converge to fewer release lines and make more frequent releases in each line. Thanks, Weich

Re: [Virtual MEETUP]: Migration to Hadoop 3

2020-08-26 Thread Sunil Govindan
Hi folks great to see the participation and thanks all for joining! @Wei-Chiu Chuang 3.1 is one of the stable line along with 3.2 As we are moving to a stable 3.3, we should start to visit the fate of 3.1 by end of this year and early next year. Thanks Sunil On Thu, Aug 27, 2020 at 11:17 AM We