Re: Release plans for Hadoop 2.10.0

Hi Wei-Chiu, Just got a chance to pull the jstack on a datanode that's showing high ReadBlockOpAvgTime and I found a few different scenarios: Lot of DataXceiver threads in the following state for a while java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method)

Re: Release plans for Hadoop 2.10.0

Hi Wei-Chiu, I came across HDFS-14476 when searching if anyone else is seeing the same issues as us. I didn't see it merged and so assumed there are other fixes done around what you mention in there. HDFS-11187 is already applied to 2.9.1 and we are on 2.9.2 and so it might not be impacting us th

Re: Release plans for Hadoop 2.10.0

or maybe https://issues.apache.org/jira/browse/HDFS-14476 I reverted this fix and I've not looked at it further. But take a look. It's disappointing to me that none of the active Hadoop contributors seem to understand DirectoryScanner well enough. or HDFS-11187

Re: Release plans for Hadoop 2.10.0

Thanks for the quick response Jonathan. Honestly, I am not sure if 2.10.0 will fix my issue but it looks similar to https://issues.apache.org/jira/browse/HDFS-14536 which is not fixed yet so we will probably not see the benefit. We need to either dig more into the logs and jstack and create a JIR

Re: Release plans for Hadoop 2.10.0

Hey Viral, yes. We're working on a 2.10.0 release, I'm the release manager for that. I can't comment on the particular issue you're seeing, but I plan to start the release process for 2.10.0 early next week, then 2.10.0 will be released shortly after that (assuming all goes well). Thanks, Jonathan

Release plans for Hadoop 2.10.0

(Cross posting from user list based on feedback by Sean Busbey) All, Just saw the announcement for new release for Hadoop 3.2.1, congratulations team and thanks for all the hard work! Are we going to see a new release in the 2.x.x ? I noticed a bunch of tickets that have been resolved in the la