Thanks Jim, Eric and Sunil, I tried to backport YARN-10540 to branch-3.2.2 at local and check yarn ui2, there is still one link that does not work correctly, But I am not sure if it is expected. Detailed information is attached at YARN-10540. If someone could confirm or update, please let me know. I would like to backport then and prepare another RC. NOTE: Hadoop-3.2.2 will not release as we plan because some expected issues are in progress. It will be postponed to 2021/01, and I will try my best to push it forward. AND Thanks to all reviewers (too numerous to mention).
- He Xiaoqiao On Tue, Dec 22, 2020 at 8:32 AM Wei-Chiu Chuang <weic...@apache.org> wrote: > We should target > 3.4.0, > 3.3.1 > 3.2.3 (or 3.2.2) > > I updated and set 3.3.0 released in YARN. > > > Time to clean up some of the old releases. I'll do that. > On Mon, Dec 21, 2020 at 4:04 PM Eric Badger > <ebad...@verizonmedia.com.invalid> wrote: > >> I've committed https://issues.apache.org/jira/browse/YARN-10540. >> Xiaoqiao, >> feel free to cherry-pick this into the 3.2.2 release branch if you think >> it >> is relevant. >> >> Also, can someone tell me which releases we should be targeting? Currently >> these versions are all Unreleased on JIRA: >> 3.4.1, 3.4.0 >> 3.3.1, 3.3.0 >> 3.2.3, 3.2.2 >> >> As far as I know, neither trunk nor 3.3 have a release going on. So I >> don't >> know why there are 2 versions as unreleased there. >> >> Eric >> >> On Mon, Dec 21, 2020 at 3:20 PM Jim Brennan >> <james.bren...@verizonmedia.com.invalid> wrote: >> >> > I put up a patch for >> > >> https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_YARN-2D10540&d=DwIFaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=KVdP1SUmHYb-tZP8tcigmw&m=WEMl9mt9SZiq7P20DPgeZO69TFwf3d0eldQGRWlLyQg&s=FdkrkiWqHwuibT6qFqvApTkO5aTimLx7WeP74tka5XM&e= >> > . >> > Thanks for bringing it to my attention. >> > Jim >> > >> > On Mon, Dec 21, 2020 at 10:36 AM Sunil Govindan <sun...@apache.org> >> wrote: >> > >> > > I had some offline talks with a few folks. >> > > This issue is happening only in Mac, hence ideally it does not cause >> much >> > > of a problem in the supported OS. >> > > >> > > I will wait for feedback here to see whether we need another RC by >> fixing >> > > this. And will continue the discussion in the jira. >> > > >> > > Thanks >> > > Sunil >> > > >> > > On Sat, Dec 19, 2020 at 11:07 PM Sunil Govindan <sun...@apache.org> >> > wrote: >> > > >> > > > Thanks, Xiaoqiao. >> > > > All files are looking good. >> > > > >> > > > However, while I did the tests to verify the RC, I ran into a >> serious >> > NPE >> > > > in YARN. >> > > > I raised YARN-10540 < >> > > >> > >> https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_YARN-2D10540&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=8i-pN_j9VKNxmOzU6gYGtWm_IVyeZkBcMwVI2eyzpRk&e= >> > > > to >> > > > analyze this further. I think this issue due to YARN-10450 >> > > > < >> > > >> > >> https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_YARN-2D10450&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=QEHMGtEbBz5Gn7mW4UsGlc-wNZ8ugZwiFQBy2pTx-Fw&e= >> > > >. >> > > > In the trunk, I am not able to see this issue. So It could be >> possible >> > > > that some patches are not backported to branch-3.2.2. >> > > > >> > > > UI1 & UI2 nodes page is not working at this moment. I will check a >> bit >> > > > more to see about this and update here. >> > > > >> > > > Thanks >> > > > Sunil >> > > > >> > > > On Sat, Dec 19, 2020 at 5:36 PM Xiaoqiao He <hexiaoq...@apache.org> >> > > wrote: >> > > > >> > > >> Thanks Sunil, md5 files have been removed from RC4. Please have a >> > look. >> > > >> Thanks & Regards. >> > > >> >> > > >> - He Xiaoqiao >> > > >> >> > > >> On Sat, Dec 19, 2020 at 7:22 PM Sunil Govindan <sun...@apache.org> >> > > wrote: >> > > >> >> > > >>> Hi Xiaoqiao, >> > > >>> >> > > >>> Please remove the md5 files from your shared RC4 repo. Thanks, >> @Akira >> > > >>> Ajisaka <aajis...@apache.org> for sharing this input. >> > > >>> >> > > >>> Thanks >> > > >>> Sunil >> > > >>> >> > > >>> On Sat, Dec 19, 2020 at 10:21 AM Sunil Govindan < >> sun...@apache.org> >> > > >>> wrote: >> > > >>> >> > > >>>> Reference: >> > > >>>> >> > > >> > >> https://urldefense.proofpoint.com/v2/url?u=https-3A__www.apache.org_dev_release-2Ddistribution.html-23sigs-2Dand-2Dsums&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=0qrQgqFXZzLqTDPzH_T1emam7NnHvnzXqZ6Ag0ccgIQ&e= >> > > >>>> Also, we had a Jira to track this HADOOP-15930 >> > > >>>> < >> > > >> > >> https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_HADOOP-2D15930&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=afUJEs9zxobnuEnC4v0xJ6v7d0dtrUkUaX15lI6VZbM&e= >> > > >. >> > > >>>> >> > > >>>> Thanks >> > > >>>> Sunil >> > > >>>> >> > > >>>> On Sat, Dec 19, 2020 at 10:16 AM Sunil Govindan < >> sun...@apache.org> >> > > >>>> wrote: >> > > >>>> >> > > >>>>> Hi Xiaoqiao and Wei-chiu >> > > >>>>> >> > > >>>>> I am a bit confused after seeing both *.sha512 and *.md5 files >> in >> > the >> > > >>>>> RC directory. >> > > >>>>> Are we releasing both now? >> > > >>>>> >> > > >>>>> Thanks >> > > >>>>> Sunil >> > > >>>>> >> > > >>>>> On Wed, Dec 9, 2020 at 10:32 PM Xiaoqiao He < >> hexiaoq...@apache.org >> > > >> > > >>>>> wrote: >> > > >>>>> >> > > >>>>>> Hi folks, >> > > >>>>>> >> > > >>>>>> The release candidate (RC4) for Hadoop-3.2.2 is available now. >> > > >>>>>> There are 10 commits[1] differences between RC4 and RC3[2]. >> > > >>>>>> >> > > >>>>>> The RC4 is available at: >> > > >>>>>> >> > > >> > >> https://urldefense.proofpoint.com/v2/url?u=http-3A__people.apache.org_-7Ehexiaoqiao_hadoop-2D3.2.2-2DRC4&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=HUI5h2vNLugUtOGnApsEXpk40-hQszUQyUNbfYRQeXU&e= >> > > >>>>>> The RC4 tag in github is here: >> > > >>>>>> >> > > >> > >> https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_hadoop_tree_release-2D3.2.2-2DRC4&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=Z3pv4v__QPeuKK5Ol_DOqKD-3deFnGKSfXdhi0v_K1c&e= >> > > >>>>>> The maven artifacts are staged at: >> > > >>>>>> >> > > >>>>>> >> > > >> > >> https://urldefense.proofpoint.com/v2/url?u=https-3A__repository.apache.org_content_repositories_orgapachehadoop-2D1296&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=XA6ozoshoAKllmFj5vMTlXjE-8Ee41jaKYiTxBmnWpA&e= >> > > >>>>>> >> > > >>>>>> You can find my public key at: >> > > >>>>>> >> > > >> > >> https://urldefense.proofpoint.com/v2/url?u=https-3A__dist.apache.org_repos_dist_release_hadoop_common_KEYS&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=oJ2jBABd8kCf9bLKre7vOkc4T010inenJNexdbGlOdg&e= >> > > or >> > > >>>>>> >> > > >> > >> https://urldefense.proofpoint.com/v2/url?u=https-3A__people.apache.org_keys_committer_hexiaoqiao.asc&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=r5d-JXE1QGikxkDXlH-K9P15VaTM_kOtQz0IyBHM_Yk&e= >> > > directly. >> > > >>>>>> >> > > >>>>>> Please try the release and vote. >> > > >>>>>> >> > > >>>>>> I have done a simple testing with my pseudo cluster. >> > > >>>>>> * Verify gpg sign and md5sum. >> > > >>>>>> * Setup pseudo cluster with HDFS and YARN. >> > > >>>>>> * Run simple FsShell - mkdir/put/get/rename/mv. >> > > >>>>>> * Submit example mr job and check the result - Pi/wordcount. >> > > >>>>>> * Check the web UI of >> > NameNode/DataNode/Resourcemanager/NodeManager. >> > > >>>>>> My +1 to start. >> > > >>>>>> >> > > >>>>>> Thanks, >> > > >>>>>> He Xiaoqiao >> > > >>>>>> >> > > >>>>>> [1] >> > > >>>>>> >> > > >>>>>> >> > > >> > >> https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_hadoop_compare_release-2D3.2.2-2DRC3...release-2D3.2.2-2DRC4&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=uUm4bp4BGiN0L04RJ1ny8G0ugpng57O_0Im8zQfMMGc&e= >> > > >>>>>> [2] >> > > >>>>>> >> > > >>>>>> >> > > >> > >> https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.apache.org_thread.html_rfb74c3a5d4f223c5804d8ee622829263740cd8701c8f3fc8b6f970af-2540-253Chdfs-2Ddev.hadoop.apache.org-253E&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=x0gXxcI_Gd1cGJRczQYxrTznWYSJcZqCkUHuUPUjL7w&e= >> > > >>>>>> [3] >> > > >>>>>> >> > > >>>>>> >> > > >> > >> https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_secure_Dashboard.jspa-3FselectPageId-3D12335948&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=9w6gMkXXqF9gv5R3eFWF9fWH5mAJpqw7xXpGKd-XwfU&e= >> > > >>>>>> >> > > >>>>> >> > > >> > >> >
