We should target 3.4.0, 3.3.1 3.2.3 (or 3.2.2) I updated and set 3.3.0 released in YARN.
Time to clean up some of the old releases. I'll do that. On Mon, Dec 21, 2020 at 4:04 PM Eric Badger <ebad...@verizonmedia.com.invalid> wrote: > I've committed https://issues.apache.org/jira/browse/YARN-10540. Xiaoqiao, > feel free to cherry-pick this into the 3.2.2 release branch if you think it > is relevant. > > Also, can someone tell me which releases we should be targeting? Currently > these versions are all Unreleased on JIRA: > 3.4.1, 3.4.0 > 3.3.1, 3.3.0 > 3.2.3, 3.2.2 > > As far as I know, neither trunk nor 3.3 have a release going on. So I don't > know why there are 2 versions as unreleased there. > > Eric > > On Mon, Dec 21, 2020 at 3:20 PM Jim Brennan > <james.bren...@verizonmedia.com.invalid> wrote: > > > I put up a patch for > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_YARN-2D10540&d=DwIFaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=KVdP1SUmHYb-tZP8tcigmw&m=WEMl9mt9SZiq7P20DPgeZO69TFwf3d0eldQGRWlLyQg&s=FdkrkiWqHwuibT6qFqvApTkO5aTimLx7WeP74tka5XM&e= > > . > > Thanks for bringing it to my attention. > > Jim > > > > On Mon, Dec 21, 2020 at 10:36 AM Sunil Govindan <sun...@apache.org> > wrote: > > > > > I had some offline talks with a few folks. > > > This issue is happening only in Mac, hence ideally it does not cause > much > > > of a problem in the supported OS. > > > > > > I will wait for feedback here to see whether we need another RC by > fixing > > > this. And will continue the discussion in the jira. > > > > > > Thanks > > > Sunil > > > > > > On Sat, Dec 19, 2020 at 11:07 PM Sunil Govindan <sun...@apache.org> > > wrote: > > > > > > > Thanks, Xiaoqiao. > > > > All files are looking good. > > > > > > > > However, while I did the tests to verify the RC, I ran into a serious > > NPE > > > > in YARN. > > > > I raised YARN-10540 < > > > > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_YARN-2D10540&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=8i-pN_j9VKNxmOzU6gYGtWm_IVyeZkBcMwVI2eyzpRk&e= > > > > to > > > > analyze this further. I think this issue due to YARN-10450 > > > > < > > > > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_YARN-2D10450&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=QEHMGtEbBz5Gn7mW4UsGlc-wNZ8ugZwiFQBy2pTx-Fw&e= > > > >. > > > > In the trunk, I am not able to see this issue. So It could be > possible > > > > that some patches are not backported to branch-3.2.2. > > > > > > > > UI1 & UI2 nodes page is not working at this moment. I will check a > bit > > > > more to see about this and update here. > > > > > > > > Thanks > > > > Sunil > > > > > > > > On Sat, Dec 19, 2020 at 5:36 PM Xiaoqiao He <hexiaoq...@apache.org> > > > wrote: > > > > > > > >> Thanks Sunil, md5 files have been removed from RC4. Please have a > > look. > > > >> Thanks & Regards. > > > >> > > > >> - He Xiaoqiao > > > >> > > > >> On Sat, Dec 19, 2020 at 7:22 PM Sunil Govindan <sun...@apache.org> > > > wrote: > > > >> > > > >>> Hi Xiaoqiao, > > > >>> > > > >>> Please remove the md5 files from your shared RC4 repo. Thanks, > @Akira > > > >>> Ajisaka <aajis...@apache.org> for sharing this input. > > > >>> > > > >>> Thanks > > > >>> Sunil > > > >>> > > > >>> On Sat, Dec 19, 2020 at 10:21 AM Sunil Govindan <sun...@apache.org > > > > > >>> wrote: > > > >>> > > > >>>> Reference: > > > >>>> > > > > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__www.apache.org_dev_release-2Ddistribution.html-23sigs-2Dand-2Dsums&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=0qrQgqFXZzLqTDPzH_T1emam7NnHvnzXqZ6Ag0ccgIQ&e= > > > >>>> Also, we had a Jira to track this HADOOP-15930 > > > >>>> < > > > > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_HADOOP-2D15930&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=afUJEs9zxobnuEnC4v0xJ6v7d0dtrUkUaX15lI6VZbM&e= > > > >. > > > >>>> > > > >>>> Thanks > > > >>>> Sunil > > > >>>> > > > >>>> On Sat, Dec 19, 2020 at 10:16 AM Sunil Govindan < > sun...@apache.org> > > > >>>> wrote: > > > >>>> > > > >>>>> Hi Xiaoqiao and Wei-chiu > > > >>>>> > > > >>>>> I am a bit confused after seeing both *.sha512 and *.md5 files in > > the > > > >>>>> RC directory. > > > >>>>> Are we releasing both now? > > > >>>>> > > > >>>>> Thanks > > > >>>>> Sunil > > > >>>>> > > > >>>>> On Wed, Dec 9, 2020 at 10:32 PM Xiaoqiao He < > hexiaoq...@apache.org > > > > > > >>>>> wrote: > > > >>>>> > > > >>>>>> Hi folks, > > > >>>>>> > > > >>>>>> The release candidate (RC4) for Hadoop-3.2.2 is available now. > > > >>>>>> There are 10 commits[1] differences between RC4 and RC3[2]. > > > >>>>>> > > > >>>>>> The RC4 is available at: > > > >>>>>> > > > > > > https://urldefense.proofpoint.com/v2/url?u=http-3A__people.apache.org_-7Ehexiaoqiao_hadoop-2D3.2.2-2DRC4&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=HUI5h2vNLugUtOGnApsEXpk40-hQszUQyUNbfYRQeXU&e= > > > >>>>>> The RC4 tag in github is here: > > > >>>>>> > > > > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_hadoop_tree_release-2D3.2.2-2DRC4&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=Z3pv4v__QPeuKK5Ol_DOqKD-3deFnGKSfXdhi0v_K1c&e= > > > >>>>>> The maven artifacts are staged at: > > > >>>>>> > > > >>>>>> > > > > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__repository.apache.org_content_repositories_orgapachehadoop-2D1296&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=XA6ozoshoAKllmFj5vMTlXjE-8Ee41jaKYiTxBmnWpA&e= > > > >>>>>> > > > >>>>>> You can find my public key at: > > > >>>>>> > > > > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__dist.apache.org_repos_dist_release_hadoop_common_KEYS&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=oJ2jBABd8kCf9bLKre7vOkc4T010inenJNexdbGlOdg&e= > > > or > > > >>>>>> > > > > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__people.apache.org_keys_committer_hexiaoqiao.asc&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=r5d-JXE1QGikxkDXlH-K9P15VaTM_kOtQz0IyBHM_Yk&e= > > > directly. > > > >>>>>> > > > >>>>>> Please try the release and vote. > > > >>>>>> > > > >>>>>> I have done a simple testing with my pseudo cluster. > > > >>>>>> * Verify gpg sign and md5sum. > > > >>>>>> * Setup pseudo cluster with HDFS and YARN. > > > >>>>>> * Run simple FsShell - mkdir/put/get/rename/mv. > > > >>>>>> * Submit example mr job and check the result - Pi/wordcount. > > > >>>>>> * Check the web UI of > > NameNode/DataNode/Resourcemanager/NodeManager. > > > >>>>>> My +1 to start. > > > >>>>>> > > > >>>>>> Thanks, > > > >>>>>> He Xiaoqiao > > > >>>>>> > > > >>>>>> [1] > > > >>>>>> > > > >>>>>> > > > > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_hadoop_compare_release-2D3.2.2-2DRC3...release-2D3.2.2-2DRC4&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=uUm4bp4BGiN0L04RJ1ny8G0ugpng57O_0Im8zQfMMGc&e= > > > >>>>>> [2] > > > >>>>>> > > > >>>>>> > > > > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.apache.org_thread.html_rfb74c3a5d4f223c5804d8ee622829263740cd8701c8f3fc8b6f970af-2540-253Chdfs-2Ddev.hadoop.apache.org-253E&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=x0gXxcI_Gd1cGJRczQYxrTznWYSJcZqCkUHuUPUjL7w&e= > > > >>>>>> [3] > > > >>>>>> > > > >>>>>> > > > > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_secure_Dashboard.jspa-3FselectPageId-3D12335948&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=9w6gMkXXqF9gv5R3eFWF9fWH5mAJpqw7xXpGKd-XwfU&e= > > > >>>>>> > > > >>>>> > > > > > >