To follow-up on this thread for anyone who is experiencing similar issues with junit processing and memory usage -
Firstly, we noticed that a specific set of pages were taking the longest to load - the interstitial build number pages that show changes, scm revisions, and a Test Result link (e.g. https://jenkins/job/myjob/43980/). Secondly, we noticed that the longer the job ran without someone actively loading one of the interstitial build pages, the worse the problem became. For example, attempting to load one of these pages after a weekend with no activity could take upwards of a minute. Finally, if the most recent interstitial job page was loaded by a single user, all of the other pages then became responsive for all users. Our workaround for the time being is a cron job that pre-loads these interstitial pages using curl. We were pleasantly surprised this worked at all and we are anxious to better understand what is causing this new blocking behavior. 0 * * * * jenkins lastBuild=`ls -ltr /var/lib/jenkins/jobs/myjob/builds | tail -1 | awk '{print $9}'`; curl -k https://jenkins/job/myjob/$lastBuild/ > /tmp/$lastBuild.output On Tuesday, September 29, 2015 at 11:09:46 AM UTC-7, brother kevin wrote: > > The problem returned after changing the max builds back to 500 for the job > in question. We kept upping the -Xmx value and jenkins continued to run > out of memory and the web ui would become unusable, with most requests > timing out. > > We eventually settled on -Xmx16384M and the jenkins monitoring plugin > showed the junit xml processing cresting the 16GB watermark. > > We upgraded from v1.8 of the junit plugin, to the latest version v1.9, and > experienced the same excessive memory usage. > > The junit.xml file has includes 51,000 tests and is about 17MB in size. > Is that indicative of a job that has too many tests within it? > > Please advise, we have turned off junit processing on the job in question > and our memory usage has dropped to below 4GB. > > Thank you! > >> -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/922ed56a-d029-48cb-a5b1-6fd6b6e20676%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
