ok, things are looking good... i'll definitely be keeping an eye on this worker, but it looks like the ivy cache somehow got poisoned and affected the builds.
it's still not clear to me *how* this happened, but *what* happened is clear: the ivydata properties file for oro is-local=true for the jar, and then it was barfing while parsing the local file: path. all other properties files on the workers have that flag set to false, and a nice url pointing to repo1.maven.org. after wiping the .ivy2 repo, it was repopulated and the flag (on -03) is now set to false, and we're good. shane On Wed, May 6, 2015 at 10:12 AM, shane knapp <skn...@berkeley.edu> wrote: > ok, i looked deeper and this is only happening on -03, and not linked > specifically to the pull request builder: > 3 NewSparkPullRequestBuilder > 13 Spark-Master-SBT > 4 Spark-1.4-SBT > 49 SparkPullRequestBuilder > > also, it started at ~3pm on this past sunday... and nothing was done to > this worker then. :\ > > anyways, to continue testing and make sure we have no poisoned caches, i > nuked the ivy, sbt and maven caches, as well as wiping the jenkins > workspace. > > i'll be turning on this worker, and i set up some monitoring and will be > watching it today. > > if this fails, i'll just wipe and reinstall the node. sorry for the > inconvenience! > > On Tue, May 5, 2015 at 3:08 PM, shane knapp <skn...@berkeley.edu> wrote: > >> alright, this is happening again w/this worker and i will be taking it >> offline for further investigation. i'm OOO for the rest of the day, but >> will check in again later this evening. >> >> On Tue, May 5, 2015 at 9:33 AM, shane knapp <skn...@berkeley.edu> wrote: >> >>> ok, i reset the maven cache on amp-jenkins-worker-03 and some stuff is >>> currently building and not failing... i'll keep a close eye on this for >>> now. >>> >>> On Tue, May 5, 2015 at 9:15 AM, shane knapp <skn...@berkeley.edu> wrote: >>> >>>> hmm, still happening. looking deeper. >>>> >>>> On Tue, May 5, 2015 at 8:54 AM, shane knapp <skn...@berkeley.edu> >>>> wrote: >>>> >>>>> taking a look now. >>>>> >>>>> On Tue, May 5, 2015 at 3:23 AM, Patrick Wendell <pwend...@gmail.com> >>>>> wrote: >>>>> >>>>>> For unknown reasons, pull requests on Jenkins worker 3 have been >>>>>> failing with an exception[1]. After trying to fix this by clearing the >>>>>> ivy and maven caches on the node, I've given up and simply blacklisted >>>>>> that worker. >>>>>> >>>>>> [error] oro#oro;2.0.8!oro.jar origin location must be absolute: >>>>>> file:/home/jenkins/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar >>>>>> java.lang.IllegalArgumentException: oro#oro;2.0.8!oro.jar origin >>>>>> location must be absolute: >>>>>> file:/home/jenkins/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar >>>>>> at org.apache.ivy.util.Checks.checkAbsolute(Checks.java:57) >>>>>> at >>>>>> org.apache.ivy.core.cache.DefaultRepositoryCacheManager.getArchiveFileInCache(DefaultRepositoryCacheManager.java:385) >>>>>> at >>>>>> org.apache.ivy.core.cache.DefaultRepositoryCacheManager.download(DefaultRepositoryCacheManager.java:849) >>>>>> at >>>>>> org.apache.ivy.plugins.resolver.BasicResolver.download(BasicResolver.java:835) >>>>>> at >>>>>> org.apache.ivy.plugins.resolver.RepositoryResolver.download(RepositoryResolver.java:282) >>>>>> at >>>>>> org.apache.ivy.plugins.resolver.ChainResolver.download(ChainResolver.java:219) >>>>>> at >>>>>> org.apache.ivy.plugins.resolver.ChainResolver.download(ChainResolver.java:219) >>>>>> at >>>>>> org.apache.ivy.core.resolve.ResolveEngine.downloadArtifacts(ResolveEngine.java:388) >>>>>> at >>>>>> org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java:331) >>>>>> at org.apache.ivy.Ivy.resolve(Ivy.java:517) >>>>>> at sbt.IvyActions$.sbt$IvyActions$$resolve(IvyActions.scala:266) >>>>>> at sbt.IvyActions$$anonfun$updateEither$1.apply(IvyActions.scala:175) >>>>>> at sbt.IvyActions$$anonfun$updateEither$1.apply(IvyActions.scala:157) >>>>>> at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:151) >>>>>> at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:151) >>>>>> at sbt.IvySbt$$anonfun$withIvy$1.apply(Ivy.scala:128) >>>>>> at sbt.IvySbt.sbt$IvySbt$$action$1(Ivy.scala:56) >>>>>> at sbt.IvySbt$$anon$4.call(Ivy.scala:64) >>>>>> ... >>>>>> >>>>> >>>>> >>>> >>> >> >
