RE: Timezone for build servers - all use UTC?

[Gav...]

> -Original Message-
> From: sebb [mailto:seb...@gmail.com]
> Sent: Tuesday, 12 January 2010 3:29 AM
> To: builds@apache.org
> Subject: Timezone for build servers - all use UTC?
> 
> Hudson currently uses UTC.
> 
> Continuum uses PST - please could it also use UTC?
> 
> Not sure what Buildbots use, but again I think they should use UTC.

Yep, all buildbot machines are on UTC.

Gav...

Re: Stepping down as Hudson Admin

[Justin Mason]

Thanks for all the help Nigel!

On Mon, Jan 11, 2010 at 20:24, Tim Ellison  wrote:
> Understood Nige, thanks for the work you put in helping to establish the
> build system. Good luck in your new ventures.
>
> Regards,
> Tim
>
> On 11 Jan 2010 19:55, "Nigel Daley"  wrote:
>
> Justin, Tim, Giri, and Jukka (Hudson Admins),
>
> I've had some changes in my personal and work life that require me to step
> back from some of my extra responsibilities -- unfortunately this is one of
> them.  After 3 years, I'm stepping down as Hudson Admin for Apache and
> signing off these lists.  Contact me directly if you need something.  FWIW,
> Giri works with me so I'll never be that far away.  Giri can serve as
> point-of-contact if there are any issues with the Y! donated/hosted machines
> (minerva, vesta, etc).
>
> It's been a fun 3 years administering the Lucene-become-Apache Hudson
> instance.  Many thanks to Justin for joining me early on in this and the
> rest of you for carrying the butler forward in providing this important
> service!
>
> Cheers,
> Nige
>



-- 
--j.

Re: What is the host config for Continuum?

[sebb]

On 12/01/2010, Brett Porter  wrote:
>
>  On 12/01/2010, at 6:03 AM, sebb wrote:
>
>  > Which version of Ubuntu?
>
>  8.04 LTS. Some of the JDKs are a bit older, which may be a cause.
>
>
>  >
>  > Is there perhaps a VMWare image I could use to try to debug the problem?
>
>
> Only to copy the current one - though getting you a shell account with 
> limited access might be better if that's necessary.
>

If that would allow running mvn and ant, and svn update, that might be
a way forward. Ideally need to test using Java 1.6 and 1.5/1.4

>  >
>  > The slow turn-round on the Continuum server makes debugging it rather 
> tedious.
>
>
> Which aspect is slow - waiting for the default hourly schedule, or some other 
> aspect?

Waiting for the build to occur - it takes at least 3 hours for the
build to turn round, even if the build is triggered manually. It's
also really difficult to tell if the build has been triggered OK
(though the email will show this).

>  Which build result email are you concerned about? I can at least gather some 
> more details first and see if we can narrow down the cause.
>

Unfortunately, the last 2 builds succeeded (just after I added a bit
more debug!), but there have been several earlier failures, see:

http://vmbuild.apache.org/continuum/buildResults.action?projectId=22&projectGroupId=22

Note that the change in build 135 was very minor, and only affected a
debug statement processed after the test completes, so cannot have
fixed the problem:

URL: http://svn.apache.org/viewvc?rev=897906&view=rev
Log:
More debug for Continuum fail

BTW, Phil Steitz has been trying to get an Ant Java 1.5 build going
for Commons DBCP, but not having much luck so far.

>  - Brett
>
>
>  --
>  Brett Porter
>  br...@apache.org
>  http://brettporter.wordpress.com/
>
>
>
>
>

Re: What is the host config for Continuum?

[Phil Steitz]

sebb wrote:
> On 12/01/2010, Brett Porter  wrote:
>>  On 12/01/2010, at 6:03 AM, sebb wrote:
>>
>>  > Which version of Ubuntu?
>>
>>  8.04 LTS. Some of the JDKs are a bit older, which may be a cause.
>>
>>
>>  >
>>  > Is there perhaps a VMWare image I could use to try to debug the problem?
>>
>>
>> Only to copy the current one - though getting you a shell account with 
>> limited access might be better if that's necessary.
>>
> 
> If that would allow running mvn and ant, and svn update, that might be
> a way forward. Ideally need to test using Java 1.6 and 1.5/1.4
> 
>>  >
>>  > The slow turn-round on the Continuum server makes debugging it rather 
>> tedious.
>>
>>
>> Which aspect is slow - waiting for the default hourly schedule, or some 
>> other aspect?
> 
> Waiting for the build to occur - it takes at least 3 hours for the
> build to turn round, even if the build is triggered manually. It's
> also really difficult to tell if the build has been triggered OK
> (though the email will show this).
> 
>>  Which build result email are you concerned about? I can at least gather 
>> some more details first and see if we can narrow down the cause.
>>
> 
> Unfortunately, the last 2 builds succeeded (just after I added a bit
> more debug!), but there have been several earlier failures, see:
> 
> http://vmbuild.apache.org/continuum/buildResults.action?projectId=22&projectGroupId=22
> 
> Note that the change in build 135 was very minor, and only affected a
> debug statement processed after the test completes, so cannot have
> fixed the problem:
> 
> URL: http://svn.apache.org/viewvc?rev=897906&view=rev
> Log:
> More debug for Continuum fail

As mentioned on Commons-dev, joes re-enabled NTP on the guest
(vmbuild) this weekend.  I don't know the details of how time
measurement gets messed up on loaded vmware guests, but it is
conceivable that this had something to do with it.
> 
> BTW, Phil Steitz has been trying to get an Ant Java 1.5 build going
> for Commons DBCP, but not having much luck so far.

What it appears I am going to have to do for that is create a new
project group, as it seems

1) commons builds all inherit a maven build that is impossible to
selectively disable
2) having a maven build environment for one build and an Ant build
environment for a second build does not work.

So I guess I need Continuum karma to create a new project group to
house the ant build.

> 
>>  - Brett
>>
>>
>>  --
>>  Brett Porter
>>  br...@apache.org
>>  http://brettporter.wordpress.com/
>>
>>
>>
>>
>>

Re: What is the host config for Continuum?

[sebb]

On 12/01/2010, Phil Steitz  wrote:
> sebb wrote:
>  > On 12/01/2010, Brett Porter  wrote:
>  >>  On 12/01/2010, at 6:03 AM, sebb wrote:
>  >>
>  >>  > Which version of Ubuntu?
>  >>
>  >>  8.04 LTS. Some of the JDKs are a bit older, which may be a cause.
>  >>
>  >>
>  >>  >
>  >>  > Is there perhaps a VMWare image I could use to try to debug the 
> problem?
>  >>
>  >>
>  >> Only to copy the current one - though getting you a shell account with 
> limited access might be better if that's necessary.
>  >>
>  >
>  > If that would allow running mvn and ant, and svn update, that might be
>  > a way forward. Ideally need to test using Java 1.6 and 1.5/1.4
>  >
>  >>  >
>  >>  > The slow turn-round on the Continuum server makes debugging it rather 
> tedious.
>  >>
>  >>
>  >> Which aspect is slow - waiting for the default hourly schedule, or some 
> other aspect?
>  >
>  > Waiting for the build to occur - it takes at least 3 hours for the
>  > build to turn round, even if the build is triggered manually. It's
>  > also really difficult to tell if the build has been triggered OK
>  > (though the email will show this).
>  >
>  >>  Which build result email are you concerned about? I can at least gather 
> some more details first and see if we can narrow down the cause.
>  >>
>  >
>  > Unfortunately, the last 2 builds succeeded (just after I added a bit
>  > more debug!), but there have been several earlier failures, see:
>  >
>  > 
> http://vmbuild.apache.org/continuum/buildResults.action?projectId=22&projectGroupId=22
>  >
>  > Note that the change in build 135 was very minor, and only affected a
>  > debug statement processed after the test completes, so cannot have
>  > fixed the problem:
>  >
>  > URL: http://svn.apache.org/viewvc?rev=897906&view=rev
>  > Log:
>  > More debug for Continuum fail
>
>
> As mentioned on Commons-dev, joes re-enabled NTP on the guest
>  (vmbuild) this weekend.  I don't know the details of how time
>  measurement gets messed up on loaded vmware guests, but it is
>  conceivable that this had something to do with it.

However, the following build failed:

http://vmbuild.apache.org/continuum/buildResult.action?projectId=22&projectGroupId=22&projectName=&buildId=267564

and this has

Start Time:  Jan 10, 2010 03:13:35 PM PST

which I think is after the NTP fix?

> >
>  > BTW, Phil Steitz has been trying to get an Ant Java 1.5 build going
>  > for Commons DBCP, but not having much luck so far.
>
>
> What it appears I am going to have to do for that is create a new
>  project group, as it seems
>
>  1) commons builds all inherit a maven build that is impossible to
>  selectively disable
>  2) having a maven build environment for one build and an Ant build
>  environment for a second build does not work.
>
>  So I guess I need Continuum karma to create a new project group to
>  house the ant build.
>
>
>  >
>  >>  - Brett
>  >>
>  >>
>  >>  --
>  >>  Brett Porter
>  >>  br...@apache.org
>  >>  http://brettporter.wordpress.com/
>  >>
>  >>
>  >>
>  >>
>  >>
>
>

Hudson - remote builds strange behaviour

[sebb]

There seem to be some odd happenings when JMeter tries to build remotely.

See the forwarded message, which says that the build failed because it
could not find:

java.io.IOException: Cannot run program "ant" (in directory
":
java.io.IOException: error=2, No such file or directory

However, the Console output for the job says:

java.io.IOException: Cannot run program "ant" (in directory
"/home/hudson/hudson-slave/workspace/JMeter-trunk/trunk"):
java.io.IOException: error=2, No such file or directory

Is it possible to login to the slave to see what is really going on here?

-- Forwarded message --
From: Apache Hudson Server 
Date: 12 Jan 2010 13:26
Subject: Build failed in Hudson: JMeter-trunk #801
To: seb...@gmail.com


See 

 --
 Started by timer
 Building remotely on vesta.apache.org (Ubuntu)
 Updating http://svn.apache.org/repos/asf/jakarta/jmeter/trunk
 U xdocs/changes.xml
 U NOTICE
 U 
src/protocol/http/org/apache/jmeter/protocol/http/sampler/HTTPSampler.java
 U 
src/protocol/http/org/apache/jmeter/protocol/http/parser/JTidyHTMLParser.java
 U 
src/protocol/http/org/apache/jmeter/protocol/http/parser/HtmlParsingUtils.java
 U src/components/org/apache/jmeter/assertions/HTMLAssertion.java
 U src/core/org/apache/jmeter/util/XPathUtil.java
 U build.properties
 U README
 U build.xml
 U eclipse.classpath
 D lib/Tidy.jar
 U lib/aareadme.txt
  Ulib
  Ubin/shutdown.sh
  Ubin/stoptest.sh
 At revision 898314
 no change for http://svn.apache.org/repos/asf/jakarta/jmeter/trunk
since the previous build
 [locks-and-latches] Checking to see if we really have the locks
 [locks-and-latches] Have all the locks, build can start
 FATAL: command execution failed.Maybe you need to configure the job
to choose one of your Ant installations?
 java.io.IOException: Cannot run program "ant" (in directory
":
java.io.IOException: error=2, No such file or directory
at java.lang.ProcessBuilder.start(ProcessBuilder.java:459)
at hudson.Proc$LocalProc.(Proc.java:148)
at hudson.Proc$LocalProc.(Proc.java:120)
at hudson.Launcher$LocalLauncher.launch(Launcher.java:633)
at hudson.Launcher$ProcStarter.start(Launcher.java:268)
at hudson.Launcher$RemoteLaunchCallable.call(Launcher.java:775)
at hudson.Launcher$RemoteLaunchCallable.call(Launcher.java:753)
at hudson.remoting.UserRequest.perform(UserRequest.java:104)
at hudson.remoting.UserRequest.perform(UserRequest.java:48)
at hudson.remoting.Request$2.run(Request.java:236)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
 Caused by: java.io.IOException: java.io.IOException: error=2, No such
file or directory
at java.lang.UNIXProcess.(UNIXProcess.java:148)
at java.lang.ProcessImpl.start(ProcessImpl.java:65)
at java.lang.ProcessBuilder.start(ProcessBuilder.java:452)
... 15 more
 [locks-and-latches] Releasing all the locks
 [locks-and-latches] All the locks released

Hudson workspace visibility

[Aristedes Maniatis]

Do we want to make the workspace visible to anonymous users? Will that 
introduce too much load or leak confidential information? I think not on both 
counts.

This came up because Hudson sends emails out to public lists with links that 
would be useful for committers to follow. For example:

  
http://cayenne.markmail.org/search/#query:list%3Aorg.apache.cayenne.commits+page:1+mid:v27h6bwxuilwn63y+state:results



Cheers
Ari


--
-->
Aristedes Maniatis
GPG fingerprint CBFB 84B4 738D 4E87 5E5C  5EFA EF6A 7D2E 3E49 102A

Re: What is the host config for Continuum?

[Brett Porter]

On 12/01/2010, at 10:16 PM, sebb wrote:

> 
> Waiting for the build to occur - it takes at least 3 hours for the
> build to turn round, even if the build is triggered manually.

This should be alleviated as we remove projects no longer building on there, 
and upgrade to better distribute / parallelise the load.

> It's
> also really difficult to tell if the build has been triggered OK
> (though the email will show this)

Not sure what you mean here - it should show queued until it gets its turn to 
run?

> 
>> Which build result email are you concerned about? I can at least gather some 
>> more details first and see if we can narrow down the cause.
>> 
> 
> Unfortunately, the last 2 builds succeeded (just after I added a bit
> more debug!), but there have been several earlier failures, see:

So far it seems to be a timing issue related either to the clock skew or maybe 
load on the box at the time. Let's keep an eye on it and take a look if it 
fails in the same test again.

> BTW, Phil Steitz has been trying to get an Ant Java 1.5 build going
> for Commons DBCP, but not having much luck so far.

I'll add that to the list once we get the projects cleaned up...

- Brett

--
Brett Porter
br...@apache.org
http://brettporter.wordpress.com/

Re: What is the host config for Continuum?

[sebb]

On 12/01/2010, Brett Porter  wrote:
>
>  On 12/01/2010, at 10:16 PM, sebb wrote:
>
>  >
>  > Waiting for the build to occur - it takes at least 3 hours for the
>  > build to turn round, even if the build is triggered manually.
>
>
> This should be alleviated as we remove projects no longer building on there, 
> and upgrade to better distribute / parallelise the load.
>
>
>  > It's
>  > also really difficult to tell if the build has been triggered OK
>  > (though the email will show this)
>
>
> Not sure what you mean here - it should show queued until it gets its turn to 
> run?
>

There is no confirmation from clicking the "Build Now" button.

It's not clear from the queue listing if the entry in the queue is
there because it was scheduled or because it was manually triggered.

I tried triggering Commons DBCP twice just now. It was already in the
DEFAULT_BUILD_QUEUE, so I expected at least 1 other build to be added
at the end of the queue, but there is no sign of another entry.

Clicking on a build entry in the queue takes one to the build results
for the project which is not all that useful.

The e-mailed result (if there is one) will show if the build was
scheduled or manually triggered.

>  >
>  >> Which build result email are you concerned about? I can at least gather 
> some more details first and see if we can narrow down the cause.
>  >>
>  >
>  > Unfortunately, the last 2 builds succeeded (just after I added a bit
>  > more debug!), but there have been several earlier failures, see:
>
>
> So far it seems to be a timing issue related either to the clock skew or 
> maybe load on the box at the time. Let's keep an eye on it and take a look if 
> it fails in the same test again.
>
>
>  > BTW, Phil Steitz has been trying to get an Ant Java 1.5 build going
>  > for Commons DBCP, but not having much luck so far.
>
>
> I'll add that to the list once we get the projects cleaned up...
>
>
>  - Brett
>
>  --
>  Brett Porter
>  br...@apache.org
>  http://brettporter.wordpress.com/
>
>
>
>
>

Re: What is the host config for Continuum?

[Wendy Smoak]

On Tue, Jan 12, 2010 at 5:04 PM, sebb  wrote:
> I tried triggering Commons DBCP twice just now. It was already in the
> DEFAULT_BUILD_QUEUE, so I expected at least 1 other build to be added
> at the end of the queue, but there is no sign of another entry.

If the project is already queued to build, a second entry for the same
project will not be added.

I've just tested it locally and not only is there nothing on the
screen when this happens, the log file is not informative either, you
just get a bunch of:
2010-01-12 17:31:23,638 [btpool0-9] INFO
org.apache.continuum.buildmanager.ParallelBuildsManager  - Project 1
is currently building in DEFAULT_BUILD_QUEUE .  I'll go open an issue
to complain...

You should, however, see a UI change for the *first* forced build.
The icon should change to 'queued build'.  I wouldn't object if
someone wanted to add a text confirmation though.

-- 
Wendy

Re: What is the host config for Continuum?

[sebb]

On 13/01/2010, Wendy Smoak  wrote:
> On Tue, Jan 12, 2010 at 5:04 PM, sebb  wrote:
>  > I tried triggering Commons DBCP twice just now. It was already in the
>  > DEFAULT_BUILD_QUEUE, so I expected at least 1 other build to be added
>  > at the end of the queue, but there is no sign of another entry.
>
>
> If the project is already queued to build, a second entry for the same
>  project will not be added.
>
>  I've just tested it locally and not only is there nothing on the
>  screen when this happens, the log file is not informative either, you
>  just get a bunch of:
>  2010-01-12 17:31:23,638 [btpool0-9] INFO
>  org.apache.continuum.buildmanager.ParallelBuildsManager  - Project 1
>  is currently building in DEFAULT_BUILD_QUEUE .  I'll go open an issue
>  to complain...

I already opened CONTINUUM-2433 as I thnk you have seen.

>  You should, however, see a UI change for the *first* forced build.
>  The icon should change to 'queued build'.  I wouldn't object if
>  someone wanted to add a text confirmation though.

I don't see any icon change on the Project page.
This applies both when I use the "Build Now" button and when I use the
"Build" icon at the RHS of the Build Definitions list entry.

For some reason there are currently no builds active (a few minutes
ago there were loads).
So the icon (if any) should be "Building", not "Queued build", but
that does not appear on the Project page.

I do see the new entry on the "Build Results" page, which does have a
"Building" icon.

Now there is a huge queue again.

I tried Build Now again; DBCP it appears on the Queue page, but I
could not see a difference to the Project page - is the "Build" icon
supposed to change? - and of course it does not appear on the "Build
Results" page.


>  --
>
> Wendy
>