Re: NuttX Nightly Build Jenkins CI Job Ready Now

2020-02-27 Thread Xiang Xiao
Now the nightly build include all most boards under arm, mips, risc-v, sim and x86, there is still some improvement need from community: 1.Some boards under arm, risc-v and sim still can't pass the build, you can see the full list here(start with -): https://github.com/apache/incubator-nuttx-

NuttX Nightly Build Jenkins CI Job Ready Now

2020-02-27 Thread Haitao Liu
Hi, all: NuttX nightly build is coming now: https://builds.apache.org/job/NuttX-Nightly-Build/ Now it's a freestyle project CI job. It could switch to pipeline CI job later which is more functional as Miguel has proposaled. Nightly build job schedule settings as below: a. Build Triggers: The j

Re: Jenkins CI

2020-02-18 Thread Miguel Ángel Herranz
created, is stored in a Jenkinsfile or in Groovy pipeline script, so the workflow can be updated by a PR as in Github. Moreover, if using shared libraries, the logic can reside in another repository, as Greg requested. I don't know if that is possible with Github. > So, I think we could c

Re: Jenkins CI

2020-02-12 Thread Haitao Liu
After practise with Apache Jenkins CI and Github action CI for a time and do some CI problems search in Apache maillist and google, let's sum up as below: Apache Jenkins |Github a

Re: Jenkins CI

2020-02-04 Thread Miguel Ángel Herranz
Hi Haitao, I will take a look. By the way, do Apache Jenkins slave includes Docker? Or alternatively, does Apache Jenkins have Docker Slave [1] plugin available? If we could use either launch Docker containers in the slave or launch the jobs in a Docker container we could use an image with all t

Re: Jenkins CI

2020-02-04 Thread Haitao Liu
Thanks Xiang! Another PR https://github.com/apache/incubator-nuttx-testing/pull/4 since Apache jenkins slave haven't gperf preinstalled, so switch to use our owned prebuilt gperf. Xiang and Miguel please help to review. Or in another way, may I ask Justin Apache Infra team to apt-get install gperf

Re: Jenkins CI

2020-02-03 Thread Xiang Xiao
I will merge it. On Tue, Feb 4, 2020 at 12:50 PM Haitao Liu wrote: > > Hi, Greg, > Thanks to Miguel's careful review, could you please help to finish the PR > merge? > Then I and Miguel can continue the development with more PRs and refinement. > > Gregory Nutt 于2020年1月31日周五 下午11:30写道: > > > > >

Re: Jenkins CI

2020-02-03 Thread Haitao Liu
Hi, Greg, Thanks to Miguel's careful review, could you please help to finish the PR merge? Then I and Miguel can continue the development with more PRs and refinement. Gregory Nutt 于2020年1月31日周五 下午11:30写道: > > > I have just added the CI scripts and testlist files in > > https://github.com/apache

Re: Jenkins CI

2020-01-31 Thread Miguel Ángel Herranz
On Fri, Jan 31, 2020 at 4:30 PM Gregory Nutt wrote: > > Perhaps Miguel could provide the review of PR3. I will be happy to > finish the merge after some review is provided. > > I can review the script, but maybe mostly generic (not too specific to NuttX though). > Once it has been merged, both

Re: Jenkins CI

2020-01-31 Thread Miguel Ángel Herranz
On Fri, Jan 31, 2020 at 4:17 PM Haitao Liu wrote: > Hi, Miguel, > > I have just added the CI scripts and testlist files in > https://github.com/apache/incubator-nuttx-testing/pull/3 > And asked XiaoXiang help to create Nuttx Nightly build job in > builds.apache.org before. But it's just a freesty

Re: Jenkins CI

2020-01-31 Thread Gregory Nutt
I have just added the CI scripts and testlist files in https://github.com/apache/incubator-nuttx-testing/pull/3 And asked XiaoXiang help to create Nuttx Nightly build job in builds.apache.org before. But it's just a freestyle CI job which call cibuild.sh simply. Once CI script and testlist file

Re: Jenkins CI

2020-01-31 Thread Haitao Liu
Hi, Miguel, I have just added the CI scripts and testlist files in https://github.com/apache/incubator-nuttx-testing/pull/3 And asked XiaoXiang help to create Nuttx Nightly build job in builds.apache.org before. But it's just a freestyle CI job which call cibuild.sh simply. Once CI script and test

Re: Jenkins CI

2020-01-30 Thread Miguel Ángel Herranz
On Tue, Jan 28, 2020 at 8:58 PM Justin Mclean wrote: ... > You would need to submit an ICLA. The CCLA is for more for your employer > benefit not ours. Hi Justin, sorry for the delay in answering. In that case there is no need to delay I guess. I have just sent the ICLA and waiting for confirm

Re: Jenkins CI

2020-01-28 Thread Justin Mclean
Hi, > Thanks, good to know. I am asking my employer about including me in a > corporate one (CCLA [1]), but if it is too much paperwork I guess I can > just submit the ICLA. You would need to submit an ICLA. The CCLA is for more for your employer benefit not ours. Thanks, Justin

Re: Jenkins CI

2020-01-28 Thread Miguel Ángel Herranz
Hi, after some research about new releases of Jenkins, it seems that my proposal can be improved towards a simpler setup, so I modified it. I have included some code as pull requests that could be useful to discuss upon: https://github.com/apache/incubator-nuttx-testing/pull/2 and https://github.

Re: Jenkins CI

2020-01-21 Thread Miguel Ángel Herranz
> We probably can get infra to add you, submitting an ICLA might help as that could be used to create an account. Thanks, good to know. I am asking my employer about including me in a corporate one (CCLA [1]), but if it is too much paperwork I guess I can just submit the ICLA. Let's see. [1] http

Re: Jenkins CI

2020-01-20 Thread Justin Mclean
Hi, > Oh, I did check that wiki page but I was not aware that it was a > requirement to be a comitter or PPMC member to have an LDAP account, but it > makes sense, thanks anyway. We probably can get infra to add you, submitting an ICLA might help as that could be used to create an account. Than

Re: Jenkins CI

2020-01-20 Thread Miguel Ángel Herranz
> I can give people Jenkin admin access but they need to be in LDAP. [1] that means you need to be a committer or PPMC member. Oh, I did check that wiki page but I was not aware that it was a requirement to be a comitter or PPMC member to have an LDAP account, but it makes sense, thanks anyway. I

Re: Jenkins CI

2020-01-20 Thread Justin Mclean
Hi, > Also, a request: maybe it would be good to test if Jenkins in > builds.apache.org support pipelines or any Jenkins plugin is missing, so if > I could get the rights to access create a proof-of-concept pipeline to > check everything is available. I can give people Jenkin admin access but the

Re: Jenkins CI

2020-01-20 Thread Miguel Ángel Herranz
> You should have permission now. Thanks Justin. I have created a draft proposal (postfixing my name like the other one by Brennan Ashton, in case others want to add another proposal from scratch, but contributions are welcome): https://cwiki.apache.org/confluence/display/NUTTX/Continuous+integr

Re: Jenkins CI

2020-01-20 Thread Justin Mclean
Hi, > so good you liked the idea. I tried to create the page in Confluence, but > it seems I don't have enough rights. You should have permission now. Kind Regards, Justin

Re: Jenkins CI

2020-01-20 Thread Miguel Ángel Herranz
Hi Justin and Haitao, so good you liked the idea. I tried to create the page in Confluence, but it seems I don't have enough rights. Can someone else give me the needed rights to add it or create and give edit permissions? My Confluence user in cwiki.apache.org is 'maht' Cheers, Miguel On Fri,

Re: Jenkins CI

2020-01-16 Thread Haitao Liu
Thanks Greg and Abdelatif. I am going to use the Pinguino toolchain at first to let it work, and try the buildroot way later with free time. Gregory Nutt 于2020年1月16日周四 下午10:26写道: > > > In addition, I notice http://www.nuttx.org/Documentation/NuttX.html say > gnu > > toolchains based on buildroo

Re: Jenkins CI

2020-01-16 Thread Haitao Liu
Justin Mclean 于2020年1月17日周五 上午5:19写道: > Hi, > > I think working on a CI document together it a great idea. > > I also agree with Miguel's idea to working on a CI document. So save and inspire more best practices in CI. > - What architectures we want to include: all of them? (list them) some of

Re: Jenkins CI

2020-01-16 Thread Justin Mclean
Hi, I think working on a CI document together it a great idea. > - What architectures we want to include: all of them? (list them) some of > them can be deferred until "Perfect CI"? do Apache Jenkins have the machine > for that architectures? if not ... are there emulators? and the toolchains? >

Re: Jenkins CI

2020-01-16 Thread Miguel Ángel Herranz
TLDR: I think we need to make a "CI requirements and design" Draft Proposal (https://cwiki.apache.org/confluence/display/NUTTX/Draft+Proposals) --- Hi, I think that in order to get a working CI as soon as possible we need to please define a plan in a coordinated way. I think "perfection" is the

Re: Jenkins CI

2020-01-16 Thread Gregory Nutt
In addition, I notice http://www.nuttx.org/Documentation/NuttX.html say gnu toolchains based on buildroot for many architectures. There are configurations at https://bitbucket.org/nuttx/buildroot/src/master/configs/ for: avr-defconfig-4.3.3 avr-defconfig-4.5.2 I am not sure of the state o

Re: Jenkins CI

2020-01-16 Thread Gregory Nutt
Hi, Greg, may I ask where you find the right mips gcc toolchain? I haven't found an official prebuilt mips gcc toolchain yet(mips.com connect failed here). Or build it from source code. I was talking with Abdelatif about this a few days ago.  He is the MIPS/PIC32 expert on the team.  We are

Re: Jenkins CI

2020-01-16 Thread Haitao Liu
Thanks very much, It really works after correct some mips-elf-gcc/ld etc symlinks. In addition, I notice http://www.nuttx.org/Documentation/NuttX.html say gnu toolchains based on buildroot for many architectures. So for AVR gcc toolchains, I just found https://www.microchip.com/mplab/avr-support/av

Re: Jenkins CI

2020-01-16 Thread Abdelatif Guettouche
Hi Haitao, You can use this https://github.com/PinguinoIDE/pinguino-compilers Even though it hasn't been updated for years, it does the job. On Thu, Jan 16, 2020 at 1:46 PM Haitao Liu wrote: > > Hi, Greg, may I ask where you find the right mips gcc toolchain? > I haven't found an official prebui

Re: Jenkins CI

2020-01-16 Thread Haitao Liu
Hi, Greg, may I ask where you find the right mips gcc toolchain? I haven't found an official prebuilt mips gcc toolchain yet(mips.com connect failed here). Or build it from source code. Gregory Nutt 于2020年1月9日周四 上午11:55写道: > > > Thanks, I think we can firstly get start in Linux and Windows. Then

Re: Jenkins CI

2020-01-10 Thread Miguel Ángel Herranz
On Fri, Jan 10, 2020 at 2:12 PM Justin Mclean wrote: > Hi, > > > One request: I checked the Jenkins and it seems that the job > configuration > > is not accessible without having an account, and you have to be a > committer > > and must be a member of the hudson-jobadmin group > > I can add peopl

Re: Jenkins CI

2020-01-10 Thread Justin Mclean
Hi, > One request: I checked the Jenkins and it seems that the job configuration > is not accessible without having an account, and you have to be a committer > and must be a member of the hudson-jobadmin group I can add people to that as needed. I created jobs and given access o people in the p

Re: Jenkins CI

2020-01-10 Thread Miguel Ángel Herranz
s a reasonable approach. And now prepare to use Apache > Infra Jenkins CI firstly. > Yes, probably the best approach is to prepare CI jobs in a traditional way, and once it is almost stable and you and people involved have less work with it start to translating it to something versionabl

Re: Jenkins CI

2020-01-09 Thread Haitao Liu
Thanks Miguel share your approach. We'll look into it, the aim for NuttX is keep nuttx/ and apps/ user-end projects clean and do not mess up with CI stuffs. And now prepare to use Apache Infra Jenkins CI firstly. Miguel Ángel Herranz 于2020年1月9日周四 下午7:45写道: > Hi, > > I have conf

Re: Jenkins CI

2020-01-09 Thread Haitao Liu
That's great nuttx-testing project is available. I think empty nuttx-testing project is ok now. We'll put the CI scripts and testing related stuff here later. So sum up, in my opinion, there would be four CI jobs for NuttX projects: 1 One incubator-nuttx-website CI Job: Once commit merged i

Re: Jenkins CI

2020-01-09 Thread Gregory Nutt
Haitao, Would you like me to initialize the repository?  I can do that for you if you like with apps/ and nuttx/ as submodules but nothing else. Greg

Re: Jenkins CI

2020-01-09 Thread Adam Feuer
Haitao, Cool! Anywhere in a public git repo is great; nuttx testing project also sounds great. cheers adam On Thu, Jan 9, 2020 at 12:08 AM Haitao Liu wrote: > In my opinion, Jenkins CI scripts could be version controlled firstly > locally or my github. > Once the whole process is f

Re: Jenkins CI

2020-01-09 Thread Gregory Nutt
Or https://github.com/NuttX/tools would be better to hold the jenkins CI scripts in this period? Let's please not use nuttx/tools.  Let's not let any testing framework develop inside of the RTOS. I have created this for you https://github.com/apache/incubator-nuttx-testing s

Re: Jenkins CI

2020-01-09 Thread Gregory Nutt
In my opinion, Jenkins CI scripts could be version controlled firstly locally or my github. Once the whole process is functional, I think the best place is to put them into nuttx testing project if available. We need to request the creation of the NuttX testing repository. I created the

Re: Jenkins CI

2020-01-09 Thread Gregory Nutt
In configure.sh, there are four wenv options for windows as below: -c selects the Windows host and Cygwin (c) environment. -u selects the Windows host and Ubuntu under Windows 10 (u) environment. -g selects the Windows host and MinGW/MSYS environment. -n selects the Windows

Re: Jenkins CI

2020-01-09 Thread Gregory Nutt
In my opinion, Jenkins CI scripts could be version controlled firstly locally or my github. Once the whole process is functional, I think the best place is to put them into nuttx testing project if available. We need to request the creation of the NuttX testing repository. I created the new

Re: Jenkins CI

2020-01-09 Thread Miguel Ángel Herranz
Hi, I have configured Jenkins CI pipelines in the past and aside the scripts running in the jobs, managing the jobs definition in the UI can be a pain, since is easy to apply untrackable changes that impact the pipeline. So I am wondering if you are going to use any kind of solution like Jenkins

Re: Jenkins CI

2020-01-09 Thread Haitao Liu
Or https://github.com/NuttX/tools would be better to hold the jenkins CI scripts in this period? Haitao Liu 于2020年1月9日周四 下午4:08写道: > In my opinion, Jenkins CI scripts could be version controlled firstly > locally or my github. > Once the whole process is functional, I think the best pl

Re: Jenkins CI

2020-01-09 Thread Haitao Liu
In my opinion, Jenkins CI scripts could be version controlled firstly locally or my github. Once the whole process is functional, I think the best place is to put them into nuttx testing project if available. Adam Feuer 于2020年1月9日周四 下午12:51写道: > Haitao, > > Will the Jenkins CI script

Re: Jenkins CI

2020-01-09 Thread Haitao Liu
Gregory Nutt 于2020年1月9日周四 上午11:55写道: > > > Thanks, I think we can firstly get start in Linux and Windows. Then > > consider how to setup Mac later, donate slave or other. > > Two other question, nuttx uses some cross compile toolchains etc. In > > addition, Cygwin or MinGW is in need once nuttx b

Re: Jenkins CI

2020-01-08 Thread Adam Feuer
On Wed, Jan 8, 2020 at 7:55 PM Gregory Nutt wrote: > I suspect you could substitute FreeBSD for macOS and also catch most if > not all macOS build issues. I think you could also require installing coreutils via brew or macports, they both have it. On macOS I can't imagine trying to build NuttX

Re: Jenkins CI

2020-01-08 Thread Adam Feuer
Haitao, Will the Jenkins CI scripts live in version control somewhere? cheers adam On Wed, Jan 8, 2020 at 7:44 PM Haitao Liu wrote: > Ok, get it. Thanks! > > Justin Mclean 于2020年1月9日周四 上午11:07写道: > > > Hi, > > > > > Thanks, I think we can firstly get

Re: Jenkins CI

2020-01-08 Thread Gregory Nutt
Thanks, I think we can firstly get start in Linux and Windows. Then consider how to setup Mac later, donate slave or other. Two other question, nuttx uses some cross compile toolchains etc. In addition, Cygwin or MinGW is in need once nuttx built under Windows slaves. Should we ask for Apache I

Re: Jenkins CI

2020-01-08 Thread Haitao Liu
Ok, get it. Thanks! Justin Mclean 于2020年1月9日周四 上午11:07写道: > Hi, > > > Thanks, I think we can firstly get start in Linux and Windows. Then > > consider how to setup Mac later, donate slave or other. > > Two other question, nuttx uses some cross compile toolchains etc. In > > addition, Cygwin or

Re: Jenkins CI

2020-01-08 Thread Justin Mclean
Hi, > Thanks, I think we can firstly get start in Linux and Windows. Then > consider how to setup Mac later, donate slave or other. > Two other question, nuttx uses some cross compile toolchains etc. In > addition, Cygwin or MinGW is in need once nuttx built under Windows slaves. > Should we ask f

Re: Jenkins CI

2020-01-08 Thread Haitao Liu
Infra to help install in slave machines? Justin Mclean 于2020年1月9日周四 上午10:14写道: > Hi, > > > I have some questions about Apache Infra. Since NuttX would be built > under > > Linux/Mac/Windows environment, does Apache Infra Jenkins CI provides Mac > > and Windows slav

Re: Jenkins CI

2020-01-08 Thread Justin Mclean
Hi, > I have some questions about Apache Infra. Since NuttX would be built under > Linux/Mac/Windows environment, does Apache Infra Jenkins CI provides Mac > and Windows slave machines to ease CI build? There was a mac machine, but I think it was removed a while back. There are windows

Re: Jenkins CI

2020-01-08 Thread Haitao Liu
Hi, Justin, I have some questions about Apache Infra. Since NuttX would be built under Linux/Mac/Windows environment, does Apache Infra Jenkins CI provides Mac and Windows slave machines to ease CI build? Justin Mclean 于2020年1月8日周三 下午12:00写道: > Hi, > > Changing subjects. > > >

Re: Jenkins CI

2020-01-08 Thread Xiang Xiao
gende geschreven: > > > > > >  > > >> > > >>> Since code check part is available now, could I and Duo prepare to > > setup > > >>> Jenkins CI job firstly? > > >> Where are you intending to set up this job? Here [1] or elsewhere? > > > > > > Hopefully not in the end-user directories :-\ > > > > > > Greg > > > > >

Re: Jenkins CI

2020-01-08 Thread Haitao Liu
>> > >>> Since code check part is available now, could I and Duo prepare to > setup > >>> Jenkins CI job firstly? > >> Where are you intending to set up this job? Here [1] or elsewhere? > > > > Hopefully not in the end-user directories :-\ > > > > Greg > > >

Re: Jenkins CI

2020-01-07 Thread Haitao Liu
In my opionion, it's best setup job here in https://builds.apache.org Justin Mclean 于2020年1月8日周三 下午12:00写道: > Hi, > > Changing subjects. > > > Since code check part is available now, could I and Duo prepare to setup > > Jenkins CI job firstly? > > Where a

Re: Jenkins CI

2020-01-07 Thread Haitao Liu
Greg, all the CI specific scripts would only be in Jenkins Job Server. They won't come into nuttx/ and apps/ end-user directories. Gregory Nutt 于2020年1月8日周三 下午12:03写道: > >> Since code check part is available now, could I and Duo prepare to setup > >> Jenkins CI job fir

Re: Jenkins CI

2020-01-07 Thread Disruptive Solutions
eft Gregory Nutt het volgende > geschreven: > >  >> >>> Since code check part is available now, could I and Duo prepare to setup >>> Jenkins CI job firstly? >> Where are you intending to set up this job? Here [1] or elsewhere? > > Hopefully not in the end-user directories :-\ > > Greg >

Re: Jenkins CI

2020-01-07 Thread Gregory Nutt
Since code check part is available now, could I and Duo prepare to setup Jenkins CI job firstly? Where are you intending to set up this job? Here [1] or elsewhere? Hopefully not in the end-user directories :-\ Greg

Jenkins CI

2020-01-07 Thread Justin Mclean
Hi, Changing subjects. > Since code check part is available now, could I and Duo prepare to setup > Jenkins CI job firstly? Where are you intending to set up this job? Here [1] or elsewhere? Thanks, Justin 1. https://builds.apache.org