Re: Nightly Jenkins CI for Hadoop on Windows 10

2023-05-13 Thread Gautham Banasandra
Thanks Ayush. Yeah, it seems like the 6 hours limitation is going to be an issue.Let me pursue the precommit CI setup for Windows 10 for now. Thanks, --Gautham On Wed, 10 May 2023 at 04:53, Ayush Saxena wrote: > One thing I forgot to mention. If you are planning to run tests also for > Windows

Re: Nightly Jenkins CI for Hadoop on Windows 10

2023-05-09 Thread Ayush Saxena
One thing I forgot to mention. If you are planning to run tests also for Windows OS then github actions isn’t something to be chased. It has 6 hrs timeout. So, in case of multi module changes or root level changes, we will get screwed, the tests take more than 20 hrs in those cases, so we will hit

Re: Nightly Jenkins CI for Hadoop on Windows 10

2023-05-09 Thread Ayush Saxena
Hi Gautham, The only advantage I can think of is your limitation to nodes shouldn’t bother much. Though there are limited resources given to Apache but still never observed any starvation in any project for the resources using Github Actions. If Precommit CI for windows is there and it can work in

Re: Nightly Jenkins CI for Hadoop on Windows 10

2023-05-09 Thread Ayush Saxena
Awesome!!! Do you plan to run some builds per PR to ensure no commits breaks it in the future? Worth exploring GithubActions in the later stages if we can have an action for maven install on windows, it won't affect the normal build time as well. can run in parallel with the existing builds. -Ayu

Re: Nightly Jenkins CI for Hadoop on Windows 10

2023-05-09 Thread Gautham Banasandra
Hi Ayush, I was planning to set up the precommit CI job for Windows 10, so that we validate each PR against Windows 10. The precommit CI can actually run in parallel to the Linux precommit CI. But I think we've got very few Windows nodes (about 12 I think) compared to the number of Linux nodes (ab

Nightly Jenkins CI for Hadoop on Windows 10

2023-05-08 Thread Gautham Banasandra
Dear Hadoop community, It is my pleasure to announce that I've set up the Nightly Jenkins CI for Hadoop on the Windows 10 platform[1]. The effort mainly involved getting Yetus to run on Windows against Hadoop. The nightly CI will run every 36 hours and send out the build report to the same recipie