There are a few dependencies on various data files. For example www-site does
depend on the incubator's podlings.xml which is a hand edited file managed by
the IPMC. This gets broken from time to time.
> On Feb 14, 2024, at 12:56 AM, sebb wrote:
>
> The most recent example was build failures i
The most recent example was build failures in www-site when Whimsy was
unavailable.
I thought it would be simple to implement a cache, given how easy it
is to do it so on some other build systems (e.g. the comdev-site
Jenkins job which runs on Cloudbees).
On Wed, 14 Feb 2024 at 08:35, Volkan Yazı
Sebb, what is the real world problem we are trying to address? Do we have
Pelican builds taking too much time causing trouble for certain projects?
Do we have expensive network bills due to frequent downloads?
On Tue, Feb 13, 2024 at 3:49 PM sebb wrote:
> Is there any way to pass data between ru
On Wed, 14 Feb 2024 at 02:08, Dave Fisher wrote:
>
>
>
> > On Feb 13, 2024, at 2:49 PM, sebb wrote:
> >
> > On Tue, 13 Feb 2024 at 20:21, Dave Fisher wrote:
> >>
> >> One way that could work is to put a cache into a branch of the repository …
> >>
> >> It could double as a data cache.
> >
> > Ye
> On Feb 13, 2024, at 6:08 PM, Dave Fisher wrote:
>
>
>
>> On Feb 13, 2024, at 2:49 PM, sebb wrote:
>>
>> On Tue, 13 Feb 2024 at 20:21, Dave Fisher wrote:
>>>
>>> One way that could work is to put a cache into a branch of the repository …
>>>
>>> It could double as a data cache.
>>
>>
> On Feb 13, 2024, at 2:49 PM, sebb wrote:
>
> On Tue, 13 Feb 2024 at 20:21, Dave Fisher wrote:
>>
>> One way that could work is to put a cache into a branch of the repository …
>>
>> It could double as a data cache.
>
> Yes, but that would require updating the repo.
> I was hoping to avoi
On Tue, 13 Feb 2024 at 20:21, Dave Fisher wrote:
>
> One way that could work is to put a cache into a branch of the repository …
>
> It could double as a data cache.
Yes, but that would require updating the repo.
I was hoping to avoid that, as it is a wasteful use of a repository,
as well as requ
One way that could work is to put a cache into a branch of the repository …
It could double as a data cache.
> On Feb 13, 2024, at 6:49 AM, sebb wrote:
>
> Is there any way to pass data between runs of Buildbot Pelican builds?
>
> This would be useful for caching data that has to be fetched fr
Is there any way to pass data between runs of Buildbot Pelican builds?
This would be useful for caching data that has to be fetched from
elsewhere, in case the remote site is down.
Or for data that is expensive to generate but changes infrequently.
Sebb
