[ 
https://issues.apache.org/jira/browse/FLINK-21561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293774#comment-17293774
 ] 

Robert Metzger commented on FLINK-21561:
----------------------------------------

I had an offline discussion with [~autophagy] about fixing this issue: We 
intend to start a local webserver on the builder, which serves as a cache for 
binaries loaded from various sources.
Instead of downloading from archive.apache.org, we download from 
localhost:1234/archive.apache.org. The cache will check if the resource is 
already present in a cached folder, and if so, return the file.

[~autophagy] I assigned you to the ticket! Thanks a lot for working on it!

> Introduce cache for binaries downloaded by bash tests 
> ------------------------------------------------------
>
>                 Key: FLINK-21561
>                 URL: https://issues.apache.org/jira/browse/FLINK-21561
>             Project: Flink
>          Issue Type: Improvement
>          Components: Build System / CI, Test Infrastructure
>            Reporter: Robert Metzger
>            Priority: Critical
>             Fix For: 1.13.0
>
>
> It seems that archive.apache.org is currently very slow, causing the bash e2e 
> tests to timeout, because they need a lot of time downloading dependencies.
> This ticket is for tracking an improvement to the bash-based e2e tests to 
> cache the binaries in Azure pipelines Caches [1].
> [1] 
> https://docs.microsoft.com/en-us/azure/devops/pipelines/release/caching?view=azure-devops



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to