Re: Pulsar CI broken due to Eclipse Temurin repository broken

[Lari Hotari]

The problem has been resolved in the Eclipse Temurin apt repository. Pulsar
CI is unblocked.

-Lari

On Fri, 27 Oct 2023 at 09:00, Lari Hotari  wrote:

> Hi all,
>
> Pulsar CI is currently broken and fails in building docker images used in
> end-to-end Integration tests. This fails due to Eclipse Temurin apt
> repository being broken. Enrico shared the link to the Temurin issue [1] on
> Pulsar slack [2].
> Base on the latest issue comments, it seems that the repository issue is
> fixed but the old state is still held in caches and the problem isn't yet
> resolved. If that's the case, I would expect that the cache expiration is
> less than 24h. Therefore we could wait until it is resolved.
>
> -Lari
>
> 1 - https://github.com/adoptium/installer/issues/766
> 2 - https://apache-pulsar.slack.com/archives/C5ZSVEN4E/p1698413110189289
>

Reporting and tooling to detect thread leaks in Pulsar tests

[Lari Hotari]

Hi all,

I have submitted a PR (https://github.com/apache/pulsar/pull/21450) which 
includes changes to add reporting and tooling to detect thread leaks in Pulsar 
tests. 

It should be ensured in each test that resources created by the test are 
properly cleaned up. Failing to do so can lead to memory leaks and, in some 
instances, unnecessary CPU consumption. These issues can, in turn, slow down 
test execution, increase Pulsar CI build durations, and cause flakiness.  A 
significant source of memory leaks in Pulsar tests stems from thread leaks.

After the PR is merged, it will be easy to detect thread leaks since the build 
will add warnings to the summary view for the GitHub Actions build run. An 
example can be seen in the PR build run: 
https://github.com/apache/pulsar/actions/runs/6680066364?pr=21450 .
There will be more detailed information in the "Report detected thread leaks" 
build step, for example 
https://github.com/apache/pulsar/actions/runs/6680066364/job/18153890519?pr=21450#step:16:23
 .

Please review the PR https://github.com/apache/pulsar/pull/21450 so that we can 
continue to get rid of the remaining thread leaks in the future and keep the 
tests cleaner and less flaky. 

-Lari