Re: [BLOCKING] Master branch always fails on testElasticSearch8Sink

2023-06-28 Thread Lari Hotari
https://github.com/apache/pulsar/pull/20671 is now merged. For existing PRs that are blocked, it is necessary to push new changes to the PR or close and re-open the PR to pick up the fix that is merged to the master branch. I have also cherry-picked the fix to branch-3.0 and branch-2.11. There's

Re: [BLOCKING] Master branch always fails on testElasticSearch8Sink

2023-06-28 Thread tison
Cool! Best, tison. Lari Hotari 于2023年6月28日周三 23:50写道: > The root cause appears to be different than the geoip database download in > Elastic. > By default, Elastic will stop writes when the disk usage goes over 90%. > I've now added a setting to disable the disk usage threshold in the PR [1].

Re: [BLOCKING] Master branch always fails on testElasticSearch8Sink

2023-06-28 Thread Lari Hotari
The root cause appears to be different than the geoip database download in Elastic. By default, Elastic will stop writes when the disk usage goes over 90%. I've now added a setting to disable the disk usage threshold in the PR [1]. A similar setting is applied in elastic-github-actions [2]. Once

Re: [BLOCKING] Master branch always fails on testElasticSearch8Sink

2023-06-28 Thread tison
> I guess nobody proceeded in disabling the test. Yeah. I'm not in a hurry but bring up the case. It seems no one is blocked urgently and we have time to investigate it :D Thanks for your investigation and patch! Indeed. Best, tison. Lari Hotari 于2023年6月28日周三 20:58写道: > I guess nobody procee

Re: [BLOCKING] Master branch always fails on testElasticSearch8Sink

2023-06-28 Thread Lari Hotari
I guess nobody proceeded in disabling the test. I have investigated the problem and written a short guide about investigating integration tests in the real GitHub Actions VM environment using ssh. This guide is a comment on the issue: https://github.com/apache/pulsar/issues/20661#issuecomment-161

Re: [BLOCKING] Master branch always fails on testElasticSearch8Sink

2023-06-27 Thread Michael Marshall
> I think it's better to disable (or quarantine) a test if it blocks master and > there's no immediate solution. It is regrettable to disable a test, but given that this test is passing locally, I agree with quarantining the test. Thanks, Michael On Wed, Jun 28, 2023 at 12:10 AM Lari Hotari wr

Re: [BLOCKING] Master branch always fails on testElasticSearch8Sink

2023-06-27 Thread Lari Hotari
I think it's better to disable (or quarantine) a test if it blocks master and there's no immediate solution. -Lari On 2023/06/28 01:52:14 tison wrote: > See also https://github.com/apache/pulsar/issues/20661 > > Enrico and I both verified that it works well locally, so that can be an > env issu