Re: [prometheus-users] Re: Customizing Alertmanager Notifications for Telegram

2024-10-24 Thread Chris Siebenmann
> If something was worth alerting on then it's worth investigating: even if > the alert condition is no longer present, it clearly was earlier. Just > saying "oh look, it's gone away, never mind" is not helping to understand > or fix the problem (with the system and/or with the alert itself). >

Re: [prometheus-users] Re: Customizing Alertmanager Notifications for Telegram

2024-10-24 Thread 'Brian Candler' via Prometheus Users
On Thursday 24 October 2024 at 16:13:06 UTC+1 Chris Siebenmann wrote: As a counterpoint: we send resolved alerts so that we can know when a problem stopped as well as when it started (which helps for diagnosis) Fair enough, although I will mention that the historical alert information is also

[prometheus-users] Re: Issue with resolved alerts not sending notifications

2024-10-24 Thread 'Brian Candler' via Prometheus Users
On Wednesday 23 October 2024 at 16:26:30 UTC+1 mohammad md wrote: - - *annotations: summary: "High CPU usage on {{ $labels.Host }} for {{ $labels.Client }} ({{ $value }})" description: "CPU usage on {{ $labels.Host }} for {{ $labels.Client }} has exceeded 70% for 5 minu

[prometheus-users] Re: Customizing Alertmanager Notifications for Telegram

2024-10-24 Thread 'Brian Candler' via Prometheus Users
On Wednesday 23 October 2024 at 16:26:30 UTC+1 bashar madani wrote: The issue I’m facing is that Alertmanager keeps repeating the FIRING message even after the issue is resolved. I want to ensure that only the RESOLVED message is sent when the problem is fixed. If you have a group of alerts, a