Re: [prometheus-users] Re: Alert manager sending alerts, if one poll exists inside the 5m period.

2024-12-19 Thread Steven Relf
Brian, you sir are a gentleman and a scholar. I have removed that rule as I already have the other rule you suggested in place So no need for the bouncy one. Rgds Steve. On Thu, 19 Dec 2024 at 13:33, 'Brian Candler' via Prometheus Users < prometheus-users@googlegroups.com> wrote: > As a sta

[prometheus-users] Re: Alert manager sending alerts, if one poll exists inside the 5m period.

2024-12-19 Thread 'Brian Candler' via Prometheus Users
As a starting point, put the expression "probe_icmp_duration_seconds == 0" into the PromQL web browser in Prometheus, and zoom into the expected time area. What do you see? One possible issue is if the timeseries appears and disappears; 5 minutes happens to be the default staleness interval (lo

[prometheus-users] Alert manager sending alerts, if one poll exists inside the 5m period.

2024-12-19 Thread Steven Relf
Hey, Having an interesting issue with Prom and Alert manager, im 99% sure its a config issue, but having a hard time figuring it out. We have a group of polls that use the blackbox exporter to ping some endpoints. It pings once every 30 seconds. The rule looks like this - name: blackbox.rule

[prometheus-users] Re: Alertmanager email issues

2024-12-19 Thread 'Brian Candler' via Prometheus Users
> I am running kube-prometheus on K8s cluster - installed with helm. Software versions? > When I check the UI Which UI are you referring to? Prometheus' web UI has an "alerts" section, and Alertmanager's web UI also has an "alerts" section. Do they both show the active PodErrorAlert? Check th

[prometheus-users] Re: Alertmanager email issues

2024-12-19 Thread Daniello
Any help is greatly appreciated :) On Thursday, December 19, 2024 at 10:11:16 AM UTC+1 Daniello wrote: > Hi everyone > I am running kube-prometheus on K8s cluster - installed with helm. > Additionally I set up: AlertManagerConfig and PrometheusRules CRD > > *Issue*: > I have two set of alerts, o

[prometheus-users] Alertmanager email issues

2024-12-19 Thread Daniello
Hi everyone I am running kube-prometheus on K8s cluster - installed with helm. Additionally I set up: AlertManagerConfig and PrometheusRules CRD *Issue*: I have two set of alerts, one of them called *PodErrorAlert *and the other *PodPendingFor30mAlert*. When I check the UI i can see both of the a