I have alertmanager configured to send "critical" alerts to Pagerduty over Events v2 api. If the prometheus rule has an alert that lasts longer than 20 minutes or so; the pagerduty alert will be resolved and then re-triggers a new event.
I have tried disabling grouping (with "group_by [...]"). The pagerduty alert's log just says: "Resolved through the integration API.". However, the alert still shows in Alertmanager. In addition, I have messages going to slack. The alert message shows up there; but never a resolved message either. Any ideas why alertmanager would close/resolve the pagerduty incident and then re-trigger/open one again? -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/c38b7589-9c18-4c9a-b3d6-2cd39dbacfe4n%40googlegroups.com.
