Last one was from Prometheius server's status. But here is my actual file.
global:
scrape_interval: 1m # By default, scrape targets every 1 minute.
scrape_timeout: 1m
evaluation_interval: 5m # How frequently to evaluate rules
# Alertmanager configuration
alerting:
alertmanagers:
- scheme: https
static_configs:
- targets:
- "${NFM_ALERT_MANAGER_URL}"
# Load rules once and periodically evaluate them according to the global
'evaluation_interval'.
rule_files:
- "/etc/prometheus/rules/kafka/confluent.yml"
- "/etc/prometheus/rules/kafka/connect.yml"
- "/etc/prometheus/rules/kafka/uptime.yml"
- "/etc/prometheus/rules/observability/uptime.yml"
# A scrape configuration containing exactly one endpoint to scrape:
# Here it's Prometheus itself.
scrape_configs:
# have prometheus scrape itself to gather internal metrics
- job_name: 'prometheus'
scrape_interval: 1m
scheme: http
static_configs:
- targets:
- 'localhost:9090'
- job_name: 'alertmanager'
scrape_interval: 1m
metrics_path: /metrics
scheme: https
static_configs:
- targets:
- "${NFM_ALERT_MANAGER_URL}"
On Wed, Aug 21, 2024 at 3:10 PM Jay <tn2...@gmail.com> wrote:
> Greetings Team
> Yes Sure. Please see below.
>
> name: Dev-NotEqualtoBoolZero
> <https://app-prometheus2-d.ase-appintd.appserviceenvironment.net/graph?g0.expr=ALERTS%7Balertname%3D%22Dev-NotEqualtoBoolZero%22%7D&g0.tab=1&g0.display_mode=lines&g0.show_exemplars=0.g0.range_input=1h.>
> expr: confluent_kafka_server_consumer_lag_offsets{job="confluent-cloud"} >
> 100
> <https://app-prometheus2-d.ase-appintd.appserviceenvironment.net/graph?g0.expr=confluent_kafka_server_consumer_lag_offsets%7Bjob%3D%22confluent-cloud%22%7D%20%3E%20100&g0.tab=1&g0.display_mode=lines&g0.show_exemplars=0.g0.range_input=1h.>
> labels:
> severity: critical
> annotations:
> description: The consumer lags for Dev client`
>
>
> global:
> scrape_interval: 1m
> scrape_timeout: 1m
> scrape_protocols:
> - OpenMetricsText1.0.0
> - OpenMetricsText0.0.1
> - PrometheusText0.0.4
> evaluation_interval: 5m
> alerting:
> alertmanagers:
> - follow_redirects: true
> enable_http2: true
> scheme: https
> timeout: 10s
> api_version: v2
> static_configs:
> - targets:
> - app-promalertmanager2-d.ase-appintd.appserviceenvironment.net:443
> rule_files:
> - /etc/prometheus/rules/kafka/confluent.yml
>
> - job_name: confluent-cloud
> honor_timestamps: true
> track_timestamps_staleness: false
> params:
> resource.kafka.id:
> - lkc-xxx
> - lkc-xxx
> - lkc-xxx
> resource.schema_registry.id:
> - lsrc-xxx
> - lsrc-xxx
> - lsrc-xxx
> scrape_interval: 1m
> scrape_timeout: 1m
> scrape_protocols:
> - OpenMetricsText1.0.0
> - OpenMetricsText0.0.1
> - PrometheusText0.0.4
> metrics_path: /v2/metrics/cloud/export
> scheme: https
> enable_compression: true
> basic_auth:
> username: XXXXXXX
> password: <secret>
> follow_redirects: true
> enable_http2: true
> static_configs:
> - targets:
> - api.telemetry.confluent.cloud
>
> On Wed, Aug 21, 2024 at 1:51 PM Daz Wilkin <daz.wil...@gmail.com> wrote:
>
>> Please include the rule.
>>
>> You've shown that the query returns results which is necessary but
>> insufficient.
>>
>> On Wednesday, August 21, 2024 at 8:19:34 AM UTC-7 Jay P wrote:
>>
>>> I am not new to Prometheus however, I wrote the following rules which
>>> never fires. (Alertmanger and all other settings are fine since I get
>>> Alarms for other rules except this one)
>>>
>>> Attached here it he screenshot and i am copy pasting here as well.
>>>
>>> confluent_kafka_server_consumer_lag_offsets{job="confluent-cloud"} > 1
>>>
>>> Results:
>>> confluent_kafka_server_consumer_lag_offsets{consumer_group_id="XXX",
>>> instance="api.telemetry.confluent.cloud:443", job="confluent-cloud",
>>> kafka_id="XXX", topic="XXX"}
>>> 2
>>> confluent_kafka_server_consumer_lag_offsets{consumer_group_id="XXX",
>>> instance="api.telemetry.confluent.cloud:443", job="confluent-cloud",
>>> kafka_id="XXX", topic="XXX"}
>>> 3
>>>
>>> Any help is greatly appreciated. Thank you
>>>
>> --
>> You received this message because you are subscribed to a topic in the
>> Google Groups "Prometheus Users" group.
>> To unsubscribe from this topic, visit
>> https://groups.google.com/d/topic/prometheus-users/pBEqCDIUFug/unsubscribe
>> .
>> To unsubscribe from this group and all its topics, send an email to
>> prometheus-users+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/prometheus-users/e8007886-5a85-4fdb-938e-36373409498cn%40googlegroups.com
>> <https://groups.google.com/d/msgid/prometheus-users/e8007886-5a85-4fdb-938e-36373409498cn%40googlegroups.com?utm_medium=email&utm_source=footer>
>> .
>>
>
--
You received this message because you are subscribed to the Google Groups
"Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to prometheus-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/prometheus-users/CAN3oSLQVUhybFopq5pQLKyjt0sNz8jhp8HCm1GqWwyBU3AHB2w%40mail.gmail.com.
