Hi Team, We are facing below error in prometheus pod and there after it stops pushing data to mimir - target=http://pushgateway:9091/metrics msg="appending scrape report failed" err="write to WAL: log samples: write /prometheus/wal/123456: no space left on device"
Prometheus Version : 2.50.1 When verified by pod login it shows /tmp directory becomes full i.e. 11/11 Gi space is consumed. ALso tried to reduced retention period to 1h but still issue persist and /tmp directory gets full. -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/54ede684-4b7c-4fe1-a454-c12cf6b51730n%40googlegroups.com.