I faced this issue in the design phase too, found this https://github.com/beorn-/highlander but it looks a bit dead now... else you can push duplicated metrics to thanos (while setting a unique label for every prometheus instance) and then configure thanos querier to deduplicate when serving metrics On Friday, November 4, 2022 at 3:40:29 PM UTC+1 Julien Pivotto wrote:
> You would need additional tools like corosync or keepalived to achieve > this. In prometheus terms, all the prometheis servers are active and > deduplication is done at the remote write end if needed. > > On 04 Nov 07:24, Navid Shakibapour wrote: > > Is there a way to set up multiple Prometheus servers in an > active/passive > > way? Meaning only 1 server scrapes targets at a time and other ones only > > scrape if the active one doesn't "work" after x seconds/minutes. > > > > On Friday, November 4, 2022 at 3:00:15 AM UTC-4 [email protected] wrote: > > > > > There is no option without using a single instance. If your 3rd party > > > solution does not handle HA, you can not use HA. > > > > > > On Fri, Nov 4, 2022 at 7:57 AM Navid Shakibapour < > [email protected]> > > > wrote: > > > > > >> We are evaluating using Prometheus agent mode in a highly available > > >> manner to forward metrics to a 3rd party remote storage using remote > write > > >> API. > > >> We need to have multiple shards and multiple replicas per shard. Our > 3rd > > >> party remote storage does not handle deduplication on their side. > > >> > > >> Could someone point me to different options for metrics deduplication > on > > >> ingestion? > > >> > > >> > > >> -- > > >> You received this message because you are subscribed to the Google > Groups > > >> "Prometheus Users" group. > > >> To unsubscribe from this group and stop receiving emails from it, > send an > > >> email to [email protected]. > > >> To view this discussion on the web visit > > >> > https://groups.google.com/d/msgid/prometheus-users/1b274d3d-77a9-4de3-9b63-61a533b84140n%40googlegroups.com > > > >> < > https://groups.google.com/d/msgid/prometheus-users/1b274d3d-77a9-4de3-9b63-61a533b84140n%40googlegroups.com?utm_medium=email&utm_source=footer > > > > >> . > > >> > > > > > > > -- > > You received this message because you are subscribed to the Google > Groups "Prometheus Users" group. > > To unsubscribe from this group and stop receiving emails from it, send > an email to [email protected]. > > To view this discussion on the web visit > https://groups.google.com/d/msgid/prometheus-users/91c8b0d4-67e2-40d3-8314-bd58409cf937n%40googlegroups.com > . > > > -- > Julien Pivotto > @roidelapluie > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/5cfbf874-6449-4215-bcdd-3c856fa68e7dn%40googlegroups.com.
