Thanks Stuart. That would be the obvious thing to do.
Is there any way we can manage the memory segment size limits? I believe below err represents the issue loading specific segment or it exhaust after loading x number of segment since it exceeded the memory limit? On Wed, 2 Jun 2021, 00:15 Stuart Clark, <[email protected]> wrote: > On 2021-06-01 17:09, Naveen Badam wrote: > > Hi Team, > > > > I found prometheus started reporting "fatal error: runtime: out of > > memory" recently. > > > > the only change i did was, we have added few bunch of new scrappers to > > prometheus, probably that is causing issues loading the segment data? > > > > below is the error am getting while prometheus startup: > > > > Appreciate your help on fixing this issue. > > > > If extra targets to scrape is the only recent difference (the other big > user of memory would be queries) then that is likely to be what is > causing you to run out of memory. You either need to increase the amount > of memory available or reduce the number of targets/metrics/time series > being scraped. > > -- > Stuart Clark > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/CAAJWj-sV2GUf3usP-cB_tcvOhu108e6__MnfoHDAG%3DS1RWNGPA%40mail.gmail.com.
