Re: [go-nuts] Re: Pod memory keeps on increasing and restart with error OOMKilled

2022-03-11 Thread Robert Engels
I think your best course of action is to go to the Kafka forums. > On Mar 10, 2022, at 10:12 PM, Rakesh K R wrote: > > Hi, > Thank you. I know its kafka related question but thread started with issue in > golang but later we are suspecting issue in go kafka library configuration. > FYI, I am

Re: [go-nuts] Re: Pod memory keeps on increasing and restart with error OOMKilled

2022-03-10 Thread Rakesh K R
Hi, Thank you. I know its kafka related question but thread started with issue in golang but later we are suspecting issue in go kafka library configuration. FYI, I am interested in kafka client or producer properties. log.retention.hours or log.retention.bytes are kafka broker related configur

Re: [go-nuts] Re: Pod memory keeps on increasing and restart with error OOMKilled

2022-03-10 Thread Robert Engels
Look at log.retention.hours and log.retention.bytes You should post this in the Kafka forums not the Go ones. > On Mar 10, 2022, at 11:04 AM, Rakesh K R wrote: > > Hi, > Sorry I am not sure which kafka configuration are you referring here. Can you > please point me to the right configuration

Re: [go-nuts] Re: Pod memory keeps on increasing and restart with error OOMKilled

2022-03-10 Thread Rakesh K R
Hi, Sorry I am not sure which kafka configuration are you referring here. Can you please point me to the right configuration responsible for retaining the message for replay. I see following properties which might be related but not sure: queued.min.messages queued.max.messages.kbytes queue.buffe

Re: [go-nuts] Re: Pod memory keeps on increasing and restart with error OOMKilled

2022-03-10 Thread Robert Engels
You need to configure Kafka for how long it retains messages for replay - or some other option to store on disk. > On Mar 10, 2022, at 10:07 AM, Rakesh K R wrote: > > Tamas, > Thanks you. So any suggestion on how to make application release this 900MiB > memory back to OS so that pod will no

[go-nuts] Re: Pod memory keeps on increasing and restart with error OOMKilled

2022-03-10 Thread Rakesh K R
Tamas, Thanks you. So any suggestion on how to make application release this 900MiB memory back to OS so that pod will not end up in OOMKilled state? On Thursday, March 10, 2022 at 1:45:18 PM UTC+5:30 Tamás Gulácsi wrote: > gopkg.in/confluentinc/confluent-kafka-go.v1/kafka._Cfunc_GoBytes > > say

[go-nuts] Re: Pod memory keeps on increasing and restart with error OOMKilled

2022-03-10 Thread Tamás Gulácsi
gopkg.in/confluentinc/confluent-kafka-go.v1/kafka._Cfunc_GoBytes says it uses cgo, hiding it's memory usage from Go. I bet that 900MiB of memory is there... Rakesh K R a következőt írta (2022. március 10., csütörtök, 7:26:57 UTC+1): > HI, > I have a micro service application deployed on kubern