RE: Flume consumes all memory - { OutOfMemoryError: GC overhead limit exceeded }

2017-08-01 Thread Anantharaman, Srinatha (Contractor)
[mailto:iainw...@gmail.com] Sent: Thursday, July 27, 2017 4:22 PM To: user@flume.apache.org Subject: Re: Flume consumes all memory - { OutOfMemoryError: GC overhead limit exceeded } Definitely strange. I didn't see you already had those set in your flume-env.sh, my mistake If you have room

Re: Flume consumes all memory - { OutOfMemoryError: GC overhead limit exceeded }

2017-07-27 Thread iain wright
te your valuable time > > > > Regards, > > ~Sri > > > > *From:* iain wright [mailto:iainw...@gmail.com] > *Sent:* Wednesday, July 26, 2017 5:24 PM > > *To:* user@flume.apache.org > *Subject:* Re: Flume consumes all memory - { OutOfMemoryError: GC > overhe

RE: Flume consumes all memory - { OutOfMemoryError: GC overhead limit exceeded }

2017-07-26 Thread Anantharaman, Srinatha (Contractor)
posted I appreciate your valuable time Regards, ~Sri From: iain wright [mailto:iainw...@gmail.com] Sent: Wednesday, July 26, 2017 5:24 PM To: user@flume.apache.org Subject: Re: Flume consumes all memory - { OutOfMemoryError: GC overhead limit exceeded } Config seems sane. if you ps auxww|grep -i

Re: Flume consumes all memory - { OutOfMemoryError: GC overhead limit exceeded }

2017-07-26 Thread iain wright
#{ parser : > org.apache.tika.parser.microsoft.OfficeParser > } > > #{ parser : org.apache.tika.parser.hdf.HDFParser } > > #{ parser : > org.apache.tika.parser.odf.OpenDocumentParser > } > >

RE: Flume consumes all memory - { OutOfMemoryError: GC overhead limit exceeded }

2017-07-26 Thread Anantharaman, Srinatha (Contractor)
${solrLocator} } } ] } ] I am not sure How I can get the flume metrics. Thank you for looking into it Regards, ~Sri From: iain wright [mailto:iainw...@gmail.com] Sent: Wednesday, July 26, 2017 2:37 PM To: user@flume.apache.org Subject: Re: Flume consumes all memory - { OutOfMemoryErr

Re: Flume consumes all memory - { OutOfMemoryError: GC overhead limit exceeded }

2017-07-26 Thread iain wright
Hi Sri, Are you using a memory channel? What source/sink? Can you please paste/link your obfuscated config What does the metrics endpoint say in terms of channel size, sinkdrainsuccess etc, for the period leading up to the OOM? Best, Iain Sent from my iPhone > On Jul 26, 2017, at 8:00 AM, A