Issue similar to Flume-2052

2018-06-21 Thread Jyotsna G
Hi All, Am currently using Flume 1.7.0. While processing a set of files, am encountering the below exception and Flume hangs unpredictably. 18/06/21 05:40:40 ERROR source.SpoolDirectorySource: FATAL: Spool Directory source src-tpa_idoru: { spoolDir: /tmp/tpa-idoru/ }: Uncaught exception in SpoolD

Re: Issue similar to Flume-2052

2018-06-21 Thread Peter Turcsanyi
Hi Jyotsna, What is your 'decodeErrorPolicy' setting on the spool dir source? By default it is FAIL, but it must be IGNORE or REPLACE in order to proceed further when decoding error occurs. Regrads, Peter Turcsanyi On Thu, Jun 21, 2018 at 2:54 PM, Jyotsna G wrote: > Hi All, > Am currently usin

Re: Issue similar to Flume-2052

2018-06-21 Thread Jyotsna G
Thank you so much Peter. I set 'decodeErrorPolicy' to IGNORE and its processing fine now. Regards, Jyotsna On Thu, Jun 21, 2018 at 7:07 PM, Peter Turcsanyi wrote: > Hi Jyotsna, > > What is your 'decodeErrorPolicy' setting on the spool dir source? > By default it is FAIL, but it must be IGNORE