Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-14 Thread helices via rsyslog
t; >> >> >> >>> >> >> >> >> >> >>> >> doc: >> >> >> >> >>> >> >> https://www.rsyslog.com/doc/v8-stable/configuration/modules/imjournal.html >>

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-14 Thread Rainer Gerhards via rsyslog
t due to >> >> >> >> > rate-limiting (500 allowed within 5 seconds) >> >> >> >> > 2022-12-13T02:23:44.003241-06:00 hermes rsyslogd[2539]: >> >> >> >> > rsyslogd[internal_messages]: 1792 messages lost due to >> >> >&g

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-14 Thread helices via rsyslog
> >> >> >> > On Mon, Dec 12, 2022 at 2:03 PM helices < > mike+rsys...@mdsresource.net> wrote: > >> >> >> >> > >> >> >> >> I just now restarted again, like this: > >> >

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-14 Thread Rainer Gerhards via rsyslog
t; >> >> I just now restarted again, like this: >> >> >> >> >> >> >> >> # systemctl restart rsyslog >> >> >> >> >> >> >> >> We'll see overnight if that does the trick. >> &

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread helices via rsyslog
> > > >> >> >>> >> > https://www.rsyslog.com/doc/master/configuration/basic_structure.html#statement-types > >> >> >>> >> > > > >> >> >>> >> > > instead of > >> >> >>> >> > &

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread Rainer Gerhards via rsyslog
uot;514") >> >> >> module(load="imudp") >> >> >> input(type="imudp" port="514") >> >> >> module(load="ommysql.so") >> >> >> global(workDirectory="/var/lib/rsyslog")

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread helices via rsyslog
>> >> local7.*/var/log/boot.log > >> >> mail.* /var/log/maillog > >> >> uucp,news.crit /var/log/spooler > >> >> $ActionName Ftp >

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread Rainer Gerhards via rsyslog
nQueueFileName dbSftpQueue # Set file name, also enables disk mode >> >> $ActionQueueSaveOnShutdown on # Save messages to disk on shutdown >> >> $ActionQueueType LinkedList# Use asynchronous processing >> >> $ActionResumeRetryCount -1 #

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread helices via rsyslog
onous processing > >> $ActionResumeRetryCount -1 # Infinite retries on insert failure > >> authpriv.* > :ommysql:10.199.5.177,sftplogDB,hermesvsftplog,_ > >> $ActionName Admin > >> $ActionQueueFileName ZenossQueue # Set file name, also enable

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread Rainer Gerhards via rsyslog
s to disk on shutdown >> $ActionQueueType LinkedList # Use asynchronous processing >> $ActionResumeRetryCount -1 # Infinite retries on insert failure >> *.* @@10.199.1.160 >> Mon Dec 12 13:56:12 CST 2022 >> >> On Mon,

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread helices via rsyslog
; >> > > of useful info >> >> > > >> >> > > > [4] How to modify imjournal rate limits? >> >> > > >> >> > > see >> >> > > >> >> >> https://www.rsyslog.com/doc/v8-stable/configur

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-12 Thread helices via rsyslog
asynchronous processing > > $ActionResumeRetryCount -1# Infinite retries on insert failure > > *.* @@10.199.1.160 > > Mon Dec 12 13:56:12 CST 2022 > > > > On Mon, Dec 12, 2022 at 1:34 PM David Lang wrote: > > > >> did y

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-12 Thread David Lang via rsyslog
aggressive rate limiting, I find that I always need to drastically increase the limits. writing logs using the RSYSLOG_DebugFormat is adding the template to the file ftp.* /var/log/ftp;RSYSLOG_DebugFormat (legacy format, add template="RSYSLOG_DebugFormat" to that action() forma

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-12 Thread helices via rsyslog
cation for debugging? > >> > > > >> > > as I said below > >> > > > >> > > >> ftp.* /var/log/ftp;RSYSLOG_DebugFormat (legacy format, add > >> > > template="RSYSLOG_DebugFormat" to that action() format) > >&

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-12 Thread David Lang via rsyslog
s via rsyslog To: Rainer Gerhards Cc: helices , rsyslog-users Subject: Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently We're still missing something: module(load="imjournal" Ratelimit.Burst="3" Ratelimit.Interval="1000" StateFile="i

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-12 Thread helices via rsyslog
s/omfile.html > > > > > > feel free to keep asking questions. > > > > > > David Lang > > > > > > > > > > ~ Mike > > > > > > > > > > > > > > > > On Thu, Dec 1, 2022 at 1:33 PM David L

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-09 Thread Rainer Gerhards via rsyslog
gt; >> dropping > > >> logs) > > >> > > >> given the number of queues and actions, look at configuring impstats so > > >> that you > > >> can see the number of messages in the queues, number processed, etc. > > >> > >

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-09 Thread helices via rsyslog
Lang wrote: >> > >> >> it would be useful to convert to the action() syntax as it makes it >> >> clearer >> >> what's happening. >> >> >> >> Why are you pausing between writing logs? (this could be why you are >> >> dropping

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-06 Thread helices via rsyslog
queues, number processed, etc. > >> > >> imjournal defaults to some fairly aggressive rate limiting, I find that > I > >> always > >> need to drastically increase the limits. > >> > >> writing logs using the RSYSLOG_DebugFormat is adding

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-01 Thread David Lang via rsyslog
YSLOG_DebugFormat (legacy format, add template="RSYSLOG_DebugFormat" to that action() format) the debug format is large, but you really need to see the message that's failing to figure out why it's failing. The MySQL logs may give you better info on that. David La

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-01 Thread helices via rsyslog
t; Date: Thu, 1 Dec 2022 13:26:47 -0600 > > From: helices > > To: David Lang > > Cc: helices via rsyslog > > Subject: Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB > intermittently > > > > Thank you. > > > > [1] rsyslog.conf > > >

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-01 Thread David Lang via rsyslog
Date: Thu, 1 Dec 2022 13:26:47 -0600 From: helices To: David Lang Cc: helices via rsyslog Subject: Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently Thank you. [1] rsyslog.conf # date; grep -v "^\(#\|\s*$\)" /etc/rsyslog.conf ;date Thu Dec 1 13:19:34 CST 202

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-01 Thread helices via rsyslog
Thank you. [1] rsyslog.conf # date; grep -v "^\(#\|\s*$\)" /etc/rsyslog.conf ;date Thu Dec 1 13:19:34 CST 2022 module(load="imjournal" StateFile="imjournal.state") module(load="imklog") module(load="immark") module(load="impstats" interval="600" severity="7") syslog.=debug /var/log/rsyslog-stats

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-01 Thread David Lang via rsyslog
please post your full config. It would also help to log the message with the template RSYSLOG_DebugFormat to a file and find the log entry that is failing to insert. my guess is that the quotes in the message are confusing mysql note that rate limiting is throwing away messages because you ar