Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-14 Thread helices via rsyslog
;> >> > > >> >> >> >> >>> >> > > This would be >> >> >> >> >>> >> > > >> >> >> >> >>> >> > > action(name="Admin" type="omfwd" >&

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-14 Thread Rainer Gerhards via rsyslog
t due to >> >> >> >> > rate-limiting (500 allowed within 5 seconds) >> >> >> >> > 2022-12-13T02:23:44.003241-06:00 hermes rsyslogd[2539]: >> >> >> >> > rsyslogd[internal_messages]: 1792 messages lost due to >> >> >&g

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-14 Thread helices via rsyslog
> >> >> >> > On Mon, Dec 12, 2022 at 2:03 PM helices < > mike+rsys...@mdsresource.net> wrote: > >> >> >> >> > >> >> >> >> I just now restarted again, like this: > >> >

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-14 Thread Rainer Gerhards via rsyslog
t; >> >> I just now restarted again, like this: >> >> >> >> >> >> >> >> # systemctl restart rsyslog >> >> >> >> >> >> >> >> We'll see overnight if that does the trick. >> &

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread helices via rsyslog
> > > >> >> >>> >> > https://www.rsyslog.com/doc/master/configuration/basic_structure.html#statement-types > >> >> >>> >> > > > >> >> >>> >> > > instead of > >> >> >>> >> > &

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread Rainer Gerhards via rsyslog
uot;514") >> >> >> module(load="imudp") >> >> >> input(type="imudp" port="514") >> >> >> module(load="ommysql.so") >> >> >> global(workDirectory="/var/lib/rsyslog")

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread helices via rsyslog
>> >> local7.*/var/log/boot.log > >> >> mail.* /var/log/maillog > >> >> uucp,news.crit /var/log/spooler > >> >> $ActionName Ftp >

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread Rainer Gerhards via rsyslog
nQueueFileName dbSftpQueue # Set file name, also enables disk mode >> >> $ActionQueueSaveOnShutdown on # Save messages to disk on shutdown >> >> $ActionQueueType LinkedList# Use asynchronous processing >> >> $ActionResumeRetryCount -1 #

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread helices via rsyslog
onous processing > >> $ActionResumeRetryCount -1 # Infinite retries on insert failure > >> authpriv.* > :ommysql:10.199.5.177,sftplogDB,hermesvsftplog,_ > >> $ActionName Admin > >> $ActionQueueFileName ZenossQueue # Set file name, also enable

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread Rainer Gerhards via rsyslog
s to disk on shutdown >> $ActionQueueType LinkedList # Use asynchronous processing >> $ActionResumeRetryCount -1 # Infinite retries on insert failure >> *.* @@10.199.1.160 >> Mon Dec 12 13:56:12 CST 2022 >> >> On Mon,

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread helices via rsyslog
; >> > > of useful info >> >> > > >> >> > > > [4] How to modify imjournal rate limits? >> >> > > >> >> > > see >> >> > > >> >> >> https://www.rsyslog.com/doc/v8-stable/configur

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-12 Thread helices via rsyslog
asynchronous processing > > $ActionResumeRetryCount -1# Infinite retries on insert failure > > *.* @@10.199.1.160 > > Mon Dec 12 13:56:12 CST 2022 > > > > On Mon, Dec 12, 2022 at 1:34 PM David Lang wrote: > > > >> did y

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-12 Thread David Lang via rsyslog
aggressive rate limiting, I find that I always need to drastically increase the limits. writing logs using the RSYSLOG_DebugFormat is adding the template to the file ftp.* /var/log/ftp;RSYSLOG_DebugFormat (legacy format, add template="RSYSLOG_DebugFormat" to that action() forma

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-12 Thread helices via rsyslog
cation for debugging? > >> > > > >> > > as I said below > >> > > > >> > > >> ftp.* /var/log/ftp;RSYSLOG_DebugFormat (legacy format, add > >> > > template="RSYSLOG_DebugFormat" to that action() format) > >&

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-12 Thread David Lang via rsyslog
s via rsyslog To: Rainer Gerhards Cc: helices , rsyslog-users Subject: Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently We're still missing something: module(load="imjournal" Ratelimit.Burst="3" Ratelimit.Interval="1000" StateFile="i

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-12 Thread helices via rsyslog
s/omfile.html > > > > > > feel free to keep asking questions. > > > > > > David Lang > > > > > > > > > > ~ Mike > > > > > > > > > > > > > > > > On Thu, Dec 1, 2022 at 1:33 PM David L

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-09 Thread Rainer Gerhards via rsyslog
> >>> $ActionName Sftp > > >>> $ActionQueueDequeueSlowdown 1000 # How long (in microseconds) > > >> dequeueing > > >>> should be delayed > > >>> $ActionQueueFileName dbSftpQueue # Set file name, also enables disk > > &g

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-09 Thread helices via rsyslog
Lang wrote: >> > >> >> it would be useful to convert to the action() syntax as it makes it >> >> clearer >> >> what's happening. >> >> >> >> Why are you pausing between writing logs? (this could be why you are >> >> dropping

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-06 Thread helices via rsyslog
queues, number processed, etc. > >> > >> imjournal defaults to some fairly aggressive rate limiting, I find that > I > >> always > >> need to drastically increase the limits. > >> > >> writing logs using the RSYSLOG_DebugFormat is adding

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-01 Thread David Lang via rsyslog
common. How can we avoid losing so many messages? ~ Mike On Thu, Dec 1, 2022 at 1:05 PM David Lang wrote: please post your full config. It would also help to log the message with the template RSYSLOG_DebugFormat to a file and find the log entry that is failing to insert. my guess is that the quo

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-01 Thread helices via rsyslog
imiting until now. It is not uncommon. How > > can we avoid losing so many messages? > > > > ~ Mike > > > > > > On Thu, Dec 1, 2022 at 1:05 PM David Lang wrote: > > > >> please post your full config. > >> > >> It would also he

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-01 Thread David Lang via rsyslog
Date: Thu, 1 Dec 2022 13:26:47 -0600 From: helices To: David Lang Cc: helices via rsyslog Subject: Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently Thank you. [1] rsyslog.conf # date; grep -v "^\(#\|\s*$\)" /etc/rsyslog.conf ;date Thu Dec 1 13:19:34 CST 202

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-01 Thread helices via rsyslog
; > David Lang > > On Thu, 1 Dec 2022, helices via rsyslog wrote: > > > Date: Thu, 1 Dec 2022 10:08:01 -0600 > > From: helices via rsyslog > > To: rsyslog-users > > Cc: helices > > Subject: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermi

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-01 Thread David Lang via rsyslog
are trying to process them too fast. David Lang On Thu, 1 Dec 2022, helices via rsyslog wrote: Date: Thu, 1 Dec 2022 10:08:01 -0600 From: helices via rsyslog To: rsyslog-users Cc: helices Subject: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently # date; /bin/yum list rsyslog

[rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-01 Thread helices via rsyslog
# date; /bin/yum list rsyslog rsyslog-mysql ;date Thu Dec 1 09:47:18 CST 2022 Loaded plugins: fastestmirror Loading mirror speeds from cached hostfile * base: download.cf.centos.org * epel: mirror.genesisadaptive.com * extras: download.cf.centos.org * remi-php56: mirror.pit.teraswitch.com * r