On Saturday 01 July 2017 at 10:34:28, Antony Stone wrote:
> On Saturday 01 July 2017 at 01:32:34, Neil Katin wrote:
>
> > Alternately: run 'sar -r 10' (sar is in the sysstat package, -r reports
> > on memory usage) capturing the output to a file. If you see committed
> > memory (%commit) usage growing towards 100%, and then freeing up after
> > icinga dies then you have a reasonable diagnosis.
> I'll log to a file and wait...
Crash report attached - time of failure 13:42:11
sar report from 13:30 onwards also attached.
I see no indication of all 4Gbytes getting used up.
The only thing I would mention is that this crash occurred 1 minute 6 seconds
after I performed an "icinga2 reload" on the master server.
However, the crash I got last night, timed at 00:02:33 was ~20 minutes after
the previous reload (23:43:10 - I have timestamps on my bash history).
Any further ideas please, people?
Antony.
--
The Magic Words are Squeamish Ossifrage.
Please reply to the list;
please *don't* CC me.
Caught unhandled exception.
Current time: 2017-07-01 13:42:11 +0200
Application information:
Application version: r2.6.3-1
Installation root: /usr
Sysconf directory: /etc
Run directory: /run
Local state directory: /var
Package data directory: /usr/share/icinga2
State path: /var/lib/icinga2/icinga2.state
Modified attributes path: /var/lib/icinga2/modified-attributes.conf
Objects path: /var/cache/icinga2/icinga2.debug
Vars path: /var/cache/icinga2/icinga2.vars
PID path: /run/icinga2/icinga2.pid
System information:
Platform: Debian GNU/Linux
Platform version: 7 (wheezy)
Kernel: Unknown
Kernel version: Unknown
Architecture: Unknown
Build information:
Compiler: GNU 4.7.2
Build host: moe
Error: Function call 'fork' failed with error code 12, 'Cannot allocate memory'
***
* This would indicate a runtime problem or configuration error. If you believe
this is a bug in Icinga 2
* please submit a bug report at https://github.com/Icinga/icinga2 and include
this stack trace as well as any other
* information that might be useful in order to reproduce this problem.
***
Linux 3.2.41-042stab120.20 (red.ac.ted) 01/07/17 _i686_ (24 CPU)
10:35:18 kbmemfree kbmemused %memused kbbuffers kbcached kbcommit
%commit kbactive kbinact
13:30:08 3858176 336128 8.01 0 179732 0
0.00 142812 157580
13:30:18 3869008 325296 7.76 0 179568 0
0.00 133148 157604
13:30:28 3865324 328980 7.84 0 179576 0
0.00 136140 157608
13:30:38 3868768 325536 7.76 0 179588 0
0.00 133532 157612
13:30:48 3867588 326716 7.79 0 179644 0
0.00 134400 157624
13:30:58 3866428 327876 7.82 0 179652 0
0.00 135352 157628
13:31:08 3861232 333072 7.94 0 179816 0
0.00 139032 157648
13:31:18 3873464 320840 7.65 0 179668 0
0.00 130916 157616
13:31:28 3863576 330728 7.89 0 179688 0
0.00 137664 157632
13:31:38 3867792 326512 7.78 0 180100 0
0.00 134376 157596
13:31:48 3866276 328028 7.82 0 180084 0
0.00 135368 157608
13:31:58 3869844 324460 7.74 0 180080 0
0.00 132212 157612
13:32:08 3861896 332408 7.93 0 180252 0
0.00 138064 157620
13:32:18 3869376 324928 7.75 0 179880 0
0.00 133124 157600
13:32:28 3854260 340044 8.11 0 180744 0
0.00 146812 157680
13:32:38 3859972 334332 7.97 0 180072 0
0.00 141504 158396
13:32:48 3860440 333864 7.96 0 180024 0
0.00 141024 158392
13:32:58 3857572 336732 8.03 0 180008 0
0.00 142568 159212
13:33:08 3853660 340644 8.12 0 179948 0
0.00 145432 159340
13:33:18 3863452 330852 7.89 0 180132 0
0.00 138684 159424
13:33:28 3864104 330200 7.87 0 180140 0
0.00 135512 159436
13:33:38 3869540 324764 7.74 0 180164 0
0.00 132324 159440
13:33:48 3869824 324480 7.74 0 180128 0
0.00 131060 159448
13:33:58 3867940 326364 7.78 0 187864 0
0.00 139016 155272
13:34:08 3866684 327620 7.81 0 187864 0
0.00 136804 157472
13:34:18 3867032 327272 7.80 0 187932 0
0.00 135208 158752
13:34:28 3866568 327736 7.81 0 187932 0
0.00 135644 158748
13:34:38 3866476 327828 7.82 0 187944 0
0.00 135752 158748
13:34:48 3866020 328284 7.83 0 187936 0
0.00 136024 158712
13:34:58 3867856 326448 7.78 0 188852 0
0.00 133068 159988
13:35:08 3868572 325732 7.77 0 188060 0
0.00 132392 159968
13:35:18 3866348 327956 7.82 0 188044 0
0.00 134424 160128
13:35:28 3866288 328016 7.82 0 188092 0
0.00 134472 160148
13:35:38 3866292 328012 7.82 0 188096 0
0.00 134492 160132
13:35:48 3868764 325540 7.76 0 188396 0
0.00 133588 160136
13:35:58 3860156 334148 7.97 0 188512 0
0.00 138872 160196
13:36:08 3866044 328260 7.83 0 188452 0
0.00 134672 160188
13:36:18 3865536 328768 7.84 0 188652 0
0.00 135036 160120
13:36:28 3868288 326016 7.77 0 188700 0
0.00 132520 160136
13:36:38 3868152 326152 7.78 0 188692 0
0.00 132676 160128
13:36:48 3863840 330464 7.88 0 189144 0
0.00 135936 160264
13:36:58 3865972 328332 7.83 0 189144 0
0.00 134136 160284
13:37:08 3865428 328876 7.84 0 189060 0
0.00 135208 160272
13:37:18 3865572 328732 7.84 0 188832 0
0.00 135068 160268
13:37:28 3865572 328732 7.84 0 188848 0
0.00 135060 160280
13:37:38 3864856 329448 7.85 0 188848 0
0.00 135636 160280
13:37:48 3861396 332908 7.94 0 189120 0
0.00 138516 160256
13:37:58 3866732 327572 7.81 0 189168 0
0.00 132884 161288
13:38:08 3865908 328396 7.83 0 189104 0
0.00 133456 161288
13:38:18 3864568 329736 7.86 0 188876 0
0.00 135064 161284
13:38:28 3864540 329764 7.86 0 188876 0
0.00 134944 161420
13:38:38 3863372 330932 7.89 0 189124 0
0.00 135804 161448
13:38:48 3864384 329920 7.87 0 189112 0
0.00 134964 161564
13:38:58 3864288 330016 7.87 0 188848 0
0.00 134772 161700
13:39:08 3862144 332160 7.92 0 188780 0
0.00 136076 161696
13:39:18 3864708 329596 7.86 0 188576 0
0.00 134124 161624
13:39:28 3867868 326436 7.78 0 188584 0
0.00 131236 161632
13:39:38 3867528 326776 7.79 0 188808 0
0.00 131584 161636
13:39:48 3866816 327488 7.81 0 188832 0
0.00 132080 161664
13:39:58 3866976 327328 7.80 0 188872 0
0.00 131924 161680
13:40:08 3867268 327036 7.80 0 188092 0
0.00 131528 161640
13:40:18 3865480 328824 7.84 0 188072 0
0.00 133564 161656
13:40:28 3865668 328636 7.84 0 188264 0
0.00 133196 161836
13:40:38 3864408 329896 7.87 0 188580 0
0.00 134444 161688
13:40:48 3864172 330132 7.87 0 188616 0
0.00 134580 161704
13:40:58 3864660 329644 7.86 0 188668 0
0.00 134184 161704
13:41:08 3862772 331532 7.90 0 188592 0
0.00 135604 161700
13:41:18 3864280 330024 7.87 0 189352 0
0.00 136060 160596
13:41:28 3864260 330044 7.87 0 189368 0
0.00 136084 160592
13:41:38 3864272 330032 7.87 0 189372 0
0.00 136092 160596
13:41:48 3864112 330192 7.87 0 189360 0
0.00 136224 160584
13:41:58 3864252 330052 7.87 0 189352 0
0.00 136080 160588
13:42:08 3864100 330204 7.87 0 189276 0
0.00 136244 160576
13:42:18 3860488 333816 7.96 0 189732 0
0.00 136564 162872
13:42:28 3856984 337320 8.04 0 189748 0
0.00 139656 162880
13:42:38 3855716 338588 8.07 0 189776 0
0.00 140324 162892
13:42:48 3854812 339492 8.09 0 189780 0
0.00 140752 162868
13:42:58 3854780 339524 8.09 0 189784 0
0.00 140784 162868
13:43:08 3854720 339584 8.10 0 189764 0
0.00 140860 162848
13:43:18 3854900 339404 8.09 0 189544 0
0.00 140688 162840
13:43:28 3859020 335284 7.99 0 189516 0
0.00 138244 162824
13:43:38 3852900 341404 8.14 0 189560 0
0.00 142732 162832
_______________________________________________
icinga-users mailing list
icinga-users@lists.icinga.org
https://lists.icinga.org/mailman/listinfo/icinga-users
