Hi,
I have a Kamailio 3.3.3 server that currently reports the following
errors upon execution of t_relay() for certain initial INVITEs.
daemon.err /usr/sbin/kamailio[26916]: ERROR: <core>
[sip_msg_clone.c:505]: ERROR: sip_msg_cloner: cannot allocate memory
daemon.err /usr/sbin/kamailio[26916]: ERROR: tm [t_lookup.c:1338]:
ERROR: new_t: out of mem:
daemon.err /usr/sbin/kamailio[26917]: ERROR: tm [t_lookup.c:1478]:
ERROR: t_newtran: new_t failed
I understand this error to be related to shared memory, based on [1].
However, sercmd reports normal shared memory utilization:
# sercmd core.shmmem
{
total: 67108864
free: 43189728
used: 20505784
real_used: 23919136
max_used: 65948568
fragments: 36887
}
These figures are quite similar to another server with the same
configuration and Kamailio version, which is not reporting out-of-memory
errors.
# sercmd core.shmmem
{
total: 67108864
free: 40219536
used: 23241952
real_used: 26889328
max_used: 66306288
fragments: 37832
}
I recently saw similar symptoms on a Kamailio 4.0.4 server, but
Kamailio unfortunately crashed before I could get further details. In
this case, I can consistently duplicate the problem with certain
INVITEs. It seems that the failure is somehow related to the size of the
SIP headers. For example, I have an INVITE from a Polycom phone which
t_relay() routes successfully with 741 bytes of headers (total SIP
length 1039 bytes). However, it seems that if I add one character to any
of its SIP headers (742 bytes of headers; total SIP length 1039 bytes)
the t_relay() will consistently fail.
This binary doesn't have DBG_QM_MALLOC configured (I am working on
getting it re-compiled). However, since I don't know what caused the
problem, I would still like to get as much information as I can out of
the running system. I have attached the output of mi_statistics, as well
as mem_dump_pkg for the external UDP receivers and the ctl handler. Are
there any other diagnostics that could be useful?
-Andrew
[1]
http://www.kamailio.org/dokuwiki/doku.php/troubleshooting:faq#qwhat_does_errorsip_msg_clonercannot_allocate_memory_and_errornew_tout_of_memmean_and_how_do_i_fix_them
# sercmd ps
26893 attendant
26906 udp receiver child=0 sock=127.0.0.1:5060
26907 udp receiver child=1 sock=127.0.0.1:5060
26908 udp receiver child=2 sock=127.0.0.1:5060
26909 udp receiver child=3 sock=127.0.0.1:5060
26910 udp receiver child=0 sock=10.246.16.27:5060
26915 udp receiver child=1 sock=10.246.16.27:5060
26916 udp receiver child=2 sock=10.246.16.27:5060
26917 udp receiver child=3 sock=10.246.16.27:5060
26918 slow timer
26919 timer
26936 ctl handler
26937 tcp receiver (generic) child=0
26938 tcp receiver (generic) child=1
26939 tcp receiver (generic) child=2
26944 tcp receiver (generic) child=3
26946 tcp main process
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT: <core>
[pt.c:558]: Memory status (pkg) of process 26910:
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: fm_status (0x536e5008):
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: heap size= 8388608
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: used= 1373840, used+overhead=1496776, free=6891832
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: max used (+overhead)= 1785352
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: dumping free list:
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 0 fragments no.: 2, unused: 0 bucket
size: 0 - 0 (first 0)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 1 fragments no.: 2886, unused: 0 bucket
size: 8 - 8 (first 8)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 2 fragments no.: 1946, unused: 0 bucket
size: 16 - 16 (first 16)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 3 fragments no.: 3, unused: 0 bucket
size: 24 - 24 (first 24)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 4 fragments no.: 807, unused: 0 bucket
size: 32 - 32 (first 32)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 5 fragments no.: 197, unused: 0 bucket
size: 40 - 40 (first 40)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 12 fragments no.: 17, unused: 0 bucket
size: 96 - 96 (first 96)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 16 fragments no.: 38, unused: 0 bucket
size: 128 - 128 (first 128)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 20 fragments no.: 645, unused: 0 bucket
size: 160 - 160 (first 160)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 22 fragments no.: 1, unused: 0 bucket
size: 176 - 176 (first 176)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 24 fragments no.: 1, unused: 0 bucket
size: 192 - 192 (first 192)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 27 fragments no.: 1, unused: 0 bucket
size: 216 - 216 (first 216)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 31 fragments no.: 1, unused: 0 bucket
size: 248 - 248 (first 248)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 32 fragments no.: 1, unused: 0 bucket
size: 256 - 256 (first 256)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 45 fragments no.: 497, unused: 0 bucket
size: 360 - 360 (first 360)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 64 fragments no.: 1, unused: 0 bucket
size: 512 - 512 (first 512)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 79 fragments no.: 1, unused: 0 bucket
size: 632 - 632 (first 632)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 113 fragments no.: 32, unused: 0 bucket
size: 904 - 904 (first 904)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 128 fragments no.: 1, unused: 0 bucket
size: 1024 - 1024 (first 1024)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 173 fragments no.: 1, unused: 0 bucket
size: 1384 - 1384 (first 1384)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 181 fragments no.: 1, unused: 0 bucket
size: 1448 - 1448 (first 1448)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 182 fragments no.: 1, unused: 0 bucket
size: 1456 - 1456 (first 1456)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 292 fragments no.: 1, unused: 0 bucket
size: 2336 - 2336 (first 2336)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 315 fragments no.: 1, unused: 0 bucket
size: 2520 - 2520 (first 2520)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 327 fragments no.: 1, unused: 0 bucket
size: 2616 - 2616 (first 2616)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 357 fragments no.: 1, unused: 0 bucket
size: 2856 - 2856 (first 2856)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 386 fragments no.: 2, unused: 0 bucket
size: 3088 - 3088 (first 3088)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 415 fragments no.: 1, unused: 0 bucket
size: 3320 - 3320 (first 3320)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 417 fragments no.: 1, unused: 0 bucket
size: 3336 - 3336 (first 3336)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: hash = 2057 fragments no.: 1, unused: 0 bucket
size: 4194304 - 8388608 (first 6455584)
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: TOTAL: 7090 free fragments = 6891832 free bytes
Nov 27 13:25:20 HOSTNAME daemon.alert /usr/sbin/kamailio[26910]: ALERT:
fm_status: -----------------------------
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT: <core>
[pt.c:558]: Memory status (pkg) of process 26915:
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: fm_status (0x536e5008):
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: heap size= 8388608
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: used= 1375512, used+overhead=1498448, free=6890160
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: max used (+overhead)= 1785352
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: dumping free list:
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 0 fragments no.: 2, unused: 0 bucket
size: 0 - 0 (first 0)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 1 fragments no.: 2886, unused: 0 bucket
size: 8 - 8 (first 8)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 2 fragments no.: 1945, unused: 0 bucket
size: 16 - 16 (first 16)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 3 fragments no.: 3, unused: 0 bucket
size: 24 - 24 (first 24)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 4 fragments no.: 782, unused: 0 bucket
size: 32 - 32 (first 32)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 5 fragments no.: 198, unused: 0 bucket
size: 40 - 40 (first 40)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 12 fragments no.: 14, unused: 0 bucket
size: 96 - 96 (first 96)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 16 fragments no.: 35, unused: 0 bucket
size: 128 - 128 (first 128)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 17 fragments no.: 1, unused: 0 bucket
size: 136 - 136 (first 136)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 20 fragments no.: 645, unused: 0 bucket
size: 160 - 160 (first 160)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 22 fragments no.: 1, unused: 0 bucket
size: 176 - 176 (first 176)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 24 fragments no.: 1, unused: 0 bucket
size: 192 - 192 (first 192)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 27 fragments no.: 1, unused: 0 bucket
size: 216 - 216 (first 216)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 31 fragments no.: 1, unused: 0 bucket
size: 248 - 248 (first 248)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 32 fragments no.: 1, unused: 0 bucket
size: 256 - 256 (first 256)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 45 fragments no.: 496, unused: 0 bucket
size: 360 - 360 (first 360)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 64 fragments no.: 1, unused: 0 bucket
size: 512 - 512 (first 512)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 79 fragments no.: 1, unused: 0 bucket
size: 632 - 632 (first 632)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 113 fragments no.: 32, unused: 0 bucket
size: 904 - 904 (first 904)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 115 fragments no.: 1, unused: 0 bucket
size: 920 - 920 (first 920)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 136 fragments no.: 1, unused: 0 bucket
size: 1088 - 1088 (first 1088)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 160 fragments no.: 1, unused: 0 bucket
size: 1280 - 1280 (first 1280)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 181 fragments no.: 1, unused: 0 bucket
size: 1448 - 1448 (first 1448)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 195 fragments no.: 1, unused: 0 bucket
size: 1560 - 1560 (first 1560)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 198 fragments no.: 1, unused: 0 bucket
size: 1584 - 1584 (first 1584)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 240 fragments no.: 1, unused: 0 bucket
size: 1920 - 1920 (first 1920)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 285 fragments no.: 1, unused: 0 bucket
size: 2280 - 2280 (first 2280)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 386 fragments no.: 2, unused: 0 bucket
size: 3088 - 3088 (first 3088)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 415 fragments no.: 1, unused: 0 bucket
size: 3320 - 3320 (first 3320)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 417 fragments no.: 1, unused: 0 bucket
size: 3336 - 3336 (first 3336)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: hash = 2057 fragments no.: 1, unused: 0 bucket
size: 4194304 - 8388608 (first 6459144)
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: TOTAL: 7059 free fragments = 6890160 free bytes
Nov 27 13:25:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26915]: ALERT:
fm_status: -----------------------------
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT: <core>
[pt.c:558]: Memory status (pkg) of process 26916:
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: fm_status (0x536e5008):
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: heap size= 8388608
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: used= 1376960, used+overhead=1499920, free=6888688
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: max used (+overhead)= 1785352
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: dumping free list:
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 0 fragments no.: 2, unused: 0 bucket
size: 0 - 0 (first 0)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 1 fragments no.: 2886, unused: 0 bucket
size: 8 - 8 (first 8)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 2 fragments no.: 1935, unused: 0 bucket
size: 16 - 16 (first 16)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 3 fragments no.: 3, unused: 0 bucket
size: 24 - 24 (first 24)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 4 fragments no.: 798, unused: 0 bucket
size: 32 - 32 (first 32)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 5 fragments no.: 197, unused: 0 bucket
size: 40 - 40 (first 40)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 12 fragments no.: 6, unused: 0 bucket
size: 96 - 96 (first 96)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 16 fragments no.: 27, unused: 0 bucket
size: 128 - 128 (first 128)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 20 fragments no.: 645, unused: 0 bucket
size: 160 - 160 (first 160)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 22 fragments no.: 1, unused: 0 bucket
size: 176 - 176 (first 176)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 24 fragments no.: 1, unused: 0 bucket
size: 192 - 192 (first 192)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 27 fragments no.: 1, unused: 0 bucket
size: 216 - 216 (first 216)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 31 fragments no.: 1, unused: 0 bucket
size: 248 - 248 (first 248)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 32 fragments no.: 1, unused: 0 bucket
size: 256 - 256 (first 256)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 45 fragments no.: 497, unused: 0 bucket
size: 360 - 360 (first 360)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 64 fragments no.: 1, unused: 0 bucket
size: 512 - 512 (first 512)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 79 fragments no.: 1, unused: 0 bucket
size: 632 - 632 (first 632)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 89 fragments no.: 1, unused: 0 bucket
size: 712 - 712 (first 712)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 113 fragments no.: 31, unused: 0 bucket
size: 904 - 904 (first 904)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 124 fragments no.: 1, unused: 0 bucket
size: 992 - 992 (first 992)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 140 fragments no.: 1, unused: 0 bucket
size: 1120 - 1120 (first 1120)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 158 fragments no.: 1, unused: 0 bucket
size: 1264 - 1264 (first 1264)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 170 fragments no.: 1, unused: 0 bucket
size: 1360 - 1360 (first 1360)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 175 fragments no.: 1, unused: 0 bucket
size: 1400 - 1400 (first 1400)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 190 fragments no.: 1, unused: 0 bucket
size: 1520 - 1520 (first 1520)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 269 fragments no.: 1, unused: 0 bucket
size: 2152 - 2152 (first 2152)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 298 fragments no.: 1, unused: 0 bucket
size: 2384 - 2384 (first 2384)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 313 fragments no.: 1, unused: 0 bucket
size: 2504 - 2504 (first 2504)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 327 fragments no.: 1, unused: 0 bucket
size: 2616 - 2616 (first 2616)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 357 fragments no.: 1, unused: 0 bucket
size: 2856 - 2856 (first 2856)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 386 fragments no.: 2, unused: 0 bucket
size: 3088 - 3088 (first 3088)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 415 fragments no.: 1, unused: 0 bucket
size: 3320 - 3320 (first 3320)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 417 fragments no.: 1, unused: 0 bucket
size: 3336 - 3336 (first 3336)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: hash = 2057 fragments no.: 1, unused: 0 bucket
size: 4194304 - 8388608 (first 6451032)
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: TOTAL: 7051 free fragments = 6888688 free bytes
Nov 27 13:26:09 HOSTNAME daemon.alert /usr/sbin/kamailio[26916]: ALERT:
fm_status: -----------------------------
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT: <core>
[pt.c:558]: Memory status (pkg) of process 26917:
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: fm_status (0x536e5008):
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: heap size= 8388608
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: used= 1374600, used+overhead=1497504, free=6891104
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: max used (+overhead)= 1785352
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: dumping free list:
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 0 fragments no.: 2, unused: 0 bucket
size: 0 - 0 (first 0)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 1 fragments no.: 2886, unused: 0 bucket
size: 8 - 8 (first 8)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 2 fragments no.: 1942, unused: 0 bucket
size: 16 - 16 (first 16)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 3 fragments no.: 3, unused: 0 bucket
size: 24 - 24 (first 24)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 4 fragments no.: 799, unused: 0 bucket
size: 32 - 32 (first 32)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 5 fragments no.: 197, unused: 0 bucket
size: 40 - 40 (first 40)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 12 fragments no.: 14, unused: 0 bucket
size: 96 - 96 (first 96)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 16 fragments no.: 34, unused: 0 bucket
size: 128 - 128 (first 128)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 20 fragments no.: 645, unused: 0 bucket
size: 160 - 160 (first 160)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 22 fragments no.: 1, unused: 0 bucket
size: 176 - 176 (first 176)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 24 fragments no.: 1, unused: 0 bucket
size: 192 - 192 (first 192)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 27 fragments no.: 1, unused: 0 bucket
size: 216 - 216 (first 216)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 31 fragments no.: 1, unused: 0 bucket
size: 248 - 248 (first 248)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 32 fragments no.: 1, unused: 0 bucket
size: 256 - 256 (first 256)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 45 fragments no.: 498, unused: 0 bucket
size: 360 - 360 (first 360)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 64 fragments no.: 1, unused: 0 bucket
size: 512 - 512 (first 512)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 79 fragments no.: 1, unused: 0 bucket
size: 632 - 632 (first 632)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 113 fragments no.: 32, unused: 0 bucket
size: 904 - 904 (first 904)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 175 fragments no.: 1, unused: 0 bucket
size: 1400 - 1400 (first 1400)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 190 fragments no.: 1, unused: 0 bucket
size: 1520 - 1520 (first 1520)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 210 fragments no.: 1, unused: 0 bucket
size: 1680 - 1680 (first 1680)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 228 fragments no.: 1, unused: 0 bucket
size: 1824 - 1824 (first 1824)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 327 fragments no.: 1, unused: 0 bucket
size: 2616 - 2616 (first 2616)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 386 fragments no.: 1, unused: 0 bucket
size: 3088 - 3088 (first 3088)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 414 fragments no.: 1, unused: 0 bucket
size: 3312 - 3312 (first 3312)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 469 fragments no.: 1, unused: 0 bucket
size: 3752 - 3752 (first 3752)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: hash = 2057 fragments no.: 1, unused: 0 bucket
size: 4194304 - 8388608 (first 6464896)
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: TOTAL: 7068 free fragments = 6891104 free bytes
Nov 27 13:26:25 HOSTNAME daemon.alert /usr/sbin/kamailio[26917]: ALERT:
fm_status: -----------------------------
Nov 28 20:36:47 HOSTNAME daemon.info /usr/sbin/kamailio[26936]: INFO: <core>
[cfg/cfg_ctx.c:613]: INFO: cfg_set_now(): core.mem_dump_pkg has been changed to
26936
Nov 28 20:36:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26936]: ALERT: <core>
[pt.c:558]: Memory status (pkg) of process 26936:
Nov 28 20:36:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26936]: ALERT:
fm_status: fm_status (0x536e5008):
Nov 28 20:36:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26936]: ALERT:
fm_status: heap size= 8388608
Nov 28 20:36:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26936]: ALERT:
fm_status: used= 1360528, used+overhead=1485312, free=6903296
Nov 28 20:36:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26936]: ALERT:
fm_status: max used (+overhead)= 1785352
Nov 28 20:36:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26936]: ALERT:
fm_status: dumping free list:
Nov 28 20:36:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26936]: ALERT:
fm_status: hash = 1 fragments no.: 2873, unused: 0 bucket
size: 8 - 8 (first 8)
Nov 28 20:36:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26936]: ALERT:
fm_status: hash = 2 fragments no.: 2103, unused: 0 bucket
size: 16 - 16 (first 16)
Nov 28 20:36:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26936]: ALERT:
fm_status: hash = 3 fragments no.: 3, unused: 0 bucket
size: 24 - 24 (first 24)
Nov 28 20:36:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26936]: ALERT:
fm_status: hash = 4 fragments no.: 899, unused: 0 bucket
size: 32 - 32 (first 32)
Nov 28 20:36:47 HOSTNAME daemon.alert /usr/sbin/kamailio[26936]: ALERT:
fm_status: hash = 5 fragments no.: 133, unused: 0 bucket
size: 40 - 40 (first 40)
# sercmd mi get_statistics all
:: core:bad_URIs_rcvd = 0
:: core:bad_msg_hdr = 0
:: core:drop_replies = 0
:: core:drop_requests = 1034
:: core:err_replies = 0
:: core:err_requests = 0
:: core:fwd_replies = 453
:: core:fwd_requests = 1490
:: core:rcv_replies = 130686
:: core:rcv_requests = 532178
:: core:unsupported_methods = 0
:: dialog:active_dialogs = 0
:: dialog:early_dialogs = 0
:: dialog:expired_dialogs = 0
:: dialog:failed_dialogs = 506
:: dialog:processed_dialogs = 2458
:: dns:failed_dns_request = 171
:: registrar:accepted_regs = 324511
:: registrar:default_expire = 3600
:: registrar:default_expires_range = 0
:: registrar:max_contacts = 0
:: registrar:max_expires = 0
:: registrar:rejected_regs = 0
:: shmem:fragments = 36949
:: shmem:free_size = 43208760
:: shmem:max_used_size = 65948568
:: shmem:real_used_size = 23900104
:: shmem:total_size = 67108864
:: shmem:used_size = 20486656
:: sl:1xx_replies = 0
:: sl:200_replies = 324511
:: sl:202_replies = 0
:: sl:2xx_replies = 0
:: sl:300_replies = 0
:: sl:301_replies = 0
:: sl:302_replies = 0
:: sl:3xx_replies = 0
:: sl:400_replies = 0
:: sl:401_replies = 191305
:: sl:403_replies = 0
:: sl:404_replies = 0
:: sl:407_replies = 0
:: sl:408_replies = 0
:: sl:483_replies = 0
:: sl:4xx_replies = 0
:: sl:500_replies = 3604
:: sl:5xx_replies = 14
:: sl:6xx_replies = 0
:: sl:failures = 2
:: sl:received_ACKs = 1034
:: sl:sent_err_replies = 0
:: sl:sent_replies = 519441
:: sl:xxx_replies = 7
:: tcp:con_reset = 0
:: tcp:con_timeout = 0
:: tcp:connect_failed = 24
:: tcp:connect_success = 0
:: tcp:current_opened_connections = 0
:: tcp:current_write_queue_size = 0
:: tcp:established = 0
:: tcp:local_reject = 0
:: tcp:passive_open = 0
:: tcp:send_timeout = 0
:: tcp:sendq_full = 0
:: tmx:2xx_transactions = 98956
:: tmx:3xx_transactions = 164
:: tmx:4xx_transactions = 76815
:: tmx:5xx_transactions = 2521
:: tmx:6xx_transactions = 0
:: tmx:UAC_transactions = 94744
:: tmx:UAS_transactions = 178370
:: tmx:inuse_transactions = 1
:: tmx:local_replies = 104767
:: usrloc:location-contacts = 13
:: usrloc:location-expires = 18743
:: usrloc:location-users = 13
:: usrloc:registered_users = 13
_______________________________________________
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list
sr-users@lists.sip-router.org
http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
