I hope i captured all relevant log entries on master since debug level sure
produces a lot of output :)
Master log:
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/NotificationComponent: Attempting to send
reminder notification for object 'NotificationTest'
[2015-04-20 16:50:48 +0200] information/Notification: Attempting to send
notifications for notification object
'NotificationTest!dc1.test.host-notify-by-mail'.
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] debug/Notification: Type 'Problem', TypeFilter OK,
Warning, Unknown, Up, Down, DowntimeEnd, DowntimeRemoved, Custom,
Acknowledgement, Problem, Recovery, FlappingStart and FlappingEnd (FType=32,
TypeFilter=511)
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] debug/Notification: State 'Down', StateFilter Up
and Down (FState=32, StateFilter=48)
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] debug/Notification: User notification, Type
'Problem', TypeFilter Up, Down, Acknowledgement, Problem, Recovery and
FlappingStart (FType=32, TypeFilter=511)
[2015-04-20 16:50:48 +0200] debug/Notification: User notification, State
'Down', StateFilter OK, Warning, Up, Down, DowntimeEnd, DowntimeRemoved,
Custom, Acknowledgement, Problem, Recovery and FlappingStart (FState=32,
StateFilter=55)
[2015-04-20 16:50:48 +0200] information/Notification: Sending notification
'NotificationTest!dc1.test.host-notify-by-mail' for user 'icingaadmin'
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] debug/DbEvents: add notification history for
'NotificationTest'
[2015-04-20 16:50:48 +0200] debug/IdoPgsqlConnection: Query: UPDATE
icinga_hoststatus SET last_notification = TO_TIMESTAMP(1429541448),
next_notification = TO_TIMESTAMP(1429541478) WHERE host_object_id = 2842 AND
instance_id = 1
[2015-04-20 16:50:48 +0200] debug/DbEvents: add contact notification history
for service 'NotificationTest' and user 'icingaadmin'.
[2015-04-20 16:50:48 +0200] debug/IdoPgsqlConnection: Query: INSERT INTO
icinga_notifications (contacts_notified, end_time, end_time_usec,
endpoint_object_id, escalated, instance_id, long_output, notification_reason,
notification_type, object_id, output, start_time, start_time_usec, state)
VALUES (E'1', TO_TIMESTAMP(1429541448), E'307506', 3, E'0', 1, E'', E'0', E'1',
2842, E'PING CRITICAL - Packet loss = 100%', TO_TIMESTAMP(1429541448),
E'307506', E'1')
[2015-04-20 16:50:48 +0200] notice/Process: Running command
'/etc/icinga2/scripts/mail-host-notification.sh': PID 4619
[2015-04-20 16:50:48 +0200] debug/DbEvents: add log entry history for
'NotificationTest'
[2015-04-20 16:50:48 +0200] information/Notification: Completed sending
notification 'NotificationTest!dc1.test.host-notify-by-mail' for checkable
'NotificationTest'
[2015-04-20 16:50:48 +0200] debug/IdoPgsqlConnection: Query: SELECT
CURRVAL(pg_get_serial_sequence(E'icinga_notifications', E'notification_id')) AS
id
[2015-04-20 16:50:48 +0200] debug/IdoPgsqlConnection: Sequence Value: 675
[2015-04-20 16:50:48 +0200] debug/IdoPgsqlConnection: saving
contactnotification notification_id=675
[2015-04-20 16:50:48 +0200] debug/IdoPgsqlConnection: Query: INSERT INTO
icinga_contactnotifications (contact_object_id, end_time, end_time_usec,
instance_id, notification_id, start_time, start_time_usec) VALUES (2529,
TO_TIMESTAMP(1429541448), E'307506', 1, 675, TO_TIMESTAMP(1429541448),
E'307506')
[2015-04-20 16:50:48 +0200] debug/IdoPgsqlConnection: Query: INSERT INTO
icinga_logentries (endpoint_object_id, entry_time, entry_time_usec,
instance_id, logentry_data, logentry_time, logentry_type, object_id) VALUES (3,
TO_TIMESTAMP(1429541448), E'309433', 1, E'HOST NOTIFICATION:
icingaadmin;NotificationTest;PROBLEM (DOWN);hostalive;PING CRITICAL - Packet
loss = 100%', TO_TIMESTAMP(1429541448), E'524288', 2842)
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Sending message to 'satellite-b'
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:48 +0200] notice/Process: PID 4619
('/etc/icinga2/scripts/mail-host-notification.sh') terminated with exit code 0
Satellite log:
[2015-04-20 16:50:46 +0200] notice/CheckerComponent: Pending checkables: 0;
Idle checkables: 2; Checks/s: 0.2
[2015-04-20 16:50:46 +0200] debug/ApiListener: Not connecting to Zone 'root'
because we're already connected to it.
[2015-04-20 16:50:46 +0200] debug/ApiListener: Not connecting to Endpoint
'satellite-b' because that's us.
[2015-04-20 16:50:46 +0200] debug/ApiListener: Not connecting to Zone
'global-config' because it's not in the same zone, a parent or a child zone.
[2015-04-20 16:50:46 +0200] notice/ApiListener: Setting log position for
identity 'master': 2015/04/20 16:50:06
[2015-04-20 16:50:46 +0200] notice/ApiListener: Current zone master: satellite-b
[2015-04-20 16:50:46 +0200] notice/ApiListener: Connected endpoints: master (1)
[2015-04-20 16:50:46 +0200] notice/WorkQueue: #5 tasks: 0
[2015-04-20 16:50:46 +0200] debug/CheckerComponent: Executing check for
'NotificationTest'
[2015-04-20 16:50:46 +0200] debug/CheckerComponent: Check finished for object
'NotificationTest'
[2015-04-20 16:50:46 +0200] notice/ApiListener: Relaying 'event::SetNextCheck'
message
[2015-04-20 16:50:46 +0200] notice/ApiListener: Sending message to 'master'
[2015-04-20 16:50:46 +0200] notice/Process: PID 13984
('/usr/lib/nagios/plugins/check_ping' '-H' '1.2.3.4' '-c' '5000,100%' '-w'
'3000,80%') terminated with exit code 2
[2015-04-20 16:50:46 +0200] notice/ApiListener: Relaying 'event::CheckResult'
message
[2015-04-20 16:50:46 +0200] notice/ApiListener: Sending message to 'master'
[2015-04-20 16:50:46 +0200] notice/Checkable: State Change: Checkable
NotificationTest hard state change from DOWN to DOWN detected.
[2015-04-20 16:50:47 +0200] notice/ApiClient: Received 'event::Heartbeat'
message from 'master'
[2015-04-20 16:50:48 +0200] notice/ApiClient: Received 'log::SetLogPosition'
message from 'master'
[2015-04-20 16:50:48 +0200] notice/ApiClient: Received
'event::SetNextNotification' message from 'master'
[2015-04-20 16:50:48 +0200] notice/ApiListener: Relaying
'event::SetNextNotification' message
[2015-04-20 16:50:51 +0200] notice/CheckerComponent: Pending checkables: 0;
Idle checkables: 2; Checks/s: 0.4
Host object on master:
root@master:~# icinga2 object list --name NotificationTest
Object 'NotificationTest' of type 'Host':
% declared in '/etc/icinga2/zones.d/site-b/notification-test.conf', lines
31:1-31:30
* __name = "NotificationTest"
* action_url = "/pnp4nagios/index.php/graph?host=$host.name$&srv=_HOST_"
% = modified in '/etc/icinga2/zones.d/global-config/00-templates.conf',
lines 21:3-21:72
* address = "1.2.3.4"
% = modified in '/etc/icinga2/zones.d/site-b/notification-test.conf', lines
34:3-34:21
* address6 = ""
* check_command = "hostalive"
% = modified in '/etc/icinga2/zones.d/global-config/00-templates.conf',
lines 19:3-19:29
* check_interval = 30
% = modified in '/etc/icinga2/zones.d/global-config/00-templates.conf',
lines 16:3-16:21
% = modified in '/etc/icinga2/zones.d/site-b/notification-test.conf', lines
35:3-35:22
* check_period = ""
* command_endpoint = ""
* display_name = "NotificationTest"
% = modified in '/etc/icinga2/zones.d/site-b/notification-test.conf', lines
33:3-33:35
* enable_active_checks = true
* enable_event_handler = true
* enable_flapping = false
* enable_notifications = true
* enable_passive_checks = true
* enable_perfdata = true
* event_command = ""
* flapping_threshold = 30
* groups = [ ]
* icon_image = ""
* icon_image_alt = ""
* max_check_attempts = 5
% = modified in '/etc/icinga2/zones.d/global-config/00-templates.conf',
lines 15:3-15:24
* name = "NotificationTest"
* notes = ""
* notes_url = ""
* retry_interval = 30
% = modified in '/etc/icinga2/zones.d/global-config/00-templates.conf',
lines 17:3-17:22
* templates = [ "NotificationTest", "generic-host" ]
% = modified in '/etc/icinga2/zones.d/site-b/notification-test.conf', lines
31:1-31:30
% = modified in '/etc/icinga2/zones.d/global-config/00-templates.conf',
lines 14:1-14:28
* type = "Host"
* vars
* notification
* delay = 0
% = modified in '/etc/icinga2/zones.d/global-config/00-templates.conf',
lines 27:3-27:29
* interval = 30
% = modified in '/etc/icinga2/zones.d/global-config/00-templates.conf',
lines 26:3-26:34
% = modified in '/etc/icinga2/zones.d/site-b/notification-test.conf',
lines 37:3-37:34
* mail
% = modified in '/etc/icinga2/zones.d/global-config/00-templates.conf',
lines 23:3-25:3
* users = [ "icingaadmin" ]
% = modified in '/etc/icinga2/zones.d/site-b/notification-test.conf',
lines 38:3-38:46
* volatile = false
* zone = "site-b"
Host object on satellite:
root@satellite-b:~# icinga2 object list --name NotificationTest
Object 'NotificationTest' of type 'Host':
% declared in '/var/lib/icinga2/api/zones/site-b/notification-test.conf',
lines 31:1-31:30
* __name = "NotificationTest"
* action_url = "/pnp4nagios/index.php/graph?host=$host.name$&srv=_HOST_"
% = modified in
'/var/lib/icinga2/api/zones/global-config/00-templates.conf', lines 21:3-21:72
* address = "1.2.3.4"
% = modified in '/var/lib/icinga2/api/zones/site-b/notification-test.conf',
lines 34:3-34:21
* address6 = ""
* check_command = "hostalive"
% = modified in
'/var/lib/icinga2/api/zones/global-config/00-templates.conf', lines 19:3-19:29
* check_interval = 30
% = modified in
'/var/lib/icinga2/api/zones/global-config/00-templates.conf', lines 16:3-16:21
% = modified in '/var/lib/icinga2/api/zones/site-b/notification-test.conf',
lines 35:3-35:22
* check_period = ""
* command_endpoint = ""
* display_name = "NotificationTest"
% = modified in '/var/lib/icinga2/api/zones/site-b/notification-test.conf',
lines 33:3-33:35
* enable_active_checks = true
* enable_event_handler = true
* enable_flapping = false
* enable_notifications = true
* enable_passive_checks = true
* enable_perfdata = true
* event_command = ""
* flapping_threshold = 30
* groups = [ ]
* icon_image = ""
* icon_image_alt = ""
* max_check_attempts = 5
% = modified in
'/var/lib/icinga2/api/zones/global-config/00-templates.conf', lines 15:3-15:24
* name = "NotificationTest"
* notes = ""
* notes_url = ""
* retry_interval = 30
% = modified in
'/var/lib/icinga2/api/zones/global-config/00-templates.conf', lines 17:3-17:22
* templates = [ "NotificationTest", "generic-host" ]
% = modified in '/var/lib/icinga2/api/zones/site-b/notification-test.conf',
lines 31:1-31:30
% = modified in
'/var/lib/icinga2/api/zones/global-config/00-templates.conf', lines 14:1-14:28
* type = "Host"
* vars
* notification
* delay = 0
% = modified in
'/var/lib/icinga2/api/zones/global-config/00-templates.conf', lines 27:3-27:29
* interval = 30
% = modified in
'/var/lib/icinga2/api/zones/global-config/00-templates.conf', lines 26:3-26:34
% = modified in
'/var/lib/icinga2/api/zones/site-b/notification-test.conf', lines 37:3-37:34
* mail
% = modified in
'/var/lib/icinga2/api/zones/global-config/00-templates.conf', lines 23:3-25:3
* users = [ "icingaadmin" ]
% = modified in
'/var/lib/icinga2/api/zones/site-b/notification-test.conf', lines 38:3-38:46
* volatile = false
* zone = "site-b"
Notification object on master:
root@master:~# icinga2 object list --name
'NotificationTest!dc1.test.host-notify-by-mail'
Object 'NotificationTest!dc1.test.host-notify-by-mail' of type 'Notification':
% declared in '/etc/icinga2/zones.d/site-b/notification-test.conf', lines
1:0-1:56
* __name = "NotificationTest!dc1.test.host-notify-by-mail"
* command = "mail-host-notification"
% = modified in '/etc/icinga2/zones.d/global-config/00-templates.conf',
lines 62:3-62:36
% = modified in '/etc/icinga2/zones.d/site-b/notification-test.conf', lines
4:3-4:36
* command_endpoint = ""
* host_name = "NotificationTest"
% = modified in '/etc/icinga2/zones.d/site-b/notification-test.conf', lines
1:0-1:56
* interval = 30
% = modified in '/etc/icinga2/zones.d/site-b/notification-test.conf', lines
9:3-9:44
* name = "dc1.test.host-notify-by-mail"
* period = "24x7"
% = modified in '/etc/icinga2/zones.d/global-config/00-templates.conf',
lines 69:3-69:17
* service_name = ""
* states = [ 16, 32 ]
% = modified in '/etc/icinga2/zones.d/global-config/00-templates.conf',
lines 64:3-64:23
* templates = [ "dc1.test.host-notify-by-mail", "mail-host-notification" ]
% = modified in '/etc/icinga2/zones.d/site-b/notification-test.conf', lines
1:0-1:56
% = modified in '/etc/icinga2/zones.d/global-config/00-templates.conf',
lines 61:1-61:46
* times
* begin = 0
% = modified in '/etc/icinga2/zones.d/site-b/notification-test.conf',
lines 10:3-10:44
* type = "Notification"
* types = [ 32, 16, 64, 8, 128, 256, 1, 2, 4 ]
% = modified in '/etc/icinga2/zones.d/global-config/00-templates.conf',
lines 65:3-67:57
* user_groups = null
% = modified in '/etc/icinga2/zones.d/site-b/notification-test.conf', lines
7:3-7:50
* users = [ "icingaadmin" ]
% = modified in '/etc/icinga2/zones.d/site-b/notification-test.conf', lines
6:3-6:43
* vars = null
* zone = "site-b"
% = modified in '/etc/icinga2/zones.d/site-b/notification-test.conf', lines
1:0-1:56
Notification object on satellite:
root@satellite-b:~# icinga2 object list --name
'NotificationTest!dc1.test.host-notify-by-mail'
Object 'NotificationTest!dc1.test.host-notify-by-mail' of type 'Notification':
% declared in '/var/lib/icinga2/api/zones/site-b/notification-test.conf',
lines 1:0-1:56
* __name = "NotificationTest!dc1.test.host-notify-by-mail"
* command = "mail-host-notification"
% = modified in
'/var/lib/icinga2/api/zones/global-config/00-templates.conf', lines 62:3-62:36
% = modified in '/var/lib/icinga2/api/zones/site-b/notification-test.conf',
lines 4:3-4:36
* command_endpoint = ""
* host_name = "NotificationTest"
% = modified in '/var/lib/icinga2/api/zones/site-b/notification-test.conf',
lines 1:0-1:56
* interval = 30
% = modified in '/var/lib/icinga2/api/zones/site-b/notification-test.conf',
lines 9:3-9:44
* name = "dc1.test.host-notify-by-mail"
* period = "24x7"
% = modified in
'/var/lib/icinga2/api/zones/global-config/00-templates.conf', lines 69:3-69:17
* service_name = ""
* states = [ 16, 32 ]
% = modified in
'/var/lib/icinga2/api/zones/global-config/00-templates.conf', lines 64:3-64:23
* templates = [ "dc1.test.host-notify-by-mail", "mail-host-notification" ]
% = modified in '/var/lib/icinga2/api/zones/site-b/notification-test.conf',
lines 1:0-1:56
% = modified in
'/var/lib/icinga2/api/zones/global-config/00-templates.conf', lines 61:1-61:46
* times
* begin = 0
% = modified in
'/var/lib/icinga2/api/zones/site-b/notification-test.conf', lines 10:3-10:44
* type = "Notification"
* types = [ 32, 16, 64, 8, 128, 256, 1, 2, 4 ]
% = modified in
'/var/lib/icinga2/api/zones/global-config/00-templates.conf', lines 65:3-67:57
* user_groups = null
% = modified in '/var/lib/icinga2/api/zones/site-b/notification-test.conf',
lines 7:3-7:50
* users = [ "icingaadmin" ]
% = modified in '/var/lib/icinga2/api/zones/site-b/notification-test.conf',
lines 6:3-6:43
* vars = null
* zone = "site-b"
% = modified in '/var/lib/icinga2/api/zones/site-b/notification-test.conf',
lines 1:0-1:56
Features on master:
root@master:~# icinga2 feature list
Disabled features: debuglog gelf graphite icingastatus opentsdb syslog
Enabled features: api checker command compatlog ido-pgsql livestatus mainlog
notification perfdata statusdata
Features on satellite:
root@satellite-b:~# icinga2 feature list
Disabled features: command compatlog debuglog gelf graphite icingastatus
livestatus opentsdb perfdata statusdata syslog
Enabled features: api checker mainlog notification
Best regards,
Markus
_______________________________________________
icinga-users mailing list
icinga-users@lists.icinga.org
https://lists.icinga.org/mailman/listinfo/icinga-users
