Dear Icinga 2 users, This is my first post to the list and it is probably a good thing Icinga-wise as this is the first time I have run into problems that I wasn't able to solve myself. But now I am in need of some help...
Yesterday I ran a mass yum upgrade on my CentOS servers and I did not really checkup upon the fact that Icinga2 was to be upgraded from 2.4.10-1 to 2.5.3-1. Hells bells! My nodes managed the upgrade quite well. Had to add the constant PluginContribDir to a couple of constants.conf files manually and remove check_yum from my local commands.conf. But I ended up with all of them running afterwards. A few of them had to be restarted a couple of times before running stable again. My master server did not manage the upgrade quite as well. It broke down! It was a bit chaotic. So I performed a rollback using "yum history undo". Probably not the best idea as the database schema could be out of sync ... Back on version 2.4 it now looked as if one of my satellites was lost (missing its configuration) so the hosts.conf had configuration errors. Also a satellite once removed turned up again. I fixed the errors by adding the missing node again and removing the surplus (removed the references from /etc/icinga2/repository.d. Everything was up and running fine again. So I made a snapshot of my Icinga virtual server and performed the upgrade to version 2.5 again. It was still broken though the configuration checked out to be fine! It looks as if it just dies while starting (I think it was the same error I got just before panicking and rolling back to version 2.4): [2016-08-29 15:03:42 +0200] information/cli: Icinga application loader (version: v2.5.3) [2016-08-29 15:03:42 +0200] information/cli: Loading configuration file(s). [2016-08-29 15:03:42 +0200] information/ConfigItem: Committing config item(s). [2016-08-29 15:03:42 +0200] information/ApiListener: My API identity: icinga.aub.aau.dk [2016-08-29 15:03:43 +0200] warning/ApplyRule: Apply rule 'satellite-host' (in /etc/icinga2/conf.d/satellite.conf: 29:1-29:41) for type 'Dependency' does not match anywhere! [2016-08-29 15:03:43 +0200] warning/ApplyRule: Apply rule 'backup-downtime' (in /etc/icinga2/conf.d/downtimes.conf: 5:1-5:52) for type 'ScheduledDowntime' does not match anywhere! [2016-08-29 15:03:43 +0200] warning/ApplyRule: Apply rule '' (in /etc/icinga2/conf.d/services.conf: 293:1-293:64) for type 'Service' does not match anywhere! [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 1 ApiListener. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 27 Zones. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 1 FileLogger. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 27 Endpoints. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 4 NotificationCommands. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 629 Notifications. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 186 CheckCommands. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 49 Hosts. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 1 IcingaApplication. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 5 HostGroups. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 2 UserGroups. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 3 Users. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 615 Services. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 3 TimePeriods. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 10 ServiceGroups. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 1 CheckerComponent. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 1 ExternalCommandListener. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 1 GraphiteWriter. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 1 PerfdataWriter. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 1 CompatLogger. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 1 IdoMysqlConnection. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 1 LivestatusListener. [2016-08-29 15:03:43 +0200] information/ConfigItem: Instantiated 1 NotificationComponent. [2016-08-29 15:03:43 +0200] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' [2016-08-29 15:03:43 +0200] information/ConfigObject: Restoring program state from file '/var/lib/icinga2/icinga2.state' [2016-08-29 15:03:43 +0200] information/ConfigObject: Restored 1559 objects. Loaded 13 new objects without state. [2016-08-29 15:03:43 +0200] information/ConfigItem: Triggering Start signal for config items [2016-08-29 15:03:43 +0200] information/ApiListener: Adding new listener on port '5665' [2016-08-29 15:03:43 +0200] information/JsonRpcConnection: Reconnecting to API endpoint 'aleph21.aub.aau.dk' via host '130.225.53.10' and port '5665' [2016-08-29 15:03:43 +0200] information/JsonRpcConnection: Reconnecting to API endpoint 'amalthea.aub.aau.dk' via host '130.225.53.28' and port '5665' [2016-08-29 15:03:43 +0200] information/JsonRpcConnection: Reconnecting to API endpoint 'atticus.aub.aau.dk' via host '130.225.53.58' and port '5665' [2016-08-29 15:03:43 +0200] information/JsonRpcConnection: Reconnecting to API endpoint 'barracuda.aub.aau.dk' via host '130.225.53.23' and port '5665' [2016-08-29 15:03:43 +0200] information/JsonRpcConnection: Reconnecting to API endpoint 'dns1.aub.aau.dk' via host '130.225.53.2' and port '5665' [2016-08-29 15:03:43 +0200] information/JsonRpcConnection: Reconnecting to API e This is it... Icinga just dies here. So at the moment my nodes are running 2.5 and the server is on 2.4. It looks as if it works but it would be really nice to get it on 2.5 as well and fix the problems. Anyone with an idea where to look for the culprit of this? Thanks a lot, Kasper Løvschall [cid:image001.png@01D202AE.98C88990] Kasper Løvschall Senior Adviser | The University Library Phone: (+45) 99 40 73 03 | Mobile: (+45) 28 95 91 29 | Email: k...@aub.aau.dk<mailto:k...@aub.aau.dk> | Web: http://www.en.aub.aau.dk<http://www.en.aub.aau.dk/> Aalborg University Library | Langagervej 2 | 9220 Aalborg Ø | Denmark
_______________________________________________ icinga-users mailing list icinga-users@lists.icinga.org https://lists.icinga.org/mailman/listinfo/icinga-users
