Hello Antony,
thank you, so below you can see what I get by connecting to MySQL as a
privileged user and asking it to "show processlist” on both the nodes (one
running v2.4.10 and the second one running v2.3.11.
And also the output of top.
Thank you for any suggestion you can provide me.
Best regards,
Diana
On the Test node with v2.4.10
mysql> show processlist;
+----+--------+-----------+--------+---------+------+--------------------+------------------------------------------------------------------------------------------------------+
| Id | User | Host | db | Command | Time | State | Info
|
+----+--------+-----------+--------+---------+------+--------------------+------------------------------------------------------------------------------------------------------+
| 10 | icinga | localhost | icinga | Query | 0 | logging slow query |
UPDATE icinga_customvariablestatus SET instance_id = 1, is_json = '1',
object_id = 29554, session |
| 11 | root | localhost | NULL | Query | 0 | NULL | show
processlist
|
+----+--------+-----------+--------+---------+------+--------------------+———————————————————————————————————————————————————+
[root@pc-tdq-icinga-10 icinga2]# top
top - 13:00:30 up 105 days, 20:36, 1 user, load average: 7.74, 3.15, 1.19
Tasks: 964 total, 4 running, 960 sleeping, 0 stopped, 0 zombie
Cpu(s): 3.8%us, 8.1%sy, 18.5%ni, 69.4%id, 0.1%wa, 0.0%hi, 0.2%si, 0.0%st
Mem: 32769148k total, 29232284k used, 3536864k free, 115100k buffers
Swap: 8388604k total, 130352k used, 8258252k free, 1734700k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
7208 mysql 20 0 1235g 21g 3488 S 67.4 70.4 61:22.81 mysqld
18141 icinga 20 0 5190m 2.9g 4508 S 33.4 9.3 4:24.51 icinga2
25013 nscd 20 0 2635m 6472 2556 S 9.9 0.0 9:18.50 nscd
On the Prod node with v2.3.11
mysql> show processlist;
+---------+--------+-----------+--------+---------+------+-------+------------------------------------------------------------------------------------------------------+
| Id | User | Host | db | Command | Time | State | Info
|
+---------+--------+-----------+--------+---------+------+-------+------------------------------------------------------------------------------------------------------+
| 2710527 | icinga | localhost | icinga | Query | 0 | init | UPDATE
icinga_servicestatus SET is_reachable = '1' WHERE instance_id = 1 AND
service_object_id = 606 |
| 2753534 | root | localhost | NULL | Query | 0 | NULL | show
processlist
|
+---------+--------+-----------+--------+---------+------+-------+------------------------------------------------------------------------------------------------------+
2 rows in set (0.00 sec)
[root@pc-tdq-icinga-20 ~]# top
top - 15:19:46 up 107 days, 23:16, 1 user, load average: 3.03, 2.89, 2.81
Tasks: 628 total, 4 running, 624 sleeping, 0 stopped, 0 zombie
Cpu(s): 13.8%us, 3.8%sy, 8.1%ni, 74.2%id, 0.0%wa, 0.0%hi, 0.1%si, 0.0%st
Mem: 32769148k total, 22961580k used, 9807568k free, 558044k buffers
Swap: 8388604k total, 0k used, 8388604k free, 13565356k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1465 apache 20 0 384m 360m 90m R 99.9 1.1 0:07.66 status.cgi
666 apache 20 0 384m 356m 86m R 99.6 1.1 0:08.66 tac.cgi
18195 icinga 20 0 5692m 1.9g 5476 S 74.3 6.1 2090:52 icinga2
453 mysql 20 0 12.1g 4.0g 5120 S 68.0 12.9 71563:01 mysqld
3556 root 20 0 140m 38m 1128 S 4.3 0.1 3225:36 gmetricsd
On 29 Jun 2016, at 18:27, Antony Stone <antony.st...@icinga.open.source.it>
wrote:
> On Wednesday 29 June 2016 at 15:52:54, Diana Scannicchio wrote:
>
>> We tried few months ago to upgrade to v2.4.1, unfortunately the restart of
>> the icinga2 service was hanging forever apparently due to some bad
>> interaction with mysql. Once we disabled ido-mysql, it started. We setup
>> a test server, identical to the production one with the exception of the
>> HA, to be able to play and we observed the same behaviour.
>
>> [2016-06-01 16:19:03 +0200] information/IdoMysqlConnection: Query queue
>> items: 987844, query rate: 0.7/s (42/min 46/5min 2251/15min); empty in
>> infinite time, your database isn't able to keep up
>
> Are you doing any MySQL logging (for example, slow queries) to see what it
> thinks is going on?
>
> If not, what do you get by connecting to MySQL as a privileged user and
> asking
> it to "show processlist"?
>
> Also, what do you see in 'top' for CPU and memory usage for MySQL?
>
>
> Antony.
>
> --
> The Magic Words are Squeamish Ossifrage.
>
> Please reply to the list;
> please *don't* CC me.
> _______________________________________________
> icinga-users mailing list
> icinga-users@lists.icinga.org
> https://lists.icinga.org/mailman/listinfo/icinga-users
-
Diana Scannicchio
University of California, Irvine
ATLAS TDAQ SysAdmin group
Office: +41 22 76 75240
OnCall: 164851
_______________________________________________
icinga-users mailing list
icinga-users@lists.icinga.org
https://lists.icinga.org/mailman/listinfo/icinga-users
