OK, I filed a bug about this:

https://bugs.openvz.org/browse/OVZ-6678

As my workaround worked for you too, I believe you hit the same bug.
Can you check CT config for CPU-related parameters (CPUS, CPUUNITS,
and CPULIMIT)?

On 02/04/2016 01:21 PM, Bogdan-Stefan Rotariu wrote:
On 04 Feb 2016, at 21:02, Kir Kolyshkin <k...@virtuozzo.com> wrote:

Hi Bogdan,
Hi!

This looks very much like a cpu scheduler lockup, as many of the processes
belonging to the container are in R state but not running.

Can you try resetting the cpulimit for the container in question, something like

vzctl set $CTID --cpulimit 0
Hah, this was the fix, i did try all the possibilities I know.
The CT did shut down correctly after this!

and see if anything changes?

Also, take a look at cpu.stat for some of the processes that is in such state?
Say, this one:
root      107398  0.0  0.0  25460   396 ?        Rs   12:19   0:00 vzctl exec 
111 ps

cat /proc/vz/fairsched/107398/cpu.stat

If throttled_time is big, it means my hypothesis makes sense.

I am also ccing Vladimir, who knows a thing or two about our fair cpu scheduler.
Sorry, forgot to retrieve the info before setting cpulimit

Thank you Sir, you saved me from a reboot!

Kir.

On 02/04/2016 05:48 AM, Bogdan-Stefan Rotariu wrote:
Hi there,

We are having issues with one container that cannot be stopped/suspended or 
killed, all commands remain in Sleep or Running Sleep.
Any ideea how to stop this container withour rebooting the main machine?
We did try to kill all proceeses, they do not die.

      CTID      NPROC STATUS    IP_ADDR         HOSTNAME
       111        100 running   a.b.c.d server.name


[3839648.976835] CPT ERR: ffff8803dd109000,111 :foreign process 
14243/9892(bash) inside CT (e.g. vzctl enter or vzctl exec).
[3839648.976842] CPT ERR: ffff8803dd109000,111 :suspend is impossible now.
[3839649.977756] CPT ERR: ffff8803dd109000,111 :foreign process 
14243/9892(bash) inside CT (e.g. vzctl enter or vzctl exec).
[3839649.977764] CPT ERR: ffff8803dd109000,111 :suspend is impossible now.
[3839650.978718] CPT ERR: ffff8803dd109000,111 :foreign process 
14243/9892(bash) inside CT (e.g. vzctl enter or vzctl exec).
[3839650.978726] CPT ERR: ffff8803dd109000,111 :suspend is impossible now.
[3839665.639557] CPT ERR: ffff880839216000,111 :foreign process 
14243/9892(bash) inside CT (e.g. vzctl enter or vzctl exec).
[3839665.639564] CPT ERR: ffff880839216000,111 :suspend is impossible now.
[3839666.640019] CPT ERR: ffff880839216000,111 :foreign process 
14243/9892(bash) inside CT (e.g. vzctl enter or vzctl exec).

root       19890  0.0  0.0  25460   376 ?        Rs   03:34   0:00 
/usr/sbin/vzctl exec 111 cat /proc/meminfo
root       39626  0.0  0.0  25460   376 ?        Rs   03:44   0:00 
/usr/sbin/vzctl exec 111 cat /proc/meminfo
root       65503  0.0  0.0  27560   412 ?        Rs   11:59   0:00 vzctl enter 
111
root       65508  0.0  0.0  27560   416 ?        Rs   11:59   0:00 vzctl enter 
111
root       65522  0.0  0.0  27560   416 ?        Rs   11:59   0:00 vzctl enter 
111
root       73329  0.0  0.0  25460   372 ?        Rs   12:00   0:00 
/usr/sbin/vzctl exec 111 cat /proc/meminfo
root       73371  0.0  0.0  25460   380 ?        Rs   12:00   0:00 
/usr/sbin/vzctl exec 111 cat /proc/meminfo
root       74865  0.0  0.0  25464   408 ?        Rs   12:00   0:00 vzctl stop 
111
root       75864  0.0  0.0  25464   412 ?        Rs   12:04   0:00 vzctl stop 
111
root       85384  0.0  0.0  25464   404 ?        Rs   12:08   0:00 vzctl stop 
111
root       96674  0.0  0.0  25464   412 ?        Rs   12:12   0:00 vzctl stop 
111
root       96787  0.0  0.0  25464   408 ?        Rs   12:13   0:00 vzctl stop 
111 --fast
root      107300  0.0  0.0  27560   412 ?        Rs   12:18   0:00 vzctl enter 
111
root      107398  0.0  0.0  25460   396 ?        Rs   12:19   0:00 vzctl exec 
111 ps
root      116638  0.0  0.0 108168  1368 ?        S    12:21   0:00 sh -c 
/usr/sbin/vzctl exec 111 cat /proc/meminfo | grep --max-count=1 'MemFree' | awk 
'{print $2}'
root      116639  0.0  0.0  25460  1024 ?        S    12:21   0:00 
/usr/sbin/vzctl exec 111 cat /proc/meminfo
root      116642  0.0  0.0  25460   364 ?        S    12:21   0:00 
/usr/sbin/vzctl exec 111 cat /proc/meminfo
root      116643  0.0  0.0  25460   384 ?        Rs   12:21   0:00 
/usr/sbin/vzctl exec 111 cat /proc/meminfo
root      116650  0.0  0.0  25460   384 ?        Rs   12:21   0:00 
/usr/sbin/vzctl exec 111 cat /proc/meminfo
root      117653  0.0  0.0  25460   380 ?        Rs   12:22   0:00 
/usr/sbin/vzctl exec 111 cat /proc/meminfo
root      117746  0.0  0.0 108168  1368 ?        S    12:22   0:00 sh -c 
/usr/sbin/vzctl exec 111 cat /proc/meminfo | grep --max-count=1 'MemFree' | awk 
'{print $2}'
root      117747  0.0  0.0 108168  1368 ?        S    12:22   0:00 sh -c 
/usr/sbin/vzctl exec 111 cat /proc/meminfo | grep --max-count=1 'MemFree' | awk 
'{print $2}'
root      117748  0.0  0.0  25460  1016 ?        S    12:22   0:00 
/usr/sbin/vzctl exec 111 cat /proc/meminfo
root      117749  0.0  0.0  25460  1020 ?        S    12:22   0:00 
/usr/sbin/vzctl exec 111 cat /proc/meminfo
root      117754  0.0  0.0  25460   360 ?        S    12:22   0:00 
/usr/sbin/vzctl exec 111 cat /proc/meminfo
root      117755  0.0  0.0  25460   356 ?        S    12:22   0:00 
/usr/sbin/vzctl exec 111 cat /proc/meminfo
root      117756  0.0  0.0  25460   380 ?        Rs   12:22   0:00 
/usr/sbin/vzctl exec 111 cat /proc/meminfo
root      117757  0.0  0.0  25460   376 ?        Rs   12:22   0:00 
/usr/sbin/vzctl exec 111 cat /proc/meminfo
root      118191  0.0  0.0 108168  1372 ?        S    12:22   0:00 sh -c 
/usr/sbin/vzctl exec 111 cat /proc/meminfo | grep --max-count=1 'MemTotal' | 
awk '{print $2}'
root      118192  0.0  0.0  25460  1020 ?        S    12:22   0:00 
/usr/sbin/vzctl exec 111 cat /proc/meminfo
root      118195  0.0  0.0  25460   360 ?        S    12:22   0:00 
/usr/sbin/vzctl exec 111 cat /proc/meminfo
root      118196  0.0  0.0  25460   380 ?        Rs   12:22   0:00 
/usr/sbin/vzctl exec 111 cat /proc/meminfo
root      126585  0.0  0.0  25464   408 ?        Rs   12:25   0:00 vzctl stop 
111
root      129412  0.0  0.0  25464   352 ?        Rs   12:26   0:00 vzctl stop 
111
root      138146  0.0  0.0  25464   404 ?        Rs   12:28   0:00 vzctl stop 
111
root      147844  0.0  0.0  25464   408 ?        Rs   12:33   0:00 vzctl stop 
111
root      157178  0.0  0.0  25464   412 ?        Rs   12:36   0:00 vzctl stop 
111
root      158300  0.0  0.0  25464   400 ?        Rs   12:39   0:00 vzctl stop 
111
root      179962  0.0  0.0  25464   408 ?        Rs   12:49   0:00 vzctl stop 
111
root      180039  0.0  0.0  25464   408 ?        Rs   12:49   0:00 vzctl stop 
111
root      220918  0.0  0.0  25464   412 ?        Rs   13:04   0:00 vzctl stop 
111
root      240631  0.0  0.0  25464   408 ?        Rs   13:14   0:00 vzctl stop 
111
root      247169  0.0  0.0  25464   412 ?        Rs   13:15   0:00 vzctl stop 
111
root      250371  0.0  0.0  25464   400 ?        Rs   13:19   0:00 vzctl stop 
111 --fast


_______________________________________________
Users mailing list
Users@openvz.org
https://lists.openvz.org/mailman/listinfo/users
_______________________________________________
Users mailing list
Users@openvz.org
https://lists.openvz.org/mailman/listinfo/users

_______________________________________________
Users mailing list
Users@openvz.org
https://lists.openvz.org/mailman/listinfo/users

_______________________________________________
Users mailing list
Users@openvz.org
https://lists.openvz.org/mailman/listinfo/users

Reply via email to