2021-02-06 00:05:21 UTC - Dominic Kim: @Brendan Doyle Did you increase the version of the client in Invoker or downgrade your host? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612569921106100?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:05:52 UTC - Brendan Doyle: Everything is running 20.10.x https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612569952106300?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:06:08 UTC - Dominic Kim: ok https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612569968106600?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:08:21 UTC - Dominic Kim: which storage driver are you using? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612570101107200?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:09:08 UTC - Brendan Doyle: tmpfs https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612570148107400?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:10:17 UTC - Dominic Kim: ok I would try the same https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612570217107900?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:13:57 UTC - Brendan Doyle: looking at the invoker ansible, we aren't using this mount `/sys/fs/cgroup:/sys/fs/cgroup` https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612570437108100?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:14:06 UTC - Brendan Doyle: Is this necessary https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612570446108300?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:16:50 UTC - Dominic Kim: Hm.. since our invoker communicate with the host dockerd via socket, I suppose not necessary. https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612570610110200?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:18:53 UTC - Brendan Doyle: well I just mounted that and it at least is outputting paused and pid's for some of the containers within the invoker container now https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612570733110400?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:19:07 UTC - Brendan Doyle: but still the same error logs with runc https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612570747110600?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:19:31 UTC - Dominic Kim: ok I would also consider that https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612570771111100?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:22:27 UTC - Brendan Doyle: okay so when comparing to the host `sudo runc --root /run/docker/runtime-runc/moby/ list` , within the container the containers that are paused are now correctly displayed as paused. But containers that are listed as running on the host are still listed as stopped with pid 0 from within the invoker white_check_mark : Dominic Kim https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612570947111300?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:25:32 UTC - Dominic Kim: one more question, which version of kernel are you using? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612571132112200?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:29:46 UTC - Brendan Doyle: `Linux 3.10.0-1160.6.1.el7.x86_64 x86_64` https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612571386112400?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:32:31 UTC - Dominic Kim: thanks https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612571551112700?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:45:28 UTC - Brendan Doyle: oh also we're using systemd for our cgroup https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612572328112900?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:49:37 UTC - Dominic Kim: oh.. that might be the reason I think. https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612572577113100?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:49:54 UTC - Dominic Kim: https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612572594113300?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:50:21 UTC - Dominic Kim: If you don't configure anything, runc would try to access cgroup with cgroupFs driver I think? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612572621113500?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:50:39 UTC - Dominic Kim: AFAIK, their cgroup path is different. https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612572639113700?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:53:22 UTC - Brendan Doyle: so is it just a different file path I have to mount? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612572802113900?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:54:08 UTC - Dominic Kim: Not quite sure but I suppose so. https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612572848114100?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 00:55:38 UTC - Dominic Kim: Could you share how does it look like in `/sys/fs/cgroup/memory` and `/sys/fs/cgroup/memory/docker`? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612572938114300?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 01:51:12 UTC - Dominic Kim: Just for those who have an interest, Brendan could make it work by adding `--userns=host --pid=host` options for docker run and the 18.06 client is also compatible with the 20.10 host. https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612576272114500?thread_ts=1612559268.103200&cid=C3TPCAQG1 ---- 2021-02-06 11:14:14 UTC - David Williams: How do I create form.js? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1612610054115000 ----
