Public bug reported: Magnum as deployed by kolla-ansible 6.1.0 in Openstack queens.
magnum-api --version 6.1.1 openstack coe cluster template show k8s +-----------------------+--------------------------------------+ | Field | Value | +-----------------------+--------------------------------------+ | insecure_registry | - | | labels | {} | | updated_at | 2018-10-16T16:32:47+00:00 | | floating_ip_enabled | True | | fixed_subnet | 1a2721a3-6974-4391-a742-740fb119f34f | | master_flavor_id | m1.large | | uuid | 103f51c0-e5c5-4a1b-ba57-1bea3637b7de | | no_proxy | - | | https_proxy | - | | tls_disabled | True | | keypair_id | mykey | | public | False | | http_proxy | - | | docker_volume_size | 15 | | server_type | vm | | external_network_id | a3eacd21-2d88-40f1-9b67-48adf848a11c | | cluster_distro | fedora-atomic | | image_id | fedora-atomic-latest | | volume_driver | cinder | | registry_enabled | False | | docker_storage_driver | devicemapper | | apiserver_port | - | | name | k8s | | created_at | 2018-10-08T16:55:26+00:00 | | network_driver | flannel | | fixed_network | a601e6e0-4c7c-4a6e-a911-de8ed8258b15 | | coe | kubernetes | | flavor_id | m1.large | | master_lb_enabled | False | | dns_nameserver | 8.8.8.8 | +-----------------------+--------------------------------------+ The fedora atomic image is the one recommended in the user guide, such as: openstack image create --container-format bare --disk-format raw --public --file=Fedora-Atomic-27-20180212.2.x86_64.qcow2 --property os_distro='fedora-atomic' fedora-atomic-latest I have tried several variations of the Fedora atomic image with varying results, however I cannot get a kubernets master to bootstrap, here's the console log: heat does not spawn any minions and the stack eventually times out after 60 minutes with create failed. There are a few errors, specifically: this one is concerning me most: ############## " kubectl apply --validate=false -f - [ 193.047828] cloud-init[1250]: error: unable to decode "STDIN": no kind "ClusterRole" is registered for version "rbac.authorization.k8s.io/v1beta1" " && I think this one is erroneous ############### " 60.259770] cloud-init[1250]: Pulling layer 3bb67df590fb7166176759e564de2766df68cf5458a1b145c8a28330614fb5e9 [ 90.400104] cloud-init[1250]: g-io-error-quark: fallocate: No space left on device (12) [ 90.403178] cloud-init[1250]: Pulling layer 846750b50aa3d195d902fb91579b24cd29fabf05d15eb012c8436714097a4cbc " and finally ############### [ 193.839453] cloud-init[1250]: 2018-10-16 17:06:36,208 - cc_scripts_user.py[WARNING]: Failed to run module scripts-user (scripts in /var/lib/cloud/instance/scripts) [ 193.840781] cloud-init[1250]: 2018-10-16 17:06:36,209 - util.py[WARNING]: Running module scripts-user (<module 'cloudinit.config.cc_scripts_user' from '/usr/lib/python3.5/site-packages/cloudinit/config/cc_scripts_user.py'>) failed here's the complete log: [ 1.489018] dracut-pre-udev[333]: rpcbind: /run/rpcbind/rpcbind.lock: No such file or directory [ 1.502082] dracut-pre-udev[333]: rpc.idmapd: conf_reinit: open ("(null)", O_RDONLY) failed [ 1.505126] dracut-pre-udev[333]: rpc.idmapd: conf_reinit: open ("(null)", O_RDONLY) failed [ 1.507960] dracut-pre-udev[333]: rpc.idmapd: Could not find user "nobody" %G%G%G%G[ 7.666169] cloud-init[758]: Cloud-init v. 0.7.9 running 'init-local' at Tue, 16 Oct 2018 17:03:29 +0000. Up 7.04 seconds. [[0;32m OK [0m] Started Initial cloud-init job (pre-networking). [[0;32m OK [0m] Reached target Network (Pre). [[0;32m OK [0m] Reached target System Initialization. [[0;32m OK [0m] Listening on Open-iSCSI iscsiuio Socket. [[0;32m OK [0m] Listening on D-Bus System Message Bus Socket. [[0;32m OK [0m] Listening on Open-iSCSI iscsid Socket. [[0;32m OK [0m] Reached target Sockets. [[0;32m OK [0m] Reached target Basic System. Starting NTP client/server... Starting Login Service... Starting OpenSSH rsa Server Key Generation... [[0;32m OK [0m] Started Daily Cleanup of Temporary Directories. [[0;32m OK [0m] Reached target Timers. Starting GSSAPI Proxy Daemon... Starting OpenSSH ed25519 Server Key Generation... Starting OpenSSH ecdsa Server Key Generation... [[0;32m OK [0m] Started D-Bus System Message Bus. Starting Network Manager... [[0;32m OK [0m] Started GSSAPI Proxy Daemon. [[0;32m OK [0m] Started OpenSSH ed25519 Server Key Generation. [[0;32m OK [0m] Started OpenSSH ecdsa Server Key Generation. [[0;32m OK [0m] Reached target NFS client services. [[0;32m OK [0m] Started Login Service. [[0;32m OK [0m] Started NTP client/server. [[0;32m OK [0m] Started OpenSSH rsa Server Key Generation. [[0;32m OK [0m] Reached target sshd-keygen.target. [[0;32m OK [0m] Started Network Manager. [[0;32m OK [0m] Reached target Network. [[0;32m OK [0m] Started Containerd Standalone OCI Container Daemon. [[0;32m OK [0m] Started Logout off all iSCSI sessions on shutdown. [[0;32m OK [0m] Reached target Remote File Systems (Pre). [[0;32m OK [0m] Reached target Remote File Systems. Starting Initial cloud-init job (metadata service crawler)... Starting Network Manager Wait Online... Starting Network Manager Script Dispatcher Service... [[0;32m OK [0m] Started Network Manager Script Dispatcher Service. Starting Hostname Service... [[0;32m OK [0m] Started Hostname Service. Starting Authorization Manager... [[0;32m OK [0m] Started Authorization Manager. [[0;32m OK [0m] Started Network Manager Wait Online. [ 13.818047] cloud-init[903]: Cloud-init v. 0.7.9 running 'init' at Tue, 16 Oct 2018 17:03:31 +0000. Up 9.07 seconds. [ 13.819344] cloud-init[903]: ci-info: +++++++++++++++++++++++++++++Net device info+++++++++++++++++++++++++++++ [ 13.819874] cloud-init[903]: ci-info: +--------+------+-----------+---------------+-------+-------------------+ [ 13.821020] cloud-init[903]: ci-info: | Device | Up | Address | Mask | Scope | Hw-Address | [ 13.822092] cloud-init[903]: ci-info: +--------+------+-----------+---------------+-------+-------------------+ [ 13.823176] cloud-init[903]: ci-info: | eth0: | True | 10.0.0.16 | 255.255.255.0 | . | fa:16:3e:25:ea:7c | [ 13.824298] cloud-init[903]: ci-info: | eth0: | True | . | . | d | fa:16:3e:25:ea:7c | [ 13.830120] cloud-init[903]: ci-info: | lo: | True | 127.0.0.1 | 255.0.0.0 | . | . | [ 13.830651] cloud-init[903]: ci-info: | lo: | True | . | . | d | . | [ 13.831032] cloud-init[903]: ci-info: +--------+------+-----------+---------------+-------+-------------------+ [ 13.831329] cloud-init[903]: ci-info: ++++++++++++++++++++++++++++++Route IPv4 info+++++++++++++++++++++++++++++++ [ 13.831669] cloud-init[903]: ci-info: +-------+-----------------+----------+-----------------+-----------+-------+ [ 13.832060] cloud-init[903]: ci-info: | Route | Destination | Gateway | Genmask | Interface | Flags | [ 13.832365] cloud-init[903]: ci-info: +-------+-----------------+----------+-----------------+-----------+-------+ [ 13.832722] cloud-init[903]: ci-info: | 0 | 0.0.0.0 | 10.0.0.1 | 0.0.0.0 | eth0 | UG | [ 13.833080] cloud-init[903]: ci-info: | 1 | 10.0.0.0 | 0.0.0.0 | 255.255.255.0 | eth0 | U | [ 13.833382] cloud-init[903]: ci-info: | 2 | 169.254.169.254 | 10.0.0.2 | 255.255.255.255 | eth0 | UGH | [ 13.833737] cloud-init[903]: ci-info: +-------+-----------------+----------+-----------------+-----------+-------+ [[0;32m OK [0m] Started Initial cloud-init job (metadata service crawler). [[0;32m OK [0m] Reached target Network is Online. Starting Notify NFS peers of a restart... Starting Permit User Sessions... Starting Docker Storage Setup... [[0;32m OK [0m] Reached target Cloud-config availability. Starting Apply the settings specified in cloud-config... Starting OpenSSH server daemon... [[0;32m OK [0m] Started Notify NFS peers of a restart. [[0;32m OK [0m] Started Permit User Sessions. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ 15.124085] cloud-init[1079]: Cloud-init v. 0.7.9 running 'modules:config' at Tue, 16 Oct 2018 17:03:37 +0000. Up 14.91 seconds. [ 16.521199] cloud-init[1250]: + CA_FILE=/etc/pki/ca-trust/source/anchors/openstack-ca.pem [ 16.525360] cloud-init[1250]: + '[' -n '' ']' Fedora 25 (Atomic Host) Kernel 4.11.10-200.fc25.x86_64 on an x86_64 (ttyS0) djyhftj-bpu2zxlywylj-master-0 login: [ 23.873903] cloud-init[1250]: Pulling layer 7ecc8a985be6848a7ee66b80217c168de6e79dcbda3c01ee36a45367c3a3a6bc [ 23.875151] cloud-init[1250]: Pulling layer a6091bfb179ad957897301750adebbb3dc821e0aff7e2695e1e87128f91d705c [ 23.876226] cloud-init[1250]: Pulling layer a6220ca8d39b93c71aa73bc81d83160f4c414f1ca6688b79a4e343a0f1ec5973 [ 23.876959] cloud-init[1250]: Pulling layer 76cd47524e799b1197a4a641ec9fe2c102265d5f188cacadf07bfda2bee5da0d [ 23.877779] cloud-init[1250]: Pulling layer cde34beaf6309f264b84a33e37a4728cca16d21e2bb5fd1bf45140ea72cfde03 [ 23.878612] cloud-init[1250]: Pulling layer e3bab3136514f51d8e0082f241ba3aec260150a1cee7e6cdac36e6a2e2377951 [ 23.879054] cloud-init[1250]: Pulling layer 5daa2b6fae719323bda2d879fe3c101afc140265482f7712d2971858d88e291e [ 50.951481] cloud-init[1250]: Pulling layer 3ba53a147ecd07b7212b1a1437b5a1c76fdf2b108df17e8396e735b2d251f41b [ 52.372526] cloud-init[1250]: Extracting to /var/lib/containers/atomic/etcd.0 [ 52.378880] cloud-init[1250]: File /etc/etcd/etcd.conf already exists. [ 52.493048] cloud-init[1250]: systemctl daemon-reload [ 52.508441] cloud-init[1250]: systemd-tmpfiles --create /etc/tmpfiles.d/etcd.conf [ 52.624581] cloud-init[1250]: systemctl enable etcd [ 52.879419] cloud-init[1250]: Removed /etc/systemd/system/multi-user.target.wants/docker-storage-setup.service. [ 53.126407] cloud-init[1250]: Physical volume "/dev/disk/by-id/virtio-05478377-bc61-445f-9" successfully created. [ 53.272717] cloud-init[1250]: Volume group "docker" successfully created [ 53.447634] cloud-init[1250]: Rounding up size to full physical extent 16.00 MiB [ 53.550885] cloud-init[1250]: Logical volume "docker-poolmeta" created. [ 53.720951] cloud-init[1250]: Logical volume "docker-pool" created. [ 53.742728] cloud-init[1250]: WARNING: Converting logical volume docker/docker-pool and docker/docker-poolmeta to thin pool's data and metadata volumes with metadata wiping. [ 53.743115] cloud-init[1250]: THIS WILL DESTROY CONTENT OF LOGICAL VOLUME (filesystem etc.) [ 54.140078] cloud-init[1250]: Converted docker/docker-pool to thin pool. [ 54.373702] cloud-init[1250]: Logical volume docker/docker-pool changed. [ 54.385048] cloud-init[1250]: configuring kubernetes (master) [ 60.255121] cloud-init[1250]: Pulling layer 3463131de5b085ae9a30c13d5c526f9297e0fe72df17fa141a1765cb371015fd [ 60.256963] cloud-init[1250]: Pulling layer d5fb7cc999272ece23da54e91e99a3112762fb7795e484f6d0417b7f7de23e2b [ 60.257725] cloud-init[1250]: Pulling layer 7e8cdf9900e2a4b61f2e25c9b5ba77fc84f3fba44ed9304810d5570a40c0b3db [ 60.258146] cloud-init[1250]: Pulling layer 1d16a9f678250828a8d1b2d287bc0d0c18a5675596d63bd9cb6411a872e6ad9c [ 60.258517] cloud-init[1250]: Pulling layer 34d2bce38fe0837669be1e3c7f77edcce5bcfb96d2f7e185a95e56d7e5bccf06 [ 60.258960] cloud-init[1250]: Pulling layer 87ef82017b811187513a6c37b5a9d1b657b5d4c79eea3dd9e4d1863a10532144 [ 60.259770] cloud-init[1250]: Pulling layer 3bb67df590fb7166176759e564de2766df68cf5458a1b145c8a28330614fb5e9 [ 90.400104] cloud-init[1250]: g-io-error-quark: fallocate: No space left on device (12) [ 90.403178] cloud-init[1250]: Pulling layer 846750b50aa3d195d902fb91579b24cd29fabf05d15eb012c8436714097a4cbc [ 96.339185] cloud-init[1250]: Pulling layer 3463131de5b085ae9a30c13d5c526f9297e0fe72df17fa141a1765cb371015fd [ 96.339830] cloud-init[1250]: Pulling layer d5fb7cc999272ece23da54e91e99a3112762fb7795e484f6d0417b7f7de23e2b [ 96.341226] cloud-init[1250]: Pulling layer 7e8cdf9900e2a4b61f2e25c9b5ba77fc84f3fba44ed9304810d5570a40c0b3db [ 96.342840] cloud-init[1250]: Pulling layer e2159df0a65a19c5dae53ca4692d7be7e629d264f922ed6b2478a6d0c8541dbd [ 96.345098] cloud-init[1250]: Pulling layer 108ac72bedc5a771b79695b7610f858f084527d0c0ec6111e6138c9ad43f106b [ 110.585438] cloud-init[1250]: g-io-error-quark: min-free-space-percent '3%' would be exceeded, 149.3 MB more required (0) [ 110.588356] cloud-init[1250]: Pulling layer 85be7c2510a4a87225e74b3927b5bd30c483dc3527bd21d7063a1a0c091037b4 [ 116.438087] cloud-init[1250]: Pulling layer 3463131de5b085ae9a30c13d5c526f9297e0fe72df17fa141a1765cb371015fd [ 116.447435] cloud-init[1250]: Pulling layer d5fb7cc999272ece23da54e91e99a3112762fb7795e484f6d0417b7f7de23e2b [ 116.448302] cloud-init[1250]: Pulling layer 7e8cdf9900e2a4b61f2e25c9b5ba77fc84f3fba44ed9304810d5570a40c0b3db [ 116.449056] cloud-init[1250]: Pulling layer 4c14709b7f4a00b74a2cfc2b80ec5a3d4e75d8b26335548b364057aa9f30a8aa [ 116.449482] cloud-init[1250]: Pulling layer ef8fcf929d9f6c0034f5414195b6adf5961b11c5b4096753fa28b5352e677027 [ 137.191555] cloud-init[1250]: g-io-error-quark: min-free-space-percent '3%' would be exceeded, 149.3 MB more required (0) [ 137.195413] cloud-init[1250]: Pulling layer 8bdfb179a1d2b55cb6e4af1062c5e8cfd89d8116fd56f06138f4d0b0b5b74ead [ 143.070160] cloud-init[1250]: Pulling layer 61b7c97279a555e18bf110b78ab39ba1dea16bad4b88756fd7f1900b789eccb9 [ 143.075037] cloud-init[1250]: Pulling layer c80ade50ed9043de1461bd622bf95339a59894c68191360dcc4ea28a5d267019 [ 143.075784] cloud-init[1250]: Pulling layer 3a7e1b8b1915be0197b045e8d36ca4e3e81299d941aaeedaceb5a769dd98096c [ 143.076626] cloud-init[1250]: Pulling layer 8e60b5f5e8894c88f2af29a4fde95139d7aed18680a86e6c7945a03d0952359a [ 152.495472] cloud-init[1250]: Pulling layer 55da6b08c07beab88b3baa58b502a6e324fd2945e08fb9722ce033e5a39a570d [ 153.094621] cloud-init[1250]: Extracting to /var/lib/containers/atomic/flanneld.0 [ 153.099950] cloud-init[1250]: File /etc/sysconfig/flanneld already exists. [ 153.211494] cloud-init[1250]: systemctl daemon-reload [ 153.226880] cloud-init[1250]: systemd-tmpfiles --create /etc/tmpfiles.d/flanneld.conf [ 153.314729] cloud-init[1250]: systemctl enable flanneld [ 153.417449] cloud-init[1250]: + _prefix=docker.io/openstackmagnum/ [ 153.417951] cloud-init[1250]: + atomic install --storage ostree --system --system-package no --set REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt --name heat-container-agent docker.io/openstackmagnum/heat-container-agent:rawhide [ 159.246123] cloud-init[1250]: Pulling layer 32d051af12f8fb4de96468f9d1dd7e2045444820f84aa53e318c5d23dc9481e7 [ 159.246556] cloud-init[1250]: Pulling layer 086aa3838e9f52e3a6aeb83998f8d87e5f4f1208ceb4655b9b5a7d21c696bc72 [ 159.246950] cloud-init[1250]: Pulling layer 35c6835c61aad2abb02ab746b0fd22860e205fa32922163a7f5269aa63410d32 [ 159.247818] cloud-init[1250]: Pulling layer 938954ceff8876e4187da19479fe63c49d19c3bb31ec401c20b2279f41d5eb05 [ 159.248682] cloud-init[1250]: Pulling layer c7a2341b649502b7b9b48173415f1db2f6fc6ea5baea7c4ed58538c9c5c29f5c [ 159.249177] cloud-init[1250]: Pulling layer d119e0ba16d60a3dd6f7403f15d2508300997de6963f4449cc1b42d04b9ab4a8 [ 159.249580] cloud-init[1250]: Pulling layer a62589cc8c25666193ab76056c371e36a770b8bc385d89ae3b67473b9c12fe29 [ 159.249976] cloud-init[1250]: Pulling layer ad40c553bd1bcb0746a9d6b6a1df7559faa06b0c70a0ff7c34678e892ea11021 [ 159.250838] cloud-init[1250]: Pulling layer e4e5d7a594921460060d6ea9f344ae9cf719d09e0fd179e2ee2a40f666883bd2 [ 159.251683] cloud-init[1250]: Pulling layer 6261e53e3aca9d7068a2c4ec2c631b34be4d356d66c3d927051433cab9f1e5d1 [ 159.252122] cloud-init[1250]: Pulling layer 1934d0968e292f159906c152602ce0dfc42304786647d3332e88fe08a527cc1b [ 159.252537] cloud-init[1250]: Pulling layer e5b6be0df0154e6d0f7749f295393331951ce47f6ef4ef5a3e1b081078e42932 [ 159.252972] cloud-init[1250]: Pulling layer 15eb7a13273fa00596131d4734c1610c9472685da81f7fb1a2ebcadf212bc84c [ 184.881581] cloud-init[1250]: Pulling layer 96ce1eb42495f7bbf766c2b4049858fabf7907831888a2d90e916c5aa41054c4 [ 186.192413] cloud-init[1250]: Extracting to /var/lib/containers/atomic/heat-container-agent.0 [ 186.317027] cloud-init[1250]: systemctl daemon-reload [ 186.330307] cloud-init[1250]: systemd-tmpfiles --create /etc/tmpfiles.d/heat-container-agent.conf [ 186.430483] cloud-init[1250]: systemctl enable heat-container-agent [ 186.497279] cloud-init[1250]: + systemctl start heat-container-agent [ 186.639316] cloud-init[1250]: starting services [ 186.649442] cloud-init[1250]: activating service etcd [ 186.811547] cloud-init[1250]: activating service docker [ 187.019733] cloud-init[1250]: activating service kube-apiserver [ 187.032982] cloud-init[1250]: Created symlink /etc/systemd/system/multi-user.target.wants/kube-apiserver.service ��� /usr/lib/systemd/system/kube-apiserver.service. [ 187.147088] cloud-init[1250]: activating service kube-controller-manager [ 187.153995] cloud-init[1250]: Created symlink /etc/systemd/system/multi-user.target.wants/kube-controller-manager.service ��� /usr/lib/systemd/system/kube-controller-manager.service. [ 187.290709] cloud-init[1250]: activating service kube-scheduler [ 187.309902] cloud-init[1250]: Created symlink /etc/systemd/system/multi-user.target.wants/kube-scheduler.service ��� /usr/lib/systemd/system/kube-scheduler.service. [ 187.477585] cloud-init[1250]: creating /usr/local/bin/flannel-config [ 187.500658] cloud-init[1250]: Created symlink /etc/systemd/system/multi-user.target.wants/flannel-config.service ��� /etc/systemd/system/flannel-config.service. [ 187.648086] cloud-init[1250]: activating service flanneld [ 187.757753] cloud-init[1250]: + . /etc/sysconfig/heat-params [ 187.760763] cloud-init[1250]: ++ PROMETHEUS_MONITORING=False [ 187.761075] cloud-init[1250]: ++ KUBE_API_PUBLIC_ADDRESS=87.44.4.55 [ 187.761413] cloud-init[1250]: ++ KUBE_API_PRIVATE_ADDRESS=10.0.0.16 [ 187.761789] cloud-init[1250]: ++ KUBE_API_PORT=8080 [ 187.762619] cloud-init[1250]: ++ KUBE_NODE_PUBLIC_IP=87.44.4.55 [ 187.763016] cloud-init[1250]: ++ KUBE_NODE_IP=10.0.0.16 [ 187.763352] cloud-init[1250]: ++ KUBE_ALLOW_PRIV=true [ 187.763788] cloud-init[1250]: ++ ENABLE_CINDER= [ 187.764846] cloud-init[1250]: ++ ETCD_VOLUME=c4572e10-30ae-4f4f-9e1d-08488e4e3f22 [ 187.765649] cloud-init[1250]: ++ ETCD_VOLUME_SIZE=0 [ 187.766078] cloud-init[1250]: ++ DOCKER_VOLUME=05478377-bc61-445f-95a7-117440d58380 [ 187.766421] cloud-init[1250]: ++ DOCKER_VOLUME_SIZE=15 [ 187.766816] cloud-init[1250]: ++ DOCKER_STORAGE_DRIVER=devicemapper [ 187.767596] cloud-init[1250]: ++ NETWORK_DRIVER=flannel [ 187.768061] cloud-init[1250]: ++ FLANNEL_NETWORK_CIDR=10.100.0.0/16 [ 187.768412] cloud-init[1250]: ++ FLANNEL_NETWORK_SUBNETLEN=24 [ 187.768794] cloud-init[1250]: ++ FLANNEL_BACKEND=udp [ 187.769162] cloud-init[1250]: ++ PODS_NETWORK_CIDR=10.100.0.0/16 [ 187.769621] cloud-init[1250]: ++ PORTAL_NETWORK_CIDR=10.254.0.0/16 [ 187.770078] cloud-init[1250]: ++ ADMISSION_CONTROL_LIST=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,ResourceQuota [ 187.770406] cloud-init[1250]: ++ ETCD_DISCOVERY_URL=https://discovery.etcd.io/1d5e6a47d28fe3a3e849ac85e8296692 [ 187.770735] cloud-init[1250]: ++ USERNAME=admin [ 187.771111] cloud-init[1250]: ++ PASSWORD=ChangeMe [ 187.771451] cloud-init[1250]: ++ CLUSTER_SUBNET=1a2721a3-6974-4391-a742-740fb119f34f [ 187.771849] cloud-init[1250]: ++ TLS_DISABLED=True [ 187.772551] cloud-init[1250]: ++ KUBE_DASHBOARD_ENABLED=True [ 187.772876] cloud-init[1250]: ++ INFLUX_GRAFANA_DASHBOARD_ENABLED=False [ 187.773622] cloud-init[1250]: ++ VERIFY_CA=True [ 187.773968] cloud-init[1250]: ++ CLUSTER_UUID=14e93d3c-f172-4bd3-914d-c3606f7c7611 [ 187.774677] cloud-init[1250]: ++ MAGNUM_URL=https://################:9511/v1 [ 187.775485] cloud-init[1250]: ++ VOLUME_DRIVER=cinder [ 187.775879] cloud-init[1250]: ++ HTTP_PROXY= [ 187.776551] cloud-init[1250]: ++ HTTPS_PROXY= [ 187.776903] cloud-init[1250]: ++ NO_PROXY= [ 187.777613] cloud-init[1250]: ++ WAIT_CURL='curl -i -X POST -H '\''X-Auth-Token: gAAAAABbxhmQjMeEMI2URJotaK8Sqsirx5rYpZF4gxpmnvNOK0ah6Nx8s3JFwg8MZ-xFnAYbAYbK6bF-NElrkTpviVbne0ygg-EwgYMypiVs9Q9RpWwYR90DMzNGskd_nG89mX2Ry9rfkqP-TNxZHFsa32-oL-ctA7H-XlbkUNiarGCUdoQmYkI'\'' -H '\''Content-Type: application/json'\'' -H '\''Accept: application/json'\'' https://#################:8004/v1/f858dee6da724dcba43a17341af78c83/stacks/djyhftj-bpu2zxlywylj-kube_masters-wy47q3n75qvd-0-ysr6kncv7yym/f9f36fc3-9b22-4deb-92de-66c896e20e74/resources/master_wait_handle/signal' [ 187.778033] cloud-init[1250]: ++ KUBE_TAG=v1.9.3 [ 187.778331] cloud-init[1250]: ++ ETCD_TAG=v3.2.7 [ 187.778660] cloud-init[1250]: ++ FLANNEL_TAG=v0.9.0 [ 187.779034] cloud-init[1250]: ++ KUBE_VERSION=v1.9.3 [ 187.779368] cloud-init[1250]: ++ KUBE_DASHBOARD_VERSION=v1.8.3 [ 187.779699] cloud-init[1250]: ++ TRUSTEE_USER_ID=###################### [ 187.780142] cloud-init[1250]: ++ TRUSTEE_PASSWORD=################# [ 187.780397] cloud-init[1250]: ++ TRUST_ID= [ 187.780773] cloud-init[1250]: ++ AUTH_URL=https://###########:5000/v3/ [ 187.781479] cloud-init[1250]: ++ INSECURE_REGISTRY_URL= [ 187.781824] cloud-init[1250]: ++ CONTAINER_INFRA_PREFIX= [ 187.782503] cloud-init[1250]: ++ SYSTEM_PODS_INITIAL_DELAY=30 [ 187.782796] cloud-init[1250]: ++ SYSTEM_PODS_TIMEOUT=5 [ 187.783525] cloud-init[1250]: ++ ETCD_LB_VIP= [ 187.783824] cloud-init[1250]: ++ DNS_SERVICE_IP=10.254.0.10 [ 187.784481] cloud-init[1250]: ++ DNS_CLUSTER_DOMAIN=cluster.local [ 187.784792] cloud-init[1250]: ++ CERT_MANAGER_API=False [ 187.785469] cloud-init[1250]: ++ CA_KEY= [ 187.785772] cloud-init[1250]: ++ CALICO_TAG=v2.6.7 [ 187.786468] cloud-init[1250]: ++ CALICO_CNI_TAG=v1.11.2 [ 187.786773] cloud-init[1250]: ++ CALICO_KUBE_CONTROLLERS_TAG=v1.0.3 [ 187.787439] cloud-init[1250]: ++ CALICO_IPV4POOL=192.168.0.0/16 [ 187.787741] cloud-init[1250]: ++ INGRESS_CONTROLLER= [ 187.788117] cloud-init[1250]: ++ INGRESS_CONTROLLER_ROLE=ingress [ 187.788443] cloud-init[1250]: ++ KUBELET_OPTIONS= [ 187.788781] cloud-init[1250]: ++ KUBECONTROLLER_OPTIONS= [ 187.789441] cloud-init[1250]: ++ KUBEAPI_OPTIONS= [ 187.789831] cloud-init[1250]: ++ KUBEPROXY_OPTIONS= [ 187.790488] cloud-init[1250]: ++ KUBESCHEDULER_OPTIONS= [ 187.790800] cloud-init[1250]: + echo 'Waiting for Kubernetes API...' [ 187.791487] cloud-init[1250]: Waiting for Kubernetes API... [ 187.791788] cloud-init[1250]: + curl --silent http://127.0.0.1:8080/version [ 187.792543] cloud-init[1250]: + sleep 5 [ 192.782106] cloud-init[1250]: + curl --silent http://127.0.0.1:8080/version [ 192.799712] cloud-init[1250]: { [ 192.800088] cloud-init[1250]: "major": "1", [ 192.800708] cloud-init[1250]: "minor": "5", [ 192.801792] cloud-init[1250]: "gitVersion": "v1.5.3", [ 192.802164] cloud-init[1250]: "gitCommit": "029c3a408176b55c30846f0faedf56aae5992e9b", [ 192.802847] cloud-init[1250]: "gitTreeState": "clean", [ 192.803596] cloud-init[1250]: "buildDate": "2017-03-09T11:55:06Z", [ 192.804645] cloud-init[1250]: "goVersion": "go1.7.5", [ 192.805713] cloud-init[1250]: "compiler": "gc", [ 192.806778] cloud-init[1250]: "platform": "linux/amd64" [ 192.809382] cloud-init[1250]: }+ cat [ 192.810143] cloud-init[1250]: + kubectl apply --validate=false -f - [ 193.047828] cloud-init[1250]: error: unable to decode "STDIN": no kind "ClusterRole" is registered for version "rbac.authorization.k8s.io/v1beta1" [ 193.050635] cloud-init[1250]: + cat [ 193.051661] cloud-init[1250]: + kubectl apply --validate=false -f - [ 193.242126] cloud-init[1250]: error: unable to decode "STDIN": no kind "ClusterRoleBinding" is registered for version "rbac.authorization.k8s.io/v1beta1" [ 193.250669] cloud-init[1250]: + ADMIN_RBAC=/srv/magnum/kubernetes/kubernetes-admin-rbac.yaml [ 193.253626] cloud-init[1250]: + '[' -f /srv/magnum/kubernetes/kubernetes-admin-rbac.yaml ']' [ 193.256515] cloud-init[1250]: + echo 'Writing File: /srv/magnum/kubernetes/kubernetes-admin-rbac.yaml' [ 193.260727] cloud-init[1250]: Writing File: /srv/magnum/kubernetes/kubernetes-admin-rbac.yaml [ 193.264764] cloud-init[1250]: ++ dirname /srv/magnum/kubernetes/kubernetes-admin-rbac.yaml [ 193.268792] cloud-init[1250]: + mkdir -p /srv/magnum/kubernetes [ 193.271951] cloud-init[1250]: + cat [ 193.284791] cloud-init[1250]: Writing File: /etc/kubernetes/manifests/kube-coredns.yaml [ 193.293474] cloud-init[1250]: Waiting for Kubernetes API... [ 193.306098] cloud-init[1250]: { [ 193.308092] cloud-init[1250]: "major": "1", [ 193.310324] cloud-init[1250]: "minor": "5", [ 193.312338] cloud-init[1250]: "gitVersion": "v1.5.3", [ 193.314661] cloud-init[1250]: "gitCommit": "029c3a408176b55c30846f0faedf56aae5992e9b", [ 193.317711] cloud-init[1250]: "gitTreeState": "clean", [ 193.320095] cloud-init[1250]: "buildDate": "2017-03-09T11:55:06Z", [ 193.322645] cloud-init[1250]: "goVersion": "go1.7.5", [ 193.324783] cloud-init[1250]: "compiler": "gc", [ 193.326843] cloud-init[1250]: "platform": "linux/amd64" [ 193.513813] cloud-init[1250]: }serviceaccount "coredns" created [ 193.530531] cloud-init[1250]: configmap "coredns" created [ 193.551350] cloud-init[1250]: deployment "coredns" created [ 193.597106] cloud-init[1250]: service "kube-dns" created [ 193.630364] cloud-init[1250]: serviceaccount "kube-dns-autoscaler" created [ 193.645795] cloud-init[1250]: Error from server (BadRequest): error when creating "/etc/kubernetes/manifests/kube-coredns.yaml": ClusterRole in version "v1beta1" cannot be handled as a ClusterRole: no kind "ClusterRole" is registered for version "rbac.authorization.k8s.io/v1beta1" [ 193.654226] cloud-init[1250]: Error from server (BadRequest): error when creating "/etc/kubernetes/manifests/kube-coredns.yaml": ClusterRoleBinding in version "v1beta1" cannot be handled as a ClusterRoleBinding: no kind "ClusterRoleBinding" is registered for version "rbac.authorization.k8s.io/v1beta1" [ 193.661238] cloud-init[1250]: Error from server (BadRequest): error when creating "/etc/kubernetes/manifests/kube-coredns.yaml": ClusterRole in version "v1" cannot be handled as a ClusterRole: no kind "ClusterRole" is registered for version "rbac.authorization.k8s.io/v1" [ 193.667421] cloud-init[1250]: Error from server (BadRequest): error when creating "/etc/kubernetes/manifests/kube-coredns.yaml": ClusterRoleBinding in version "v1" cannot be handled as a ClusterRoleBinding: no kind "ClusterRoleBinding" is registered for version "rbac.authorization.k8s.io/v1" [ 193.676973] cloud-init[1250]: unable to recognize "/etc/kubernetes/manifests/kube-coredns.yaml": no matches for apps/, Kind=Deployment [ 193.690191] cloud-init[1250]: Cloud-init v. 0.7.9 running 'modules:final' at Tue, 16 Oct 2018 17:03:38 +0000. Up 16.31 seconds. [ 193.695152] cloud-init[1250]: 2018-10-16 17:06:36,056 - util.py[WARNING]: Failed running /var/lib/cloud/instance/scripts/part-018 [1] [ 193.730046] cloud-init[1250]: Created symlink /etc/systemd/system/multi-user.target.wants/wc-notify.service ��� /etc/systemd/system/wc-notify.service. [ 193.839453] cloud-init[1250]: 2018-10-16 17:06:36,208 - cc_scripts_user.py[WARNING]: Failed to run module scripts-user (scripts in /var/lib/cloud/instance/scripts) [ 193.840781] cloud-init[1250]: 2018-10-16 17:06:36,209 - util.py[WARNING]: Running module scripts-user (<module 'cloudinit.config.cc_scripts_user' from '/usr/lib/python3.5/site-packages/cloudinit/config/cc_scripts_user.py'>) failed ci-info: ++++++Authorized keys from /home/fedora/.ssh/authorized_keys for user fedora+++++++ ci-info: +---------+-------------------------------------------------+---------+-----------+ ci-info: | Keytype | Fingerprint (md5) | Options | Comment | ci-info: +---------+-------------------------------------------------+---------+-----------+ ci-info: | ssh-rsa | 97:97:5a:2d:64:cc:fb:7e:bf:e3:38:15:ba:2f:d3:95 | - | rob@kolla | ci-info: +---------+-------------------------------------------------+---------+-----------+ <14>Oct 16 17:06:36 ec2: <14>Oct 16 17:06:36 ec2: ############################################################# <14>Oct 16 17:06:36 ec2: -----BEGIN SSH HOST KEY FINGERPRINTS----- <14>Oct 16 17:06:36 ec2: 256 SHA256:5qCh5vKl8GDvwxSDfAAWlu1G4P7MNxMRYfplGr0U5Dg no comment (ECDSA) <14>Oct 16 17:06:36 ec2: 256 SHA256:rB3dy+HnoQinecnh1FNp7qtccuFwsOKY1DGZT00tn9M no comment (ED25519) <14>Oct 16 17:06:36 ec2: 2048 SHA256:cCWy6DZJeJqY1DaExG3MdATIu2hV/Y1vizdK+PTjMIo no comment (RSA) <14>Oct 16 17:06:36 ec2: -----END SSH HOST KEY FINGERPRINTS----- <14>Oct 16 17:06:36 ec2: ############################################################# -----BEGIN SSH HOST KEY KEYS----- ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPHKzVDV1w9Q5P1vxlMIiZvFTQzA+JUuQqlTBrtFFNwoOWbs5f/7RKxoWvpdqSTUGGz8fJX79Jsjn1ayVYD7Rs0= ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINfw+gC2EuVoWckcpmJU7dA12s6rmuSyx1MJpk4vMQds ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpdgTU1zJ85YKbbQVTC7oy5DrE6xQsu1Sv8JlHSEAYlCHpdtTBaSN78suxIF2SN2wPbN/NEGO59i+2UOXLx32DpxkDznFltARjgDMv++k8T6vuV1aBnJcnLJAVC0YaIWROGNAIjIYQV085RmefNvQmv6X0eRH+gvZNVOaGxpxkG1NTWGg1cugMxF30d3osZE8W051DSVTKDmdlzmB/a5KsXBA1MiAt6+DFKkGVD1GHB91BDJYq2eGYcmeXMhOEA/LMY95OOyOC4AUP9IfHfWil8aLBdXU7bjZrbEWRTW8LriGGmH7g/yp0RjLI99/MBswiYZFMACPDYPhZxa/LLx05 -----END SSH HOST KEY KEYS----- [ 193.918840] cloud-init[1250]: Cloud-init v. 0.7.9 finished at Tue, 16 Oct 2018 17:06:36 +0000. Datasource DataSourceOpenStack [net,ver=2]. Up 193.90 seconds after I ssh onto the master node: #################### http://paste.openstack.org/show/732327/ ** Affects: magnum (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1798323 Title: error when creating kube-coredns To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/magnum/+bug/1798323/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs