profile
viewpoint

Ask questionsJob rke-network-plugin-deploy-job never completes (virtualbox)

RKE version: v0.2.0

Docker version: (docker version,docker info preferred)

Client:
 Version:           18.09.3
 API version:       1.39
 Go version:        go1.10.8
 Git commit:        774a1f4
 Built:             Thu Feb 28 06:53:11 2019
 OS/Arch:           linux/amd64
 Experimental:      false

Server: Docker Engine - Community
 Engine:
  Version:          18.09.3
  API version:      1.39 (minimum version 1.12)
  Go version:       go1.10.8
  Git commit:       774a1f4
  Built:            Thu Feb 28 05:59:55 2019
  OS/Arch:          linux/amd64
  Experimental:     false
Containers: 20
 Running: 7
 Paused: 0
 Stopped: 13
Images: 4
Server Version: 18.09.3
Storage Driver: overlay2
 Backing Filesystem: extfs
 Supports d_type: true
 Native Overlay Diff: true
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
 Volume: local
 Network: bridge host macvlan null overlay
 Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
Swarm: inactive
Runtimes: runc
Default Runtime: runc
Init Binary: docker-init
containerd version: e6b3f5632f50dbc4e9cb6288d911bf4f5e95b18e
runc version: 6635b4f0c6af3810594d2770f662f34ddc15b40d
init version: fec3683
Security Options:
 apparmor
 seccomp
  Profile: default
Kernel Version: 4.15.0-46-generic
Operating System: Ubuntu 18.04.2 LTS
OSType: linux
Architecture: x86_64
CPUs: 1
Total Memory: 985.5MiB
Name: kanuahs
ID: 5EFK:2KX7:R64P:YT56:WCYV:653P:AFWT:TAS4:PMGA:YCOR:3FPX:4D2N
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
Labels:
Experimental: false
Insecure Registries:
 127.0.0.0/8
Live Restore Enabled: false
Product License: Community Engine

WARNING: No swap limit support

Operating system and kernel: (cat /etc/os-release, uname -r preferred)

NAME="Ubuntu"
VERSION="18.04.2 LTS (Bionic Beaver)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 18.04.2 LTS"
VERSION_ID="18.04"
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
VERSION_CODENAME=bionic
UBUNTU_CODENAME=bionic

4.15.0-46-generic

Type/provider of hosts: (VirtualBox/Bare-metal/AWS/GCE/DO)

Virtualbox

cluster.yml file:

nodes:
  - address: 127.0.1.1
    user: kanuahs
    role:
      - controlplane
      - etcd
      - worker
    ssh_key_path: /home/kanuahs/.ssh/id_rsa

Steps to Reproduce:

  1. Create a fresh ubuntu 18.04 server virtualbox VM using this ISO, Install docker, etcd, Generate ssh keys
  2. rke up

Results:

rke up
...
INFO[0100] [addons] Saving ConfigMap for addon rke-network-plugin to Kubernetes 
INFO[0100] [addons] Successfully saved ConfigMap for addon rke-network-plugin to Kubernetes 
INFO[0100] [addons] Executing deploy job rke-network-plugin 
FATA[0131] Failed to get job complete status for job rke-network-plugin-deploy-job in namespace kube-system 
kubectl get nodes

NAME        STATUS     ROLES                      AGE    VERSION
127.0.1.1   NotReady   controlplane,etcd,worker   114s   v1.13.4
kubectl describe jobs -n kube-system
Name:           rke-network-plugin-deploy-job
Namespace:      kube-system
Selector:       controller-uid=9a9d01ed-5069-11e9-b158-080027e84c2b
Labels:         controller-uid=9a9d01ed-5069-11e9-b158-080027e84c2b
                job-name=rke-network-plugin-deploy-job
Annotations:    <none>
Parallelism:    1
Completions:    1
Start Time:     Wed, 27 Mar 2019 13:53:30 +0530
Pods Statuses:  1 Running / 0 Succeeded / 4 Failed
Pod Template:
  Labels:           controller-uid=9a9d01ed-5069-11e9-b158-080027e84c2b
                    job-name=rke-network-plugin-deploy-job
  Service Account:  rke-job-deployer
  Containers:
   rke-network-plugin-pod:
    Image:      rancher/hyperkube:v1.13.4-rancher1
    Port:       <none>
    Host Port:  <none>
    Command:
      kubectl
      apply
      -f
      /etc/config/rke-network-plugin.yaml
    Environment:  <none>
    Mounts:
      /etc/config from config-volume (rw)
  Volumes:
   config-volume:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      rke-network-plugin
    Optional:  false
Events:
  Type    Reason            Age   From            Message
  ----    ------            ----  ----            -------
  Normal  SuccessfulCreate  2m2s  job-controller  Created pod: rke-network-plugin-deploy-job-pk298
  Normal  SuccessfulCreate  102s  job-controller  Created pod: rke-network-plugin-deploy-job-n8wx2
  Normal  SuccessfulCreate  71s   job-controller  Created pod: rke-network-plugin-deploy-job-f6d9h
  Normal  SuccessfulCreate  50s   job-controller  Created pod: rke-network-plugin-deploy-job-6bcqv
  Normal  SuccessfulCreate  10s   job-controller  Created pod: rke-network-plugin-deploy-job-7kzkg
kubectl get pods -n kube-system 
NAME                                  READY   STATUS   RESTARTS   AGE
rke-network-plugin-deploy-job-6bcqv   0/1     Error    0          84s
rke-network-plugin-deploy-job-7kzkg   0/1     Error    0          44s
rke-network-plugin-deploy-job-f6d9h   0/1     Error    0          105s
rke-network-plugin-deploy-job-n8wx2   0/1     Error    0          2m16s
rke-network-plugin-deploy-job-pk298   0/1     Error    0          2m37s
kubectl logs -n kube-system rke-network-plugin-deploy-job-6bcqv

...
unable to recognize "/etc/config/rke-network-plugin.yaml": Get https://10.43.0.1:443/api?timeout=32s: dial tcp 10.43.0.1:443: connect: connection refused
unable to recognize "/etc/config/rke-network-plugin.yaml": Get https://10.43.0.1:443/api?timeout=32s: dial tcp 10.43.0.1:443: connect: connection refused
unable to recognize "/etc/config/rke-network-plugin.yaml": Get https://10.43.0.1:443/api?timeout=32s: dial tcp 10.43.0.1:443: connect: connection refused

Additional Info:

The rke binary is inside VM. I'm trying to create a single node cluster from inside the VM, with the VM itself as the node.

rke up --local (with no config file) causes the same problem

rancher/rke

Answer questions trankchung

Using Ubuntu or RancherOS it works fine but problem with CentOS 7x.

useful!
source:https://uonfu.com/
answerer
Chung Tran trankchung Charlotte, NC https://tran-scending.net A computer engineer truly advocating to open source software and Linux ecosystem. True fan of automation, kubernetes, and containerization.
Github User Rank List