profile
viewpoint

Ask questionsCluster not starting with DIND setup

What happened: Kind 0.3.0 cluster not starting on prow with k8s test images and docker in docker enabled. Kind 0.2.1 works fine. We are running our CI in a prow cluster, using cr.io/k8s-testimages/bootstrap:latest as base image with dind enabled. The cluster does not start.

What you expected to happen: The cluster to be up & running.

How to reproduce it (as minimally and precisely as possible): docker run --privileged --rm -it -e DOCKER_IN_DOCKER_ENABLED='true' -v $(pwd):/workspace --entrypoint /usr/local/bin/runner.sh gcr.io/k8s-testimages/bootstrap:latest bash -c "wget https://dl.google.com/go/go1.12.6.linux-amd64.tar.gz && tar -C /usr/local -xzf go1.12.6.linux-amd64.tar.gz && GO111MODUILE='on' /usr/local/go/bin/go get sigs.k8s.io/kind@v0.3.0 && ~/go/bin/kind create cluster --name=fede

Anything else we need to know?: The control plane node starts correctly. If I look for kubelet logs inside I can see a bunch of

If I bash into it and look for the kubelet logs:


Jun 17 12:38:24 fede-control-plane kubelet[216]: E0617 12:38:24.141929     216 kuberuntime_manager.go:693] createPodSandbox for pod "kube-controller-manager-fede-control-plane_kube-system(ced6e7a763e96d1888013e32a44b1066)" failed: rpc error: code = Unknown desc = failed to start sandbox container: failed to create containerd task: failed to mount rootfs component &{overlay overlay [workdir=/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs/snapshots/24/work upperdir=/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs/snapshots/24/fs lowerdir=/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs/snapshots/1/fs]}: invalid argument: unknown
Jun 17 12:38:24 fede-control-plane kubelet[216]: E0617 12:38:24.141977     216 pod_workers.go:190] Error syncing pod ced6e7a763e96d1888013e32a44b1066 ("kube-controller-manager-fede-control-plane_kube-system(ced6e7a763e96d1888013e32a44b1066)"), skipping: failed to "CreatePodSandbox" for "kube-controller-manager-fede-control-plane_kube-system(ced6e7a763e96d1888013e32a44b1066)" with CreatePodSandboxError: "CreatePodSandbox for pod \"kube-controller-manager-fede-control-plane_kube-system(ced6e7a763e96d1888013e32a44b1066)\" failed: rpc error: code = Unknown desc = failed to start sandbox container: failed to create containerd task: failed to mount rootfs component &{overlay overlay [workdir=/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs/snapshots/24/work upperdir=/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs/snapshots/24/fs lowerdir=/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs/snapshots/1/fs]}: invalid argument: unknown"

And also a bunch of failures while hitting the api (which makes sense since the apiserver is still down).

Environment:

  • kind version: (use kind version):
  • Kubernetes version: (use kubectl version):
  • Docker version: (use docker info):
  • OS (e.g. from /etc/os-release):
kubernetes-sigs/kind

Answer questions fedepaol

Nice, I'll try to add the mounts and see if it works! Thanks!

useful!

Related questions

Appears when using ceph of roook: map failed: (30) Read-only file system hot 1
Errors compile: version "go1.12.1" does not match go tool version "go1.10.2" hot 1
Installing Istio fails when trying to match resources hot 1
Helm: rabbitmq-ha deployment fails to discover k8s nodes hot 1
`kind` should be able to start the control plane when `/dev/kmsg` is not available hot 1
WSLv1: No DNS between pods or to the internet hot 1
source:https://uonfu.com/
Github User Rank List