Unable to access pods going to pending state

Symptom

Users are not able to login into a pod or any pods going to pending state.

The journalctl -u kubelet | grep -i garbage shows error Image garbage collection failed once. Stats initialization may not have completed yet: failed to get imageFs info: unable to find data in memory cache.

Cause

This issue mostly occurs in development environments or proof of concepts (POC) set ups where building of Docker images ran multiple times and the cache is not cleared.

Action

Run following commands:

docker system prune

systemctl stop kubelet

systemctl stop docker

systemctl start docker

systemctl start kubelet