[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]

Failed to remove orphaned pod - device or resource busy



Hi All,

I had a v1.3 cluster with a master and a node going. Both servers were rebooted over the weekend and all hell broke loose. 

The registry, the router and all apps I had running have stopped working. 

I see quite a few of these errors in the logs: 

Oct 04 17:14:07 poc-docker02.aipo.gov.au origin-node[1773]: I1004 17:14:07.510615    1815 kubelet.go:2117] Failed to remove orphaned pod "c449d37f-8549-11e6-83c1-005056915814" dir; err: remove /var/lib/origin/openshift.local.volumes/pods/c449d37f-8549-11e6-83c1-005056915814/volumes/kubernetes.io~secret/builder-token-ftgao: device or resource busy

I don't really know what happened, how I got into this state. The registry is stuck in "Container Creating".  If I start a new deployment of the router the deployment pod doesn't get past "Pending". 

Seems like I can't delete pods either. They get stuck in "Terminating". 

Not sure how to narrow this down. Any help greatly appreciated. 

Thanks

Lionel.

[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]