dmesg报INFO: task blocked for more than 120 seconds

riverz1227

已于 2024-08-19 17:19:47 修改

阅读量465

点赞数 9

分类专栏：操作系统 I/O性能调优文章标签： linux

于 2024-08-19 11:26:17 首次发布

本文链接：https://blog.csdn.net/Z1227f/article/details/141320617

版权

问题

业务反馈k8s node状态为not ready

排查

查看kubelet日志,定位是和docker交互超时

重启docker后恢复(ps:重启了两遍,重启第一次时卡住很久)

#tail -100f /var/log/kubernetes/kubelet.dc08-prod-maybach-bj01host-96130.root.log.WARNING.20240819-100423.168494
Log file created at: 2024/08/19 10:04:23
Running on machine: dc08-prod-maybach-bj01host-96130
Binary: Built with gc go1.11.4 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0819 10:04:23.018723  168494 manager.go:253] Timeout trying to communicate with docker during initialization, will retry
W0819 10:04:43.019185  168494 manager.go:253] Timeout trying to communicate with docker during initialization, will retry
W0819 10:05:23.019388  168494 manager.go:253] Timeout trying to communicate with docker during initialization, will retry
W0819 10:06:03.019575  168494 manager.go:253] Timeout trying to communicate with docker during initialization, will retry