[ 492.864502][ T44] INFO: task ip:4572 blocked for more than 122 seconds. [ 492.864911][ T44] Not tainted 6.18.0-rc6-virtme #1 [ 492.865068][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 492.865323][ T44] task:ip state:D stack:25352 pid:4572 tgid:4572 ppid:4567 task_flags:0x400100 flags:0x00080001 [ 492.865677][ T44] Call Trace: [ 492.865791][ T44] [ 492.865905][ T44] __schedule+0x88d/0x1b90 [ 492.866046][ T44] ? io_schedule_timeout+0x130/0x130 [ 492.866176][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.866304][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.866434][ T44] schedule+0xd4/0x260 [ 492.866537][ T44] schedule_preempt_disabled+0x18/0x30 [ 492.866659][ T44] __mutex_lock+0x9ae/0x1500 [ 492.866791][ T44] ? napi_enable+0x3b/0x80 [ 492.866919][ T44] ? virtqueue_add_inbuf_ctx+0x1850/0x1850 [ 492.867070][ T44] ? ww_mutex_lock+0x160/0x160 [ 492.867192][ T44] ? __asan_memset+0x27/0x50 [ 492.867316][ T44] ? sg_init_table+0x19/0x60 [ 492.867466][ T44] ? try_fill_recv+0x3ec/0x1750 [ 492.867591][ T44] ? napi_enable+0x3b/0x80 [ 492.867717][ T44] napi_enable+0x3b/0x80 [ 492.867810][ T44] __virtnet_rx_resume+0x156/0x290 [ 492.867918][ T44] ? queue_delayed_work_on+0x91/0x100 [ 492.868027][ T44] virtnet_rx_resume_all+0xe7/0x1a0 [ 492.868136][ T44] virtnet_xdp_set+0xef7/0x1aa0 [ 492.868252][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0 [ 492.868359][ T44] dev_xdp_install+0x3e4/0x8e0 [ 492.868476][ T44] ? netif_skb_check_for_xdp+0x600/0x600 [ 492.868591][ T44] dev_xdp_attach+0x50d/0x1320 [ 492.869041][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0 [ 492.869159][ T44] ? __bpf_prog_get+0x320/0x320 [ 492.869271][ T44] dev_change_xdp_fd+0x182/0x240 [ 492.869381][ T44] do_setlink.isra.0+0x1c2d/0x2880 [ 492.869499][ T44] ? rtnl_newlink_create+0x900/0x900 [ 492.869612][ T44] ? rcu_lockdep_current_cpu_online+0x3e/0x1b0 [ 492.869754][ T44] ? rcu_read_lock_any_held+0x41/0xa0 [ 492.869861][ T44] ? validate_chain+0x287/0x5f0 [ 492.869971][ T44] ? rcu_read_lock_any_held+0x6b/0xa0 [ 492.870078][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 492.870185][ T44] ? __lock_acquire+0x34c/0x740 [ 492.870297][ T44] ? trace_lock_acquire+0x88/0xd0 [ 492.870404][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 492.870516][ T44] ? lock_acquire+0x31/0x80 [ 492.870633][ T44] ? rtnl_newlink+0x5df/0xb20 [ 492.870740][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.870848][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.870959][ T44] ? trace_contention_end+0xd6/0x140 [ 492.871070][ T44] ? rtnl_newlink+0x5df/0xb20 [ 492.871176][ T44] ? __mutex_lock+0x32e/0x1500 [ 492.871292][ T44] ? ww_mutex_lock+0x160/0x160 [ 492.871401][ T44] ? nla_validate_int_range+0x5b0/0x5b0 [ 492.871521][ T44] ? __rtnl_newlink+0x3fa/0xa40 [ 492.871637][ T44] rtnl_newlink+0x637/0xb20 [ 492.871749][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 492.871863][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.871971][ T44] ? find_held_lock+0x2b/0x80 [ 492.872078][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 492.872188][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.872305][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 492.872417][ T44] rtnetlink_rcv_msg+0x6fe/0xb90 [ 492.872540][ T44] ? rtnl_port_fill+0x940/0x940 [ 492.872650][ T44] ? __lock_acquire+0x34c/0x740 [ 492.872759][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.872868][ T44] ? find_held_lock+0x2b/0x80 [ 492.872986][ T44] netlink_rcv_skb+0x123/0x380 [ 492.873096][ T44] ? rtnl_port_fill+0x940/0x940 [ 492.873204][ T44] ? netlink_ack+0xcc0/0xcc0 [ 492.873314][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 492.873426][ T44] netlink_unicast+0x4a3/0x770 [ 492.873542][ T44] ? netlink_attachskb+0x810/0x810 [ 492.873656][ T44] ? __lock_acquire+0x34c/0x740 [ 492.873766][ T44] netlink_sendmsg+0x735/0xc60 [ 492.873876][ T44] ? netlink_unicast+0x770/0x770 [ 492.873990][ T44] ? __might_fault+0x97/0x140 [ 492.874102][ T44] ____sys_sendmsg+0x419/0x850 [ 492.874215][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 492.874325][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 492.874462][ T44] ? move_addr_to_kernel+0x40/0x40 [ 492.874570][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 492.874681][ T44] ? validate_chain+0x287/0x5f0 [ 492.874794][ T44] ___sys_sendmsg+0xfd/0x180 [ 492.874901][ T44] ? __call_rcu_common.constprop.0+0xa5/0x680 [ 492.875036][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 492.875164][ T44] __sys_sendmsg+0x124/0x1c0 [ 492.875272][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 492.875377][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 492.875489][ T44] ? __call_rcu_common.constprop.0+0x2fa/0x680 [ 492.875628][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 492.875744][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.875857][ T44] do_syscall_64+0xbb/0xfd0 [ 492.875971][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 492.876104][ T44] RIP: 0033:0x7f0dc00dcc5e [ 492.876221][ T44] RSP: 002b:00007ffc8f86cc30 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 492.876398][ T44] RAX: ffffffffffffffda RBX: 0000000000000007 RCX: 00007f0dc00dcc5e [ 492.876563][ T44] RDX: 0000000000000000 RSI: 00007ffc8f86ccf0 RDI: 0000000000000003 [ 492.876731][ T44] RBP: 00007ffc8f86cc40 R08: 0000000000000000 R09: 0000000000000000 [ 492.876894][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffc8f86d3b0 [ 492.877058][ T44] R13: 00000000692416e2 R14: 0000000000000000 R15: 0000000000499600 [ 492.877225][ T44] [ 492.877313][ T44] INFO: task ip:4572 is blocked on a mutex likely owned by task kworker/3:2:438. [ 492.877498][ T44] task:kworker/3:2 state:D stack:27896 pid:438 tgid:438 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 492.877745][ T44] Workqueue: events refill_work [ 492.877859][ T44] Call Trace: [ 492.877942][ T44] [ 492.878001][ T44] __schedule+0x88d/0x1b90 [ 492.878117][ T44] ? io_schedule_timeout+0x130/0x130 [ 492.878227][ T44] ? usleep_range_state+0xba/0x1b0 [ 492.878336][ T44] ? find_held_lock+0x2b/0x80 [ 492.878443][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.878558][ T44] ? usleep_range_state+0xba/0x1b0 [ 492.878673][ T44] schedule+0xd4/0x260 [ 492.878758][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0 [ 492.878894][ T44] ? schedule_timeout_idle+0xe0/0xe0 [ 492.879004][ T44] ? hrtimer_cb_get_time+0x90/0x90 [ 492.879112][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 492.879218][ T44] ? ktime_get+0x15e/0x220 [ 492.879325][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 492.879436][ T44] ? ktime_get+0xa9/0x220 [ 492.879523][ T44] usleep_range_state+0x133/0x1b0 [ 492.879636][ T44] ? schedule_hrtimeout+0x20/0x20 [ 492.879749][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 492.879862][ T44] napi_disable_locked+0x379/0x5f0 [ 492.879970][ T44] ? _mutex_trylock_nest_lock+0x150/0x150 [ 492.880077][ T44] ? netdev_bind_sb_channel_queue+0x470/0x470 [ 492.880217][ T44] napi_disable+0x43/0x80 [ 492.880299][ T44] refill_work+0x116/0x210 [ 492.880412][ T44] process_one_work+0xd57/0x1390 [ 492.880529][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 492.880636][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.880745][ T44] ? assign_work+0x152/0x380 [ 492.880858][ T44] worker_thread+0x4d6/0xd40 [ 492.880970][ T44] ? process_one_work+0x1390/0x1390 [ 492.881078][ T44] ? __kthread_parkme+0xb3/0x200 [ 492.881188][ T44] ? process_one_work+0x1390/0x1390 [ 492.881299][ T44] kthread+0x355/0x5b0 [ 492.881381][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.881493][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.881603][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.881715][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.881836][ T44] ret_from_fork+0x1d4/0x270 [ 492.881948][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.882055][ T44] ret_from_fork_asm+0x11/0x20 [ 492.882176][ T44] [ 492.882265][ T44] [ 492.882265][ T44] Showing all locks held in the system: [ 492.882426][ T44] 1 lock held by khungtaskd/44: [ 492.882619][ T44] #0: ffffffff9cf78fc0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x2b/0x1db [ 492.882811][ T44] 3 locks held by kworker/u16:1/72: [ 492.882913][ T44] #0: ff1100000f5f4d48 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 492.883118][ T44] #1: ffa00000004d7d30 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 492.883371][ T44] #2: ffffffff9d692a28 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 492.883565][ T44] 3 locks held by kworker/3:2/438: [ 492.883670][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 492.883877][ T44] #1: ffa0000000bb7d30 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 492.884110][ T44] #2: ff1100000f042c98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 492.884296][ T44] 2 locks held by ip/4572: [ 492.884397][ T44] #0: ffffffff9d692a28 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x5df/0xb20 [ 492.884582][ T44] #1: ff1100000f042c98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80 [ 492.884768][ T44] [ 492.884821][ T44] ============================================= [ 492.884821][ T44] [ 580.095462][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 5311 ms [ 580.096017][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 5311000 usecs ago [ 585.535455][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 10751 ms [ 585.535861][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 10751000 usecs ago [ 591.167460][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 16383 ms [ 591.167862][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 16383000 usecs ago [ 596.287456][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 21503 ms [ 596.287840][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 21503000 usecs ago [ 601.407457][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 26623 ms [ 601.407841][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 26623000 usecs ago [ 607.551456][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 32767 ms [ 607.551834][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 32767000 usecs ago [ 613.183455][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 38399 ms [ 613.183825][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 38399000 usecs ago [ 615.744477][ T44] INFO: task kworker/u16:1:72 blocked for more than 122 seconds. [ 615.744761][ T44] Not tainted 6.18.0-rc6-virtme #1 [ 615.744908][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 615.745151][ T44] task:kworker/u16:1 state:D stack:27000 pid:72 tgid:72 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 615.745484][ T44] Workqueue: ipv6_addrconf addrconf_verify_work [ 615.745665][ T44] Call Trace: [ 615.745780][ T44] [ 615.745858][ T44] __schedule+0x88d/0x1b90 [ 615.746002][ T44] ? io_schedule_timeout+0x130/0x130 [ 615.746143][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.746270][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.746392][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.746523][ T44] schedule+0xd4/0x260 [ 615.746617][ T44] schedule_preempt_disabled+0x18/0x30 [ 615.746747][ T44] __mutex_lock+0x9ae/0x1500 [ 615.746871][ T44] ? addrconf_verify_work+0x12/0x30 [ 615.747001][ T44] ? ww_mutex_lock+0x160/0x160 [ 615.747129][ T44] ? process_one_work+0xd16/0x1390 [ 615.747250][ T44] ? trace_lock_acquire+0x88/0xd0 [ 615.747366][ T44] ? trace_lock_acquire+0x88/0xd0 [ 615.747497][ T44] ? addrconf_verify_work+0x12/0x30 [ 615.747614][ T44] addrconf_verify_work+0x12/0x30 [ 615.747738][ T44] process_one_work+0xd57/0x1390 [ 615.747867][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 615.747986][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.748100][ T44] ? assign_work+0x152/0x380 [ 615.748207][ T44] worker_thread+0x4d6/0xd40 [ 615.748315][ T44] ? process_one_work+0x1390/0x1390 [ 615.748422][ T44] ? __kthread_parkme+0xb3/0x200 [ 615.748538][ T44] ? process_one_work+0x1390/0x1390 [ 615.748645][ T44] kthread+0x355/0x5b0 [ 615.748730][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.748841][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.748947][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.749056][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.749165][ T44] ret_from_fork+0x1d4/0x270 [ 615.749271][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.749378][ T44] ret_from_fork_asm+0x11/0x20 [ 615.749495][ T44] [ 615.749586][ T44] INFO: task kworker/u16:1:72 is blocked on a mutex likely owned by task ip:4572. [ 615.749775][ T44] INFO: task ip:4572 blocked for more than 245 seconds. [ 615.749901][ T44] Not tainted 6.18.0-rc6-virtme #1 [ 615.750002][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 615.750178][ T44] task:ip state:D stack:25352 pid:4572 tgid:4572 ppid:4567 task_flags:0x400100 flags:0x00080001 [ 615.750417][ T44] Call Trace: [ 615.750502][ T44] [ 615.750558][ T44] __schedule+0x88d/0x1b90 [ 615.750672][ T44] ? io_schedule_timeout+0x130/0x130 [ 615.750789][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.750899][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.751007][ T44] schedule+0xd4/0x260 [ 615.751089][ T44] schedule_preempt_disabled+0x18/0x30 [ 615.751198][ T44] __mutex_lock+0x9ae/0x1500 [ 615.751307][ T44] ? napi_enable+0x3b/0x80 [ 615.751414][ T44] ? virtqueue_add_inbuf_ctx+0x1850/0x1850 [ 615.751555][ T44] ? ww_mutex_lock+0x160/0x160 [ 615.751663][ T44] ? __asan_memset+0x27/0x50 [ 615.751772][ T44] ? sg_init_table+0x19/0x60 [ 615.751882][ T44] ? try_fill_recv+0x3ec/0x1750 [ 615.751995][ T44] ? napi_enable+0x3b/0x80 [ 615.752103][ T44] napi_enable+0x3b/0x80 [ 615.752186][ T44] __virtnet_rx_resume+0x156/0x290 [ 615.752294][ T44] ? queue_delayed_work_on+0x91/0x100 [ 615.752401][ T44] virtnet_rx_resume_all+0xe7/0x1a0 [ 615.752512][ T44] virtnet_xdp_set+0xef7/0x1aa0 [ 615.752622][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0 [ 615.752733][ T44] dev_xdp_install+0x3e4/0x8e0 [ 615.752844][ T44] ? netif_skb_check_for_xdp+0x600/0x600 [ 615.752954][ T44] dev_xdp_attach+0x50d/0x1320 [ 615.753065][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0 [ 615.753172][ T44] ? __bpf_prog_get+0x320/0x320 [ 615.753283][ T44] dev_change_xdp_fd+0x182/0x240 [ 615.753391][ T44] do_setlink.isra.0+0x1c2d/0x2880 [ 615.753504][ T44] ? rtnl_newlink_create+0x900/0x900 [ 615.753614][ T44] ? rcu_lockdep_current_cpu_online+0x3e/0x1b0 [ 615.753750][ T44] ? rcu_read_lock_any_held+0x41/0xa0 [ 615.753856][ T44] ? validate_chain+0x287/0x5f0 [ 615.753963][ T44] ? rcu_read_lock_any_held+0x6b/0xa0 [ 615.754069][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 615.754177][ T44] ? __lock_acquire+0x34c/0x740 [ 615.754290][ T44] ? trace_lock_acquire+0x88/0xd0 [ 615.754396][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 615.754508][ T44] ? lock_acquire+0x31/0x80 [ 615.754616][ T44] ? rtnl_newlink+0x5df/0xb20 [ 615.754724][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.754830][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.754937][ T44] ? trace_contention_end+0xd6/0x140 [ 615.755045][ T44] ? rtnl_newlink+0x5df/0xb20 [ 615.755155][ T44] ? __mutex_lock+0x32e/0x1500 [ 615.755264][ T44] ? ww_mutex_lock+0x160/0x160 [ 615.755372][ T44] ? nla_validate_int_range+0x5b0/0x5b0 [ 615.755485][ T44] ? __rtnl_newlink+0x3fa/0xa40 [ 615.755596][ T44] rtnl_newlink+0x637/0xb20 [ 615.755708][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 615.755820][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.755926][ T44] ? find_held_lock+0x2b/0x80 [ 615.756037][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 615.756143][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.756255][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 615.756362][ T44] rtnetlink_rcv_msg+0x6fe/0xb90 [ 615.756480][ T44] ? rtnl_port_fill+0x940/0x940 [ 615.756587][ T44] ? __lock_acquire+0x34c/0x740 [ 615.756695][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.756809][ T44] ? find_held_lock+0x2b/0x80 [ 615.756917][ T44] netlink_rcv_skb+0x123/0x380 [ 615.757024][ T44] ? rtnl_port_fill+0x940/0x940 [ 615.757131][ T44] ? netlink_ack+0xcc0/0xcc0 [ 615.757241][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 615.757350][ T44] netlink_unicast+0x4a3/0x770 [ 615.757463][ T44] ? netlink_attachskb+0x810/0x810 [ 615.757572][ T44] ? __lock_acquire+0x34c/0x740 [ 615.757685][ T44] netlink_sendmsg+0x735/0xc60 [ 615.757802][ T44] ? netlink_unicast+0x770/0x770 [ 615.757911][ T44] ? __might_fault+0x97/0x140 [ 615.758019][ T44] ____sys_sendmsg+0x419/0x850 [ 615.758125][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 615.758232][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 615.758363][ T44] ? move_addr_to_kernel+0x40/0x40 [ 615.758481][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 615.758588][ T44] ? validate_chain+0x287/0x5f0 [ 615.758697][ T44] ___sys_sendmsg+0xfd/0x180 [ 615.758805][ T44] ? __call_rcu_common.constprop.0+0xa5/0x680 [ 615.758937][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 615.759056][ T44] __sys_sendmsg+0x124/0x1c0 [ 615.759162][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 615.759268][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 615.759376][ T44] ? __call_rcu_common.constprop.0+0x2fa/0x680 [ 615.759518][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 615.759624][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.759734][ T44] do_syscall_64+0xbb/0xfd0 [ 615.759843][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 615.759974][ T44] RIP: 0033:0x7f0dc00dcc5e [ 615.760089][ T44] RSP: 002b:00007ffc8f86cc30 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 615.760253][ T44] RAX: ffffffffffffffda RBX: 0000000000000007 RCX: 00007f0dc00dcc5e [ 615.760412][ T44] RDX: 0000000000000000 RSI: 00007ffc8f86ccf0 RDI: 0000000000000003 [ 615.760577][ T44] RBP: 00007ffc8f86cc40 R08: 0000000000000000 R09: 0000000000000000 [ 615.760739][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffc8f86d3b0 [ 615.760902][ T44] R13: 00000000692416e2 R14: 0000000000000000 R15: 0000000000499600 [ 615.761069][ T44] [ 615.761153][ T44] INFO: task ip:4572 is blocked on a mutex likely owned by task kworker/3:2:438. [ 615.761330][ T44] task:kworker/3:2 state:D stack:27896 pid:438 tgid:438 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 615.761577][ T44] Workqueue: events refill_work [ 615.761685][ T44] Call Trace: [ 615.761769][ T44] [ 615.761824][ T44] __schedule+0x88d/0x1b90 [ 615.761934][ T44] ? io_schedule_timeout+0x130/0x130 [ 615.762043][ T44] ? usleep_range_state+0xba/0x1b0 [ 615.762151][ T44] ? find_held_lock+0x2b/0x80 [ 615.762259][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.762370][ T44] ? usleep_range_state+0xba/0x1b0 [ 615.762480][ T44] schedule+0xd4/0x260 [ 615.762561][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0 [ 615.762696][ T44] ? schedule_timeout_idle+0xe0/0xe0 [ 615.762807][ T44] ? hrtimer_cb_get_time+0x90/0x90 [ 615.762915][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 615.763021][ T44] ? ktime_get+0x15e/0x220 [ 615.763129][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 615.763240][ T44] ? ktime_get+0xa9/0x220 [ 615.763321][ T44] usleep_range_state+0x133/0x1b0 [ 615.763429][ T44] ? schedule_hrtimeout+0x20/0x20 [ 615.763539][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 615.763647][ T44] napi_disable_locked+0x379/0x5f0 [ 615.763759][ T44] ? _mutex_trylock_nest_lock+0x150/0x150 [ 615.763870][ T44] ? netdev_bind_sb_channel_queue+0x470/0x470 [ 615.764006][ T44] napi_disable+0x43/0x80 [ 615.764088][ T44] refill_work+0x116/0x210 [ 615.764197][ T44] process_one_work+0xd57/0x1390 [ 615.764308][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 615.764415][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.764530][ T44] ? assign_work+0x152/0x380 [ 615.764641][ T44] worker_thread+0x4d6/0xd40 [ 615.764758][ T44] ? process_one_work+0x1390/0x1390 [ 615.764864][ T44] ? __kthread_parkme+0xb3/0x200 [ 615.764979][ T44] ? process_one_work+0x1390/0x1390 [ 615.765092][ T44] kthread+0x355/0x5b0 [ 615.765179][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.765286][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.765395][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.765509][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.765617][ T44] ret_from_fork+0x1d4/0x270 [ 615.765724][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.765832][ T44] ret_from_fork_asm+0x11/0x20 [ 615.765945][ T44] [ 615.766030][ T44] [ 615.766030][ T44] Showing all locks held in the system: [ 615.766186][ T44] 1 lock held by khungtaskd/44: [ 615.766293][ T44] #0: ffffffff9cf78fc0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x2b/0x1db [ 615.766567][ T44] 3 locks held by kworker/u16:1/72: [ 615.766670][ T44] #0: ff1100000f5f4d48 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 615.766883][ T44] #1: ffa00000004d7d30 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 615.767141][ T44] #2: ffffffff9d692a28 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 615.767324][ T44] 3 locks held by kworker/3:2/438: [ 615.767426][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 615.767644][ T44] #1: ffa0000000bb7d30 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 615.767893][ T44] #2: ff1100000f042c98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 615.768078][ T44] 2 locks held by ip/4572: [ 615.768182][ T44] #0: ffffffff9d692a28 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x5df/0xb20 [ 615.768363][ T44] #1: ff1100000f042c98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80 [ 615.768553][ T44] [ 615.768606][ T44] ============================================= [ 615.768606][ T44] [ 618.303455][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 43519 ms [ 618.303829][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 43519000 usecs ago [ 623.423455][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 48639 ms [ 623.423834][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 48639000 usecs ago [ 629.567455][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 54783 ms [ 629.567831][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 54783000 usecs ago [ 635.199458][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 60415 ms [ 635.199849][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 60415000 usecs ago [ 640.319463][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 65535 ms [ 640.319844][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 65535000 usecs ago [ 646.463456][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 71679 ms [ 646.463827][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 71679000 usecs ago [ 652.095455][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 77311 ms [ 652.095880][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 77311000 usecs ago [ 657.215455][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 82431 ms [ 657.215819][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 82431000 usecs ago [ 662.335455][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 87551 ms [ 662.335834][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 87551000 usecs ago [ 668.479455][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 93695 ms [ 668.479839][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 93695000 usecs ago [ 674.111455][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 99327 ms [ 674.111828][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 99327000 usecs ago [ 679.231455][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 104447 ms [ 679.231884][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 104447000 usecs ago [ 684.351455][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 109567 ms [ 684.351872][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 109567000 usecs ago [ 690.495456][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 115711 ms [ 690.495877][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 115711000 usecs ago [ 696.127455][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 121343 ms [ 696.127870][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 121343000 usecs ago [ 701.247467][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 126463 ms [ 701.247997][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 126463000 usecs ago [ 706.367460][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 131583 ms [ 706.367951][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 131583000 usecs ago [ 712.511457][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 137727 ms [ 712.511914][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 137727000 usecs ago [ 718.143456][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 143359 ms [ 718.143903][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 143359000 usecs ago [ 723.263460][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 1 timed out 148479 ms [ 723.263916][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 148479000 usecs ago