[ 738.637565][ T44] INFO: task ip:5796 blocked for more than 122 seconds. [ 738.637886][ T44] Not tainted 6.19.0-rc1-virtme #1 [ 738.638024][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 738.638254][ T44] task:ip state:D stack:24976 pid:5796 tgid:5796 ppid:5791 task_flags:0x400100 flags:0x00080000 [ 738.638567][ T44] Call Trace: [ 738.638672][ T44] [ 738.638741][ T44] __schedule+0xae2/0x1720 [ 738.638884][ T44] ? io_schedule_timeout+0x130/0x130 [ 738.639010][ T44] ? __lock_release.isra.0+0x59/0x170 [ 738.639142][ T44] ? __lock_release.isra.0+0x59/0x170 [ 738.639269][ T44] schedule+0xd4/0x260 [ 738.639369][ T44] schedule_preempt_disabled+0x18/0x30 [ 738.639497][ T44] __mutex_lock+0xd76/0x1f20 [ 738.639631][ T44] ? napi_enable+0x3b/0x80 [ 738.639754][ T44] ? ww_mutex_lock+0x160/0x160 [ 738.639878][ T44] ? __lock_release.isra.0+0x59/0x170 [ 738.639997][ T44] ? __asan_memset+0x27/0x50 [ 738.640123][ T44] ? sg_init_table+0x19/0x60 [ 738.640245][ T44] ? try_fill_recv+0x3ec/0x1750 [ 738.640371][ T44] ? napi_enable+0x3b/0x80 [ 738.640488][ T44] napi_enable+0x3b/0x80 [ 738.640587][ T44] __virtnet_rx_resume+0x156/0x290 [ 738.640709][ T44] ? queue_delayed_work_on+0x91/0x100 [ 738.640833][ T44] virtnet_rx_resume_all+0xe7/0x1a0 [ 738.640951][ T44] virtnet_xdp_set+0xef7/0x1aa0 [ 738.641075][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0 [ 738.641189][ T44] dev_xdp_install+0x3e4/0x890 [ 738.641314][ T44] ? netif_set_xps_queue+0x40/0x40 [ 738.641562][ T44] dev_xdp_attach+0x50d/0x1310 [ 738.641681][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0 [ 738.641804][ T44] ? __bpf_prog_get+0x320/0x320 [ 738.641921][ T44] dev_change_xdp_fd+0x176/0x210 [ 738.642042][ T44] do_setlink.isra.0+0x1c2d/0x2880 [ 738.642159][ T44] ? rtnl_newlink_create+0x900/0x900 [ 738.642285][ T44] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 738.642427][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 738.642550][ T44] ? validate_chain+0x37b/0xb70 [ 738.642666][ T44] ? rcu_read_lock_any_held+0x66/0x90 [ 738.642787][ T44] ? stack_depot_save_flags+0x3f1/0x6f0 [ 738.642907][ T44] ? __lock_acquire+0x577/0xc10 [ 738.643031][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 738.643146][ T44] ? rtnl_newlink+0x6fc/0xe90 [ 738.643270][ T44] ? lock_acquire+0x10a/0x150 [ 738.643384][ T44] ? rcu_is_watching+0x15/0xd0 [ 738.643509][ T44] ? rcu_is_watching+0x15/0xd0 [ 738.643633][ T44] ? trace_contention_end+0xd6/0x110 [ 738.643748][ T44] ? __mutex_lock+0x285/0x1f20 [ 738.643873][ T44] ? rtnl_newlink+0x6fc/0xe90 [ 738.643988][ T44] ? ww_mutex_lock+0x160/0x160 [ 738.644109][ T44] ? nla_get_range_signed+0x3d0/0x3d0 [ 738.644231][ T44] ? __rtnl_newlink+0x3fa/0xa40 [ 738.644359][ T44] rtnl_newlink+0x75c/0xe90 [ 738.644476][ T44] ? __lock_release.isra.0+0x59/0x170 [ 738.644599][ T44] ? rtnl_setlink+0x880/0x880 [ 738.644717][ T44] ? __lock_acquire+0x577/0xc10 [ 738.644840][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 738.644953][ T44] ? find_held_lock+0x2b/0x80 [ 738.645075][ T44] ? rtnl_setlink+0x880/0x880 [ 738.645188][ T44] ? __lock_release.isra.0+0x59/0x170 [ 738.645313][ T44] ? rtnl_setlink+0x880/0x880 [ 738.645426][ T44] rtnetlink_rcv_msg+0x6fe/0xb90 [ 738.645552][ T44] ? rtnl_fdb_dump+0x620/0x620 [ 738.645666][ T44] ? __lock_acquire+0x577/0xc10 [ 738.645788][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 738.645905][ T44] ? find_held_lock+0x2b/0x80 [ 738.646028][ T44] netlink_rcv_skb+0x123/0x380 [ 738.646143][ T44] ? rtnl_fdb_dump+0x620/0x620 [ 738.646268][ T44] ? netlink_ack+0xcc0/0xcc0 [ 738.646386][ T44] ? netlink_deliver_tap+0xc5/0x330 [ 738.646503][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 738.646629][ T44] netlink_unicast+0x4a3/0x770 [ 738.646744][ T44] ? netlink_attachskb+0x810/0x810 [ 738.646866][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 738.646981][ T44] ? __lock_acquire+0x577/0xc10 [ 738.647103][ T44] netlink_sendmsg+0x735/0xc60 [ 738.647218][ T44] ? netlink_unicast+0x770/0x770 [ 738.647344][ T44] ____sys_sendmsg+0x419/0x850 [ 738.647460][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 738.647582][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 738.647727][ T44] ? move_addr_to_kernel+0x40/0x40 [ 738.647851][ T44] ? stack_depot_save_flags+0x3f1/0x6f0 [ 738.647967][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 738.648088][ T44] ___sys_sendmsg+0xfd/0x180 [ 738.648202][ T44] ? __call_rcu_common.constprop.0+0xa6/0xa00 [ 738.648354][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 738.648483][ T44] __sys_sendmsg+0x124/0x1c0 [ 738.648610][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 738.648724][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 738.648846][ T44] ? __call_rcu_common.constprop.0+0x3bd/0xa00 [ 738.649023][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 738.649142][ T44] ? rcu_is_watching+0x15/0xd0 [ 738.649260][ T44] do_syscall_64+0xbd/0xfc0 [ 738.649380][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 738.649522][ T44] RIP: 0033:0x7ff26ada5c5e [ 738.649653][ T44] RSP: 002b:00007fff35285dd0 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 738.649833][ T44] RAX: ffffffffffffffda RBX: 0000000000000007 RCX: 00007ff26ada5c5e [ 738.650016][ T44] RDX: 0000000000000000 RSI: 00007fff35285e90 RDI: 0000000000000003 [ 738.650188][ T44] RBP: 00007fff35285de0 R08: 0000000000000000 R09: 0000000000000000 [ 738.650373][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fff35286550 [ 738.650555][ T44] R13: 0000000069538d1b R14: 0000000000000000 R15: 0000000000499600 [ 738.650732][ T44] [ 738.650828][ T44] INFO: task ip:5796 is blocked on a mutex likely owned by task kworker/3:0:33. [ 738.651017][ T44] task:kworker/3:0 state:D stack:28120 pid:33 tgid:33 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 738.651283][ T44] Workqueue: events refill_work [ 738.651401][ T44] Call Trace: [ 738.651497][ T44] [ 738.651568][ T44] __schedule+0xae2/0x1720 [ 738.651684][ T44] ? usleep_range_state+0xba/0x1b0 [ 738.651804][ T44] ? io_schedule_timeout+0x130/0x130 [ 738.651920][ T44] ? __lock_release.isra.0+0x59/0x170 [ 738.652042][ T44] ? usleep_range_state+0xba/0x1b0 [ 738.652154][ T44] schedule+0xd4/0x260 [ 738.652255][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0 [ 738.652395][ T44] ? schedule_timeout_idle+0xe0/0xe0 [ 738.652516][ T44] ? __hrtimer_cb_get_time+0x50/0x50 [ 738.652639][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 738.652751][ T44] ? ktime_get+0x15e/0x220 [ 738.652873][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 738.652986][ T44] ? ktime_get+0xa9/0x220 [ 738.653086][ T44] usleep_range_state+0x133/0x1b0 [ 738.653201][ T44] ? schedule_hrtimeout+0x20/0x20 [ 738.653333][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 738.653448][ T44] ? refill_work+0x149/0x210 [ 738.653572][ T44] napi_disable_locked+0x379/0x5f0 [ 738.653686][ T44] ? _mutex_trylock_nest_lock+0x340/0x340 [ 738.653808][ T44] ? register_netdevice_notifier_net+0x40/0x40 [ 738.653952][ T44] napi_disable+0x43/0x80 [ 738.654045][ T44] refill_work+0x116/0x210 [ 738.654160][ T44] process_one_work+0xd57/0x1390 [ 738.654287][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 738.654400][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 738.654524][ T44] ? assign_work+0x152/0x380 [ 738.654652][ T44] worker_thread+0x4d6/0xd40 [ 738.654770][ T44] ? process_one_work+0x1390/0x1390 [ 738.654890][ T44] kthread+0x355/0x5b0 [ 738.654977][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 738.655098][ T44] ? __lock_release.isra.0+0x59/0x170 [ 738.655211][ T44] ? rcu_is_watching+0x15/0xd0 [ 738.655334][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 738.655447][ T44] ret_from_fork+0x3fb/0x510 [ 738.655569][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 738.655713][ T44] ? __switch_to+0x53c/0xd00 [ 738.655834][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 738.655949][ T44] ret_from_fork_asm+0x11/0x20 [ 738.656076][ T44] [ 738.656167][ T44] [ 738.656167][ T44] Showing all locks held in the system: [ 738.656351][ T44] 3 locks held by kworker/u16:0/12: [ 738.656465][ T44] #0: ff1100000916f148 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 738.656770][ T44] #1: ffa00000000c7cc0 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 738.657052][ T44] #2: ffffffffb4085768 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 738.657257][ T44] 3 locks held by kworker/3:0/33: [ 738.657369][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 738.657598][ T44] #1: ffa0000000257cc0 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 738.657852][ T44] #2: ff11000008c42c98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 738.658046][ T44] 1 lock held by khungtaskd/44: [ 738.658161][ T44] #0: ffffffffb3971040 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 738.658400][ T44] 2 locks held by ip/5796: [ 738.658507][ T44] #0: ffffffffb4085768 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x6fc/0xe90 [ 738.658710][ T44] #1: ff11000008c42c98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80 [ 738.658905][ T44] [ 738.658970][ T44] ============================================= [ 738.658970][ T44] [ 861.517644][ T44] INFO: task kworker/u16:0:12 blocked for more than 122 seconds. [ 861.517903][ T44] Not tainted 6.19.0-rc1-virtme #1 [ 861.518028][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 861.518249][ T44] task:kworker/u16:0 state:D stack:26848 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 861.518556][ T44] Workqueue: ipv6_addrconf addrconf_verify_work [ 861.518719][ T44] Call Trace: [ 861.518830][ T44] [ 861.518898][ T44] __schedule+0xae2/0x1720 [ 861.519023][ T44] ? io_schedule_timeout+0x130/0x130 [ 861.519153][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.519274][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.519409][ T44] schedule+0xd4/0x260 [ 861.519501][ T44] schedule_preempt_disabled+0x18/0x30 [ 861.519631][ T44] __mutex_lock+0xd76/0x1f20 [ 861.519755][ T44] ? addrconf_verify_work+0x12/0x30 [ 861.519885][ T44] ? ww_mutex_lock+0x160/0x160 [ 861.520009][ T44] ? process_one_work+0xd16/0x1390 [ 861.520132][ T44] ? rcu_is_watching+0x15/0xd0 [ 861.520249][ T44] ? rcu_is_watching+0x15/0xd0 [ 861.520378][ T44] ? addrconf_verify_work+0x12/0x30 [ 861.520492][ T44] addrconf_verify_work+0x12/0x30 [ 861.520617][ T44] process_one_work+0xd57/0x1390 [ 861.520739][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 861.520860][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.520977][ T44] ? assign_work+0x152/0x380 [ 861.521098][ T44] worker_thread+0x4d6/0xd40 [ 861.521221][ T44] ? process_one_work+0x1390/0x1390 [ 861.521343][ T44] kthread+0x355/0x5b0 [ 861.521429][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.521551][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.521664][ T44] ? rcu_is_watching+0x15/0xd0 [ 861.521787][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.521904][ T44] ret_from_fork+0x3fb/0x510 [ 861.522024][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 861.522168][ T44] ? __switch_to+0x53c/0xd00 [ 861.522291][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.522406][ T44] ret_from_fork_asm+0x11/0x20 [ 861.522534][ T44] [ 861.522637][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:5796. [ 861.522840][ T44] INFO: task ip:5796 blocked for more than 245 seconds. [ 861.522974][ T44] Not tainted 6.19.0-rc1-virtme #1 [ 861.523086][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 861.523269][ T44] task:ip state:D stack:24976 pid:5796 tgid:5796 ppid:5791 task_flags:0x400100 flags:0x00080000 [ 861.523525][ T44] Call Trace: [ 861.523621][ T44] [ 861.523682][ T44] __schedule+0xae2/0x1720 [ 861.523805][ T44] ? io_schedule_timeout+0x130/0x130 [ 861.523928][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.524040][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.524163][ T44] schedule+0xd4/0x260 [ 861.524248][ T44] schedule_preempt_disabled+0x18/0x30 [ 861.524371][ T44] __mutex_lock+0xd76/0x1f20 [ 861.524487][ T44] ? napi_enable+0x3b/0x80 [ 861.524612][ T44] ? ww_mutex_lock+0x160/0x160 [ 861.524726][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.524848][ T44] ? __asan_memset+0x27/0x50 [ 861.524962][ T44] ? sg_init_table+0x19/0x60 [ 861.525085][ T44] ? try_fill_recv+0x3ec/0x1750 [ 861.525200][ T44] ? napi_enable+0x3b/0x80 [ 861.525324][ T44] napi_enable+0x3b/0x80 [ 861.525411][ T44] __virtnet_rx_resume+0x156/0x290 [ 861.525532][ T44] ? queue_delayed_work_on+0x91/0x100 [ 861.525656][ T44] virtnet_rx_resume_all+0xe7/0x1a0 [ 861.525771][ T44] virtnet_xdp_set+0xef7/0x1aa0 [ 861.525895][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0 [ 861.526008][ T44] dev_xdp_install+0x3e4/0x890 [ 861.526130][ T44] ? netif_set_xps_queue+0x40/0x40 [ 861.526248][ T44] dev_xdp_attach+0x50d/0x1310 [ 861.526382][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0 [ 861.526500][ T44] ? __bpf_prog_get+0x320/0x320 [ 861.526624][ T44] dev_change_xdp_fd+0x176/0x210 [ 861.526739][ T44] do_setlink.isra.0+0x1c2d/0x2880 [ 861.526862][ T44] ? rtnl_newlink_create+0x900/0x900 [ 861.526975][ T44] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 861.527124][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 861.527238][ T44] ? validate_chain+0x37b/0xb70 [ 861.527362][ T44] ? rcu_read_lock_any_held+0x66/0x90 [ 861.527475][ T44] ? stack_depot_save_flags+0x3f1/0x6f0 [ 861.527598][ T44] ? __lock_acquire+0x577/0xc10 [ 861.527714][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.527837][ T44] ? rtnl_newlink+0x6fc/0xe90 [ 861.527948][ T44] ? lock_acquire+0x10a/0x150 [ 861.528070][ T44] ? rcu_is_watching+0x15/0xd0 [ 861.528182][ T44] ? rcu_is_watching+0x15/0xd0 [ 861.528305][ T44] ? trace_contention_end+0xd6/0x110 [ 861.528418][ T44] ? __mutex_lock+0x285/0x1f20 [ 861.528543][ T44] ? rtnl_newlink+0x6fc/0xe90 [ 861.528658][ T44] ? ww_mutex_lock+0x160/0x160 [ 861.528776][ T44] ? nla_get_range_signed+0x3d0/0x3d0 [ 861.528895][ T44] ? __rtnl_newlink+0x3fa/0xa40 [ 861.529018][ T44] rtnl_newlink+0x75c/0xe90 [ 861.529133][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.529254][ T44] ? rtnl_setlink+0x880/0x880 [ 861.529371][ T44] ? __lock_acquire+0x577/0xc10 [ 861.529492][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.529611][ T44] ? find_held_lock+0x2b/0x80 [ 861.529724][ T44] ? rtnl_setlink+0x880/0x880 [ 861.529847][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.529961][ T44] ? rtnl_setlink+0x880/0x880 [ 861.530082][ T44] rtnetlink_rcv_msg+0x6fe/0xb90 [ 861.530196][ T44] ? rtnl_fdb_dump+0x620/0x620 [ 861.530321][ T44] ? __lock_acquire+0x577/0xc10 [ 861.530438][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.530559][ T44] ? find_held_lock+0x2b/0x80 [ 861.530675][ T44] netlink_rcv_skb+0x123/0x380 [ 861.530798][ T44] ? rtnl_fdb_dump+0x620/0x620 [ 861.530912][ T44] ? netlink_ack+0xcc0/0xcc0 [ 861.531037][ T44] ? netlink_deliver_tap+0xc5/0x330 [ 861.531148][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 861.531273][ T44] netlink_unicast+0x4a3/0x770 [ 861.531391][ T44] ? netlink_attachskb+0x810/0x810 [ 861.531514][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.531639][ T44] ? __lock_acquire+0x577/0xc10 [ 861.531753][ T44] netlink_sendmsg+0x735/0xc60 [ 861.531876][ T44] ? netlink_unicast+0x770/0x770 [ 861.531994][ T44] ____sys_sendmsg+0x419/0x850 [ 861.532114][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 861.532228][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 861.532377][ T44] ? move_addr_to_kernel+0x40/0x40 [ 861.532495][ T44] ? stack_depot_save_flags+0x3f1/0x6f0 [ 861.532617][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 861.532732][ T44] ___sys_sendmsg+0xfd/0x180 [ 861.532852][ T44] ? __call_rcu_common.constprop.0+0xa6/0xa00 [ 861.532995][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 861.533132][ T44] __sys_sendmsg+0x124/0x1c0 [ 861.533247][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 861.533375][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 861.533488][ T44] ? __call_rcu_common.constprop.0+0x3bd/0xa00 [ 861.533641][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 861.533757][ T44] ? rcu_is_watching+0x15/0xd0 [ 861.533878][ T44] do_syscall_64+0xbd/0xfc0 [ 861.533993][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 861.534142][ T44] RIP: 0033:0x7ff26ada5c5e [ 861.534266][ T44] RSP: 002b:00007fff35285dd0 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 861.534455][ T44] RAX: ffffffffffffffda RBX: 0000000000000007 RCX: 00007ff26ada5c5e [ 861.534635][ T44] RDX: 0000000000000000 RSI: 00007fff35285e90 RDI: 0000000000000003 [ 861.534804][ T44] RBP: 00007fff35285de0 R08: 0000000000000000 R09: 0000000000000000 [ 861.534982][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fff35286550 [ 861.535153][ T44] R13: 0000000069538d1b R14: 0000000000000000 R15: 0000000000499600 [ 861.535342][ T44] [ 861.535430][ T44] INFO: task ip:5796 is blocked on a mutex likely owned by task kworker/3:0:33. [ 861.535625][ T44] task:kworker/3:0 state:D stack:28120 pid:33 tgid:33 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 861.535878][ T44] Workqueue: events refill_work [ 861.535990][ T44] Call Trace: [ 861.536086][ T44] [ 861.536144][ T44] __schedule+0xae2/0x1720 [ 861.536257][ T44] ? usleep_range_state+0xba/0x1b0 [ 861.536380][ T44] ? io_schedule_timeout+0x130/0x130 [ 861.536494][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.536618][ T44] ? usleep_range_state+0xba/0x1b0 [ 861.536730][ T44] schedule+0xd4/0x260 [ 861.536824][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0 [ 861.536964][ T44] ? schedule_timeout_idle+0xe0/0xe0 [ 861.537089][ T44] ? __hrtimer_cb_get_time+0x50/0x50 [ 861.537204][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 861.537327][ T44] ? ktime_get+0x15e/0x220 [ 861.537444][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 861.537565][ T44] ? ktime_get+0xa9/0x220 [ 861.537652][ T44] usleep_range_state+0x133/0x1b0 [ 861.537774][ T44] ? schedule_hrtimeout+0x20/0x20 [ 861.537890][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 861.538010][ T44] ? refill_work+0x149/0x210 [ 861.538126][ T44] napi_disable_locked+0x379/0x5f0 [ 861.538248][ T44] ? _mutex_trylock_nest_lock+0x340/0x340 [ 861.538367][ T44] ? register_netdevice_notifier_net+0x40/0x40 [ 861.538516][ T44] napi_disable+0x43/0x80 [ 861.538610][ T44] refill_work+0x116/0x210 [ 861.538726][ T44] process_one_work+0xd57/0x1390 [ 861.538851][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 861.538964][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.539088][ T44] ? assign_work+0x152/0x380 [ 861.539204][ T44] worker_thread+0x4d6/0xd40 [ 861.539333][ T44] ? process_one_work+0x1390/0x1390 [ 861.539447][ T44] kthread+0x355/0x5b0 [ 861.539546][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.539659][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.539778][ T44] ? rcu_is_watching+0x15/0xd0 [ 861.539892][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.540015][ T44] ret_from_fork+0x3fb/0x510 [ 861.540128][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 861.540279][ T44] ? __switch_to+0x53c/0xd00 [ 861.540396][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.540515][ T44] ret_from_fork_asm+0x11/0x20 [ 861.540648][ T44] [ 861.540737][ T44] [ 861.540737][ T44] Showing all locks held in the system: [ 861.540909][ T44] 3 locks held by kworker/u16:0/12: [ 861.541019][ T44] #0: ff1100000916f148 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 861.541251][ T44] #1: ffa00000000c7cc0 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 861.541644][ T44] #2: ffffffffb4085768 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 861.541851][ T44] 3 locks held by kworker/3:0/33: [ 861.541960][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 861.542187][ T44] #1: ffa0000000257cc0 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 861.542450][ T44] #2: ff11000008c42c98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 861.542658][ T44] 1 lock held by khungtaskd/44: [ 861.542768][ T44] #0: ffffffffb3971040 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 861.542999][ T44] 2 locks held by ip/5796: [ 861.543107][ T44] #0: ffffffffb4085768 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x6fc/0xe90 [ 861.543310][ T44] #1: ff11000008c42c98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80 [ 861.543515][ T44] [ 861.543579][ T44] ============================================= [ 861.543579][ T44] [ 867.084550][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 3 timed out 5567 ms [ 867.085037][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 5567000 usecs ago [ 872.268548][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 3 timed out 10751 ms [ 872.268902][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 10751000 usecs ago [ 877.388547][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 3 timed out 15871 ms [ 877.388889][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 15871000 usecs ago [ 883.532548][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 3 timed out 22015 ms [ 883.532904][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 22015000 usecs ago [ 889.164547][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 3 timed out 27647 ms [ 889.164922][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 27647000 usecs ago [ 894.284549][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 3 timed out 32767 ms [ 894.284903][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 32767000 usecs ago [ 899.404548][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 3 timed out 37887 ms [ 899.404895][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 37887000 usecs ago [ 905.548548][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 3 timed out 44031 ms [ 905.548896][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 44031000 usecs ago [ 911.180547][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 3 timed out 49663 ms [ 911.180917][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 49663000 usecs ago [ 916.300547][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 3 timed out 54783 ms [ 916.300919][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 54783000 usecs ago [ 921.420547][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 3 timed out 59903 ms [ 921.420894][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 59903000 usecs ago [ 927.564548][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 3 timed out 66047 ms [ 927.564903][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 66047000 usecs ago [ 933.196548][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 3 timed out 71679 ms [ 933.196906][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 71679000 usecs ago [ 938.316547][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 3 timed out 76799 ms [ 938.316920][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 76799000 usecs ago [ 943.436549][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 3 timed out 81919 ms [ 943.436901][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 81919000 usecs ago [ 949.580548][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 3 timed out 88063 ms [ 949.580904][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 88063000 usecs ago [ 955.212548][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 3 timed out 93695 ms [ 955.212924][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 93695000 usecs ago