[ 738.622560][ T44] INFO: task kworker/u16:0:12 blocked for more than 122 seconds. [ 738.623117][ T44] Not tainted 6.18.0-rc6-virtme #1 [ 738.623352][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 738.623688][ T44] task:kworker/u16:0 state:D stack:26320 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 738.624089][ T44] Workqueue: ipv6_addrconf addrconf_verify_work [ 738.624332][ T44] Call Trace: [ 738.624492][ T44] [ 738.624624][ T44] __schedule+0x88d/0x1b90 [ 738.624823][ T44] ? io_schedule_timeout+0x130/0x130 [ 738.625016][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 738.625212][ T44] ? __lock_release.isra.0+0x59/0x170 [ 738.625410][ T44] ? __lock_release.isra.0+0x59/0x170 [ 738.625592][ T44] schedule+0xd4/0x260 [ 738.625736][ T44] schedule_preempt_disabled+0x18/0x30 [ 738.625906][ T44] __mutex_lock+0x9ae/0x1500 [ 738.626078][ T44] ? addrconf_verify_work+0x12/0x30 [ 738.626249][ T44] ? ww_mutex_lock+0x160/0x160 [ 738.626419][ T44] ? process_one_work+0xd16/0x1390 [ 738.626607][ T44] ? trace_lock_acquire+0x88/0xd0 [ 738.626772][ T44] ? trace_lock_acquire+0x88/0xd0 [ 738.626941][ T44] ? addrconf_verify_work+0x12/0x30 [ 738.627113][ T44] addrconf_verify_work+0x12/0x30 [ 738.627280][ T44] process_one_work+0xd57/0x1390 [ 738.627449][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 738.627628][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 738.627798][ T44] ? assign_work+0x152/0x380 [ 738.627965][ T44] worker_thread+0x4d6/0xd40 [ 738.628142][ T44] ? process_one_work+0x1390/0x1390 [ 738.628311][ T44] kthread+0x355/0x5b0 [ 738.628450][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 738.628966][ T44] ? __lock_release.isra.0+0x59/0x170 [ 738.629139][ T44] ? rcu_is_watching+0x15/0xd0 [ 738.629316][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 738.629483][ T44] ret_from_fork+0x1d4/0x270 [ 738.629667][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 738.629834][ T44] ret_from_fork_asm+0x11/0x20 [ 738.630014][ T44] [ 738.630189][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:5448. [ 738.630450][ T44] INFO: task ip:5448 blocked for more than 122 seconds. [ 738.630649][ T44] Not tainted 6.18.0-rc6-virtme #1 [ 738.630811][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 738.631057][ T44] task:ip state:D stack:25592 pid:5448 tgid:5448 ppid:1 task_flags:0x400100 flags:0x00080003 [ 738.631367][ T44] Call Trace: [ 738.631499][ T44] [ 738.631619][ T44] __schedule+0x88d/0x1b90 [ 738.631788][ T44] ? io_schedule_timeout+0x130/0x130 [ 738.631956][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 738.632129][ T44] ? __lock_release.isra.0+0x59/0x170 [ 738.632298][ T44] ? __lock_release.isra.0+0x59/0x170 [ 738.632463][ T44] schedule+0xd4/0x260 [ 738.632615][ T44] schedule_preempt_disabled+0x18/0x30 [ 738.632779][ T44] __mutex_lock+0x9ae/0x1500 [ 738.632948][ T44] ? napi_enable+0x3b/0x80 [ 738.633122][ T44] ? virtqueue_add_inbuf_ctx+0x1850/0x1850 [ 738.633317][ T44] ? ww_mutex_lock+0x160/0x160 [ 738.633487][ T44] ? __asan_memset+0x27/0x50 [ 738.633669][ T44] ? sg_init_table+0x19/0x60 [ 738.633837][ T44] ? try_fill_recv+0x3ec/0x1750 [ 738.634005][ T44] ? napi_enable+0x3b/0x80 [ 738.634175][ T44] napi_enable+0x3b/0x80 [ 738.634314][ T44] __virtnet_rx_resume+0x156/0x290 [ 738.634476][ T44] ? queue_delayed_work_on+0x91/0x100 [ 738.634657][ T44] virtnet_rx_resume_all+0xe7/0x1a0 [ 738.634828][ T44] virtnet_xdp_set+0xef7/0x1aa0 [ 738.634998][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0 [ 738.635165][ T44] dev_xdp_install+0x4ba/0x8e0 [ 738.635335][ T44] ? netif_skb_check_for_xdp+0x600/0x600 [ 738.635503][ T44] dev_xdp_attach+0x50d/0x1330 [ 738.635681][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0 [ 738.635848][ T44] ? mutex_is_locked+0x1c/0x50 [ 738.636021][ T44] ? rtnl_is_locked+0x15/0x20 [ 738.636190][ T44] ? dev_change_xdp_fd+0x9f/0x240 [ 738.636356][ T44] do_setlink.isra.0+0x1c2d/0x2880 [ 738.636524][ T44] ? rtnl_newlink_create+0x900/0x900 [ 738.636703][ T44] ? rcu_lockdep_current_cpu_online+0x3e/0x1b0 [ 738.636898][ T44] ? rcu_read_lock_any_held+0x41/0xa0 [ 738.637069][ T44] ? validate_chain+0x287/0x5f0 [ 738.637242][ T44] ? rcu_read_lock_any_held+0x6b/0xa0 [ 738.637406][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 738.637586][ T44] ? __lock_acquire+0x34c/0x740 [ 738.637756][ T44] ? trace_lock_acquire+0x88/0xd0 [ 738.637917][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 738.638088][ T44] ? lock_acquire+0x31/0x80 [ 738.638251][ T44] ? rtnl_newlink+0x5df/0xb20 [ 738.638419][ T44] ? rcu_is_watching+0x15/0xd0 [ 738.638597][ T44] ? rcu_is_watching+0x15/0xd0 [ 738.638761][ T44] ? trace_contention_end+0xd6/0x140 [ 738.638925][ T44] ? rtnl_newlink+0x5df/0xb20 [ 738.639096][ T44] ? __mutex_lock+0x32e/0x1500 [ 738.639264][ T44] ? ww_mutex_lock+0x160/0x160 [ 738.639427][ T44] ? nla_validate_int_range+0x5b0/0x5b0 [ 738.639608][ T44] ? __rtnl_newlink+0x3fa/0xa40 [ 738.639782][ T44] rtnl_newlink+0x637/0xb20 [ 738.639950][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 738.640123][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 738.640288][ T44] ? find_held_lock+0x2b/0x80 [ 738.640453][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 738.640633][ T44] ? __lock_release.isra.0+0x59/0x170 [ 738.640798][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 738.640961][ T44] rtnetlink_rcv_msg+0x6fe/0xb90 [ 738.641136][ T44] ? rtnl_port_fill+0x940/0x940 [ 738.641305][ T44] ? __lock_acquire+0x34c/0x740 [ 738.641472][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 738.641647][ T44] ? find_held_lock+0x2b/0x80 [ 738.641816][ T44] netlink_rcv_skb+0x123/0x380 [ 738.641981][ T44] ? rtnl_port_fill+0x940/0x940 [ 738.642156][ T44] ? netlink_ack+0xcc0/0xcc0 [ 738.642325][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 738.642497][ T44] netlink_unicast+0x4a3/0x770 [ 738.642678][ T44] ? netlink_attachskb+0x810/0x810 [ 738.642844][ T44] ? __lock_acquire+0x34c/0x740 [ 738.643015][ T44] netlink_sendmsg+0x735/0xc60 [ 738.643192][ T44] ? netlink_unicast+0x770/0x770 [ 738.643360][ T44] ? __might_fault+0x97/0x140 [ 738.643527][ T44] ____sys_sendmsg+0x419/0x850 [ 738.643712][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 738.643877][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 738.644074][ T44] ? move_addr_to_kernel+0x40/0x40 [ 738.644238][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 738.644400][ T44] ? validate_chain+0x287/0x5f0 [ 738.644580][ T44] ___sys_sendmsg+0xfd/0x180 [ 738.644744][ T44] ? __call_rcu_common.constprop.0+0xa5/0x680 [ 738.644939][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 738.645120][ T44] __sys_sendmsg+0x124/0x1c0 [ 738.645290][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 738.645452][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 738.645630][ T44] ? __call_rcu_common.constprop.0+0x2fa/0x680 [ 738.645827][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 738.645993][ T44] ? rcu_is_watching+0x15/0xd0 [ 738.646171][ T44] do_syscall_64+0xbb/0xfd0 [ 738.646338][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 738.646529][ T44] RIP: 0033:0x7f8e982a3c5e [ 738.646718][ T44] RSP: 002b:00007ffd0931a9e0 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 738.646944][ T44] RAX: ffffffffffffffda RBX: 0000000000000004 RCX: 00007f8e982a3c5e [ 738.647171][ T44] RDX: 0000000000000000 RSI: 00007ffd0931aaa0 RDI: 0000000000000003 [ 738.647396][ T44] RBP: 00007ffd0931a9f0 R08: 0000000000000000 R09: 0000000000000000 [ 738.647632][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffd0931b160 [ 738.647855][ T44] R13: 00000000692729cf R14: 0000000000000000 R15: 0000000000499600 [ 738.648085][ T44] [ 738.648223][ T44] INFO: task ip:5448 is blocked on a mutex likely owned by task kworker/1:0:23. [ 738.648467][ T44] task:kworker/1:0 state:D stack:28200 pid:23 tgid:23 ppid:2 task_flags:0x4208160 flags:0x00080000 [ 738.648783][ T44] Workqueue: events refill_work [ 738.648949][ T44] Call Trace: [ 738.649092][ T44] [ 738.649200][ T44] __schedule+0x88d/0x1b90 [ 738.649372][ T44] ? io_schedule_timeout+0x130/0x130 [ 738.649557][ T44] ? usleep_range_state+0xba/0x1b0 [ 738.649722][ T44] ? find_held_lock+0x2b/0x80 [ 738.649892][ T44] ? __lock_release.isra.0+0x59/0x170 [ 738.650075][ T44] ? usleep_range_state+0xba/0x1b0 [ 738.650241][ T44] schedule+0xd4/0x260 [ 738.650380][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0 [ 738.650587][ T44] ? schedule_timeout_idle+0xe0/0xe0 [ 738.650757][ T44] ? hrtimer_cb_get_time+0x90/0x90 [ 738.650925][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 738.651094][ T44] ? ktime_get+0x15e/0x220 [ 738.651259][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 738.651423][ T44] ? ktime_get+0xa9/0x220 [ 738.651576][ T44] usleep_range_state+0x133/0x1b0 [ 738.651741][ T44] ? schedule_hrtimeout+0x20/0x20 [ 738.651908][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 738.652077][ T44] napi_disable_locked+0x379/0x5f0 [ 738.652240][ T44] ? _mutex_trylock_nest_lock+0x150/0x150 [ 738.652406][ T44] ? netdev_bind_sb_channel_queue+0x470/0x470 [ 738.652614][ T44] napi_disable+0x43/0x80 [ 738.652750][ T44] refill_work+0x116/0x210 [ 738.652916][ T44] process_one_work+0xd57/0x1390 [ 738.653094][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 738.653257][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 738.653424][ T44] ? assign_work+0x152/0x380 [ 738.653607][ T44] worker_thread+0x4d6/0xd40 [ 738.653778][ T44] ? process_one_work+0x1390/0x1390 [ 738.653940][ T44] kthread+0x355/0x5b0 [ 738.654080][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 738.654248][ T44] ? __lock_release.isra.0+0x59/0x170 [ 738.654414][ T44] ? rcu_is_watching+0x15/0xd0 [ 738.654590][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 738.654756][ T44] ret_from_fork+0x1d4/0x270 [ 738.654918][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 738.655089][ T44] ret_from_fork_asm+0x11/0x20 [ 738.655257][ T44] [ 738.655401][ T44] [ 738.655401][ T44] Showing all locks held in the system: [ 738.655640][ T44] 3 locks held by kworker/u16:0/12: [ 738.655801][ T44] #0: ff1100000913cd48 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 738.656084][ T44] #1: ffa00000000c7d30 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 738.656408][ T44] #2: ffffffff98a92a28 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 738.656672][ T44] 3 locks held by kworker/1:0/23: [ 738.656831][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 738.657111][ T44] #1: ffa00000001a7d30 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 738.657411][ T44] #2: ff11000008a5aca0 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 738.657673][ T44] 3 locks held by kworker/2:0/28: [ 738.657830][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 738.658104][ T44] #1: ffa00000001ffd30 ((work_completion)(&pool->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 738.658373][ T44] #2: ffffffff98a92a28 (rtnl_mutex){+.+.}-{4:4}, at: xp_release_deferred+0x1b/0x1e0 [ 738.658639][ T44] 1 lock held by khungtaskd/44: [ 738.658795][ T44] #0: ffffffff98378fc0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x2b/0x1db [ 738.659054][ T44] 2 locks held by ip/5448: [ 738.659211][ T44] #0: ffffffff98a92a28 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x5df/0xb20 [ 738.659454][ T44] #1: ff11000008a5aca0 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80 [ 738.659719][ T44] 1 lock held by ip/5512: [ 738.659850][ T44] #0: ffffffff98a92a28 (rtnl_mutex){+.+.}-{4:4}, at: rtnetlink_rcv_msg+0x2ab/0xb90 [ 738.660100][ T44] [ 738.660206][ T44] ============================================= [ 738.660206][ T44] [ 861.502574][ T44] INFO: task kworker/u16:0:12 blocked for more than 245 seconds. [ 861.503020][ T44] Not tainted 6.18.0-rc6-virtme #1 [ 861.503233][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 861.503583][ T44] task:kworker/u16:0 state:D stack:26320 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 861.503954][ T44] Workqueue: ipv6_addrconf addrconf_verify_work [ 861.504193][ T44] Call Trace: [ 861.504354][ T44] [ 861.504480][ T44] __schedule+0x88d/0x1b90 [ 861.504697][ T44] ? io_schedule_timeout+0x130/0x130 [ 861.504887][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.505070][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.505252][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.505438][ T44] schedule+0xd4/0x260 [ 861.505609][ T44] schedule_preempt_disabled+0x18/0x30 [ 861.505774][ T44] __mutex_lock+0x9ae/0x1500 [ 861.505945][ T44] ? addrconf_verify_work+0x12/0x30 [ 861.506115][ T44] ? ww_mutex_lock+0x160/0x160 [ 861.506292][ T44] ? process_one_work+0xd16/0x1390 [ 861.506460][ T44] ? trace_lock_acquire+0x88/0xd0 [ 861.506640][ T44] ? trace_lock_acquire+0x88/0xd0 [ 861.506807][ T44] ? addrconf_verify_work+0x12/0x30 [ 861.506975][ T44] addrconf_verify_work+0x12/0x30 [ 861.507142][ T44] process_one_work+0xd57/0x1390 [ 861.507315][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 861.507480][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.507663][ T44] ? assign_work+0x152/0x380 [ 861.507830][ T44] worker_thread+0x4d6/0xd40 [ 861.507999][ T44] ? process_one_work+0x1390/0x1390 [ 861.508169][ T44] kthread+0x355/0x5b0 [ 861.508318][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.508485][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.508665][ T44] ? rcu_is_watching+0x15/0xd0 [ 861.508830][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.508995][ T44] ret_from_fork+0x1d4/0x270 [ 861.509160][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.509332][ T44] ret_from_fork_asm+0x11/0x20 [ 861.509512][ T44] [ 861.509690][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:5448. [ 861.509936][ T44] INFO: task kworker/2:0:28 blocked for more than 122 seconds. [ 861.510145][ T44] Not tainted 6.18.0-rc6-virtme #1 [ 861.510303][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 861.510560][ T44] task:kworker/2:0 state:D stack:27176 pid:28 tgid:28 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 861.510863][ T44] Workqueue: events xp_release_deferred [ 861.511030][ T44] Call Trace: [ 861.511163][ T44] [ 861.511277][ T44] __schedule+0x88d/0x1b90 [ 861.511445][ T44] ? io_schedule_timeout+0x130/0x130 [ 861.511628][ T44] ? find_held_lock+0x2b/0x80 [ 861.511800][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.511967][ T44] schedule+0xd4/0x260 [ 861.512104][ T44] schedule_preempt_disabled+0x18/0x30 [ 861.512274][ T44] __mutex_lock+0x9ae/0x1500 [ 861.512438][ T44] ? xp_release_deferred+0x1b/0x1e0 [ 861.512617][ T44] ? ww_mutex_lock+0x160/0x160 [ 861.512781][ T44] ? __lock_acquire+0x34c/0x740 [ 861.512953][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.513117][ T44] ? process_one_work+0xd16/0x1390 [ 861.513290][ T44] ? xp_release_deferred+0x1b/0x1e0 [ 861.513452][ T44] xp_release_deferred+0x1b/0x1e0 [ 861.513632][ T44] process_one_work+0xd57/0x1390 [ 861.513806][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 861.513970][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.514143][ T44] ? assign_work+0x152/0x380 [ 861.514314][ T44] worker_thread+0x4d6/0xd40 [ 861.514484][ T44] ? process_one_work+0x1390/0x1390 [ 861.514664][ T44] kthread+0x355/0x5b0 [ 861.514801][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.514966][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.515132][ T44] ? rcu_is_watching+0x15/0xd0 [ 861.515304][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.515473][ T44] ret_from_fork+0x1d4/0x270 [ 861.515646][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.515810][ T44] ret_from_fork_asm+0x11/0x20 [ 861.515980][ T44] [ 861.516118][ T44] INFO: task kworker/2:0:28 is blocked on a mutex likely owned by task ip:5448. [ 861.516376][ T44] INFO: task ip:5448 blocked for more than 245 seconds. [ 861.516574][ T44] Not tainted 6.18.0-rc6-virtme #1 [ 861.516737][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 861.516975][ T44] task:ip state:D stack:25592 pid:5448 tgid:5448 ppid:1 task_flags:0x400100 flags:0x00080003 [ 861.517286][ T44] Call Trace: [ 861.517419][ T44] [ 861.517527][ T44] __schedule+0x88d/0x1b90 [ 861.517708][ T44] ? io_schedule_timeout+0x130/0x130 [ 861.517877][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.518043][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.518248][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.518417][ T44] schedule+0xd4/0x260 [ 861.518571][ T44] schedule_preempt_disabled+0x18/0x30 [ 861.518732][ T44] __mutex_lock+0x9ae/0x1500 [ 861.518902][ T44] ? napi_enable+0x3b/0x80 [ 861.519070][ T44] ? virtqueue_add_inbuf_ctx+0x1850/0x1850 [ 861.519272][ T44] ? ww_mutex_lock+0x160/0x160 [ 861.519436][ T44] ? __asan_memset+0x27/0x50 [ 861.519618][ T44] ? sg_init_table+0x19/0x60 [ 861.519786][ T44] ? try_fill_recv+0x3ec/0x1750 [ 861.519958][ T44] ? napi_enable+0x3b/0x80 [ 861.520125][ T44] napi_enable+0x3b/0x80 [ 861.520276][ T44] __virtnet_rx_resume+0x156/0x290 [ 861.520439][ T44] ? queue_delayed_work_on+0x91/0x100 [ 861.520615][ T44] virtnet_rx_resume_all+0xe7/0x1a0 [ 861.520782][ T44] virtnet_xdp_set+0xef7/0x1aa0 [ 861.520952][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0 [ 861.521115][ T44] dev_xdp_install+0x4ba/0x8e0 [ 861.521289][ T44] ? netif_skb_check_for_xdp+0x600/0x600 [ 861.521464][ T44] dev_xdp_attach+0x50d/0x1330 [ 861.521646][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0 [ 861.521812][ T44] ? mutex_is_locked+0x1c/0x50 [ 861.521978][ T44] ? rtnl_is_locked+0x15/0x20 [ 861.522143][ T44] ? dev_change_xdp_fd+0x9f/0x240 [ 861.522312][ T44] do_setlink.isra.0+0x1c2d/0x2880 [ 861.522480][ T44] ? rtnl_newlink_create+0x900/0x900 [ 861.522664][ T44] ? rcu_lockdep_current_cpu_online+0x3e/0x1b0 [ 861.522857][ T44] ? rcu_read_lock_any_held+0x41/0xa0 [ 861.523021][ T44] ? validate_chain+0x287/0x5f0 [ 861.523192][ T44] ? rcu_read_lock_any_held+0x6b/0xa0 [ 861.523356][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 861.523523][ T44] ? __lock_acquire+0x34c/0x740 [ 861.523704][ T44] ? trace_lock_acquire+0x88/0xd0 [ 861.523872][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 861.524038][ T44] ? lock_acquire+0x31/0x80 [ 861.524205][ T44] ? rtnl_newlink+0x5df/0xb20 [ 861.524369][ T44] ? rcu_is_watching+0x15/0xd0 [ 861.524547][ T44] ? rcu_is_watching+0x15/0xd0 [ 861.524715][ T44] ? trace_contention_end+0xd6/0x140 [ 861.524879][ T44] ? rtnl_newlink+0x5df/0xb20 [ 861.525042][ T44] ? __mutex_lock+0x32e/0x1500 [ 861.525221][ T44] ? ww_mutex_lock+0x160/0x160 [ 861.525386][ T44] ? nla_validate_int_range+0x5b0/0x5b0 [ 861.525568][ T44] ? __rtnl_newlink+0x3fa/0xa40 [ 861.525735][ T44] rtnl_newlink+0x637/0xb20 [ 861.525905][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 861.526072][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.526247][ T44] ? find_held_lock+0x2b/0x80 [ 861.526413][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 861.526597][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.526763][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 861.526927][ T44] rtnetlink_rcv_msg+0x6fe/0xb90 [ 861.527092][ T44] ? rtnl_port_fill+0x940/0x940 [ 861.527262][ T44] ? __lock_acquire+0x34c/0x740 [ 861.527430][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.527607][ T44] ? find_held_lock+0x2b/0x80 [ 861.527778][ T44] netlink_rcv_skb+0x123/0x380 [ 861.527944][ T44] ? rtnl_port_fill+0x940/0x940 [ 861.528110][ T44] ? netlink_ack+0xcc0/0xcc0 [ 861.528283][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 861.528450][ T44] netlink_unicast+0x4a3/0x770 [ 861.528632][ T44] ? netlink_attachskb+0x810/0x810 [ 861.528798][ T44] ? __lock_acquire+0x34c/0x740 [ 861.528965][ T44] netlink_sendmsg+0x735/0xc60 [ 861.529137][ T44] ? netlink_unicast+0x770/0x770 [ 861.529309][ T44] ? __might_fault+0x97/0x140 [ 861.529476][ T44] ____sys_sendmsg+0x419/0x850 [ 861.529658][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 861.529823][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 861.530015][ T44] ? move_addr_to_kernel+0x40/0x40 [ 861.530186][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 861.530355][ T44] ? validate_chain+0x287/0x5f0 [ 861.530521][ T44] ___sys_sendmsg+0xfd/0x180 [ 861.530701][ T44] ? __call_rcu_common.constprop.0+0xa5/0x680 [ 861.530894][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 861.531071][ T44] __sys_sendmsg+0x124/0x1c0 [ 861.531243][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 861.531405][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 861.531584][ T44] ? __call_rcu_common.constprop.0+0x2fa/0x680 [ 861.531782][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 861.531947][ T44] ? rcu_is_watching+0x15/0xd0 [ 861.532115][ T44] do_syscall_64+0xbb/0xfd0 [ 861.532288][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 861.532478][ T44] RIP: 0033:0x7f8e982a3c5e [ 861.532666][ T44] RSP: 002b:00007ffd0931a9e0 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 861.532896][ T44] RAX: ffffffffffffffda RBX: 0000000000000004 RCX: 00007f8e982a3c5e [ 861.533117][ T44] RDX: 0000000000000000 RSI: 00007ffd0931aaa0 RDI: 0000000000000003 [ 861.533342][ T44] RBP: 00007ffd0931a9f0 R08: 0000000000000000 R09: 0000000000000000 [ 861.533576][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffd0931b160 [ 861.533801][ T44] R13: 00000000692729cf R14: 0000000000000000 R15: 0000000000499600 [ 861.534031][ T44] [ 861.534168][ T44] INFO: task ip:5448 is blocked on a mutex likely owned by task kworker/1:0:23. [ 861.534416][ T44] task:kworker/1:0 state:D stack:28200 pid:23 tgid:23 ppid:2 task_flags:0x4208160 flags:0x00080000 [ 861.534737][ T44] Workqueue: events refill_work [ 861.534907][ T44] Call Trace: [ 861.535041][ T44] [ 861.535149][ T44] __schedule+0x88d/0x1b90 [ 861.535323][ T44] ? io_schedule_timeout+0x130/0x130 [ 861.535489][ T44] ? usleep_range_state+0xba/0x1b0 [ 861.535668][ T44] ? find_held_lock+0x2b/0x80 [ 861.535834][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.536001][ T44] ? usleep_range_state+0xba/0x1b0 [ 861.536236][ T44] schedule+0xd4/0x260 [ 861.536377][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0 [ 861.536586][ T44] ? schedule_timeout_idle+0xe0/0xe0 [ 861.536755][ T44] ? hrtimer_cb_get_time+0x90/0x90 [ 861.536922][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 861.537085][ T44] ? ktime_get+0x15e/0x220 [ 861.537254][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 861.537420][ T44] ? ktime_get+0xa9/0x220 [ 861.537572][ T44] usleep_range_state+0x133/0x1b0 [ 861.537737][ T44] ? schedule_hrtimeout+0x20/0x20 [ 861.537901][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 861.538068][ T44] napi_disable_locked+0x379/0x5f0 [ 861.538239][ T44] ? _mutex_trylock_nest_lock+0x150/0x150 [ 861.538404][ T44] ? netdev_bind_sb_channel_queue+0x470/0x470 [ 861.538618][ T44] napi_disable+0x43/0x80 [ 861.538756][ T44] refill_work+0x116/0x210 [ 861.538922][ T44] process_one_work+0xd57/0x1390 [ 861.539089][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 861.539259][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.539426][ T44] ? assign_work+0x152/0x380 [ 861.539606][ T44] worker_thread+0x4d6/0xd40 [ 861.539782][ T44] ? process_one_work+0x1390/0x1390 [ 861.539946][ T44] kthread+0x355/0x5b0 [ 861.540084][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.540252][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.540417][ T44] ? rcu_is_watching+0x15/0xd0 [ 861.540597][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.540831][ T44] ret_from_fork+0x1d4/0x270 [ 861.540994][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.541163][ T44] ret_from_fork_asm+0x11/0x20 [ 861.541340][ T44] [ 861.541551][ T44] INFO: task ip:5512 blocked for more than 122 seconds. [ 861.541732][ T44] Not tainted 6.18.0-rc6-virtme #1 [ 861.541887][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 861.542180][ T44] task:ip state:D stack:25744 pid:5512 tgid:5512 ppid:5511 task_flags:0x400100 flags:0x00080001 [ 861.542485][ T44] Call Trace: [ 861.542631][ T44] [ 861.542739][ T44] __schedule+0x88d/0x1b90 [ 861.542906][ T44] ? io_schedule_timeout+0x130/0x130 [ 861.543074][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.543245][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.543408][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.543646][ T44] schedule+0xd4/0x260 [ 861.543783][ T44] schedule_preempt_disabled+0x18/0x30 [ 861.543945][ T44] __mutex_lock+0x9ae/0x1500 [ 861.544112][ T44] ? rtnetlink_rcv_msg+0x2ab/0xb90 [ 861.544281][ T44] ? write_profile+0xf0/0xf0 [ 861.544448][ T44] ? ww_mutex_lock+0x160/0x160 [ 861.544631][ T44] ? find_held_lock+0x2b/0x80 [ 861.544800][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.545023][ T44] ? rtnetlink_rcv_msg+0x2ab/0xb90 [ 861.545194][ T44] rtnetlink_rcv_msg+0x2ab/0xb90 [ 861.545361][ T44] ? rtnl_port_fill+0x940/0x940 [ 861.545523][ T44] ? __lock_acquire+0x34c/0x740 [ 861.545759][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.545922][ T44] ? find_held_lock+0x2b/0x80 [ 861.546092][ T44] netlink_rcv_skb+0x123/0x380 [ 861.546264][ T44] ? rtnl_port_fill+0x940/0x940 [ 861.546485][ T44] ? netlink_ack+0xcc0/0xcc0 [ 861.546667][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 861.546832][ T44] netlink_unicast+0x4a3/0x770 [ 861.546997][ T44] ? netlink_attachskb+0x810/0x810 [ 861.547219][ T44] ? __lock_acquire+0x34c/0x740 [ 861.547384][ T44] netlink_sendmsg+0x735/0xc60 [ 861.547568][ T44] ? netlink_unicast+0x770/0x770 [ 861.547732][ T44] ? __might_fault+0x97/0x140 [ 861.547957][ T44] ____sys_sendmsg+0x419/0x850 [ 861.548121][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 861.548293][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 861.548482][ T44] ? move_addr_to_kernel+0x40/0x40 [ 861.548719][ T44] ? rcu_lockdep_current_cpu_online+0x3e/0x1b0 [ 861.548918][ T44] ___sys_sendmsg+0xfd/0x180 [ 861.549083][ T44] ? validate_chain+0x287/0x5f0 [ 861.549304][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 861.549474][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.549651][ T44] ? __might_fault+0x97/0x140 [ 861.549824][ T44] ? _copy_to_user+0x4b/0x70 [ 861.549991][ T44] __sys_sendmsg+0x124/0x1c0 [ 861.550158][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 861.550338][ T44] ? rcu_is_watching+0x15/0xd0 [ 861.550503][ T44] do_syscall_64+0xbb/0xfd0 [ 861.550739][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 861.550929][ T44] RIP: 0033:0x7fd3c982bc5e [ 861.551096][ T44] RSP: 002b:00007ffc316bd530 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 861.551334][ T44] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fd3c982bc5e [ 861.551573][ T44] RDX: 0000000000000000 RSI: 00007ffc316bd5f0 RDI: 0000000000000004 [ 861.551790][ T44] RBP: 00007ffc316bd540 R08: 0000000000000000 R09: 0000000000000000 [ 861.552069][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffc316be6bf [ 861.552294][ T44] R13: 0000000069272a9e R14: 000000000000000d R15: 00007ffc316bd6a0 [ 861.552524][ T44] [ 861.552736][ T44] INFO: task ip:5512 is blocked on a mutex likely owned by task ip:5448. [ 861.552947][ T44] [ 861.552947][ T44] Showing all locks held in the system: [ 861.553157][ T44] 3 locks held by kworker/u16:0/12: [ 861.553376][ T44] #0: ff1100000913cd48 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 861.553667][ T44] #1: ffa00000000c7d30 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 861.554045][ T44] #2: ffffffff98a92a28 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 861.554297][ T44] 3 locks held by kworker/1:0/23: [ 861.554455][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 861.554747][ T44] #1: ffa00000001a7d30 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 861.555042][ T44] #2: ff11000008a5aca0 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 861.555348][ T44] 3 locks held by kworker/2:0/28: [ 861.555504][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 861.555850][ T44] #1: ffa00000001ffd30 ((work_completion)(&pool->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 861.556122][ T44] #2: ffffffff98a92a28 (rtnl_mutex){+.+.}-{4:4}, at: xp_release_deferred+0x1b/0x1e0 [ 861.556425][ T44] 1 lock held by khungtaskd/44: [ 861.556597][ T44] #0: ffffffff98378fc0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x2b/0x1db [ 861.556853][ T44] 2 locks held by ip/5448: [ 861.557011][ T44] #0: ffffffff98a92a28 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x5df/0xb20 [ 861.557317][ T44] #1: ff11000008a5aca0 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80 [ 861.557578][ T44] 1 lock held by ip/5512: [ 861.557759][ T44] #0: ffffffff98a92a28 (rtnl_mutex){+.+.}-{4:4}, at: rtnetlink_rcv_msg+0x2ab/0xb90 [ 861.558007][ T44] [ 861.558110][ T44] ============================================= [ 861.558110][ T44] [ 984.381570][ T44] INFO: task kworker/u16:0:12 blocked for more than 368 seconds. [ 984.382001][ T44] Not tainted 6.18.0-rc6-virtme #1 [ 984.382211][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 984.382570][ T44] task:kworker/u16:0 state:D stack:26320 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 984.382979][ T44] Workqueue: ipv6_addrconf addrconf_verify_work [ 984.383196][ T44] Call Trace: [ 984.383344][ T44] [ 984.383461][ T44] __schedule+0x88d/0x1b90 [ 984.383665][ T44] ? io_schedule_timeout+0x130/0x130 [ 984.383845][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.384025][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.384203][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.384376][ T44] schedule+0xd4/0x260 [ 984.384520][ T44] schedule_preempt_disabled+0x18/0x30 [ 984.384706][ T44] __mutex_lock+0x9ae/0x1500 [ 984.384878][ T44] ? addrconf_verify_work+0x12/0x30 [ 984.385049][ T44] ? ww_mutex_lock+0x160/0x160 [ 984.385233][ T44] ? process_one_work+0xd16/0x1390 [ 984.385404][ T44] ? trace_lock_acquire+0x88/0xd0 [ 984.385584][ T44] ? trace_lock_acquire+0x88/0xd0 [ 984.385754][ T44] ? addrconf_verify_work+0x12/0x30 [ 984.385920][ T44] addrconf_verify_work+0x12/0x30 [ 984.386094][ T44] process_one_work+0xd57/0x1390 [ 984.386266][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 984.386439][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.386621][ T44] ? assign_work+0x152/0x380 [ 984.386789][ T44] worker_thread+0x4d6/0xd40 [ 984.386959][ T44] ? process_one_work+0x1390/0x1390 [ 984.387130][ T44] kthread+0x355/0x5b0 [ 984.387271][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 984.387440][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.387618][ T44] ? rcu_is_watching+0x15/0xd0 [ 984.387790][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 984.387959][ T44] ret_from_fork+0x1d4/0x270 [ 984.388130][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 984.388296][ T44] ret_from_fork_asm+0x11/0x20 [ 984.388467][ T44] [ 984.388644][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:5448. [ 984.388892][ T44] INFO: task kworker/2:0:28 blocked for more than 245 seconds. [ 984.389115][ T44] Not tainted 6.18.0-rc6-virtme #1 [ 984.389274][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 984.389514][ T44] task:kworker/2:0 state:D stack:27176 pid:28 tgid:28 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 984.389835][ T44] Workqueue: events xp_release_deferred [ 984.390002][ T44] Call Trace: [ 984.390150][ T44] [ 984.390260][ T44] __schedule+0x88d/0x1b90 [ 984.390432][ T44] ? io_schedule_timeout+0x130/0x130 [ 984.390615][ T44] ? find_held_lock+0x2b/0x80 [ 984.390786][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.390955][ T44] schedule+0xd4/0x260 [ 984.391100][ T44] schedule_preempt_disabled+0x18/0x30 [ 984.391267][ T44] __mutex_lock+0x9ae/0x1500 [ 984.391438][ T44] ? xp_release_deferred+0x1b/0x1e0 [ 984.391618][ T44] ? ww_mutex_lock+0x160/0x160 [ 984.391786][ T44] ? __lock_acquire+0x34c/0x740 [ 984.391954][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.392127][ T44] ? process_one_work+0xd16/0x1390 [ 984.392297][ T44] ? xp_release_deferred+0x1b/0x1e0 [ 984.392461][ T44] xp_release_deferred+0x1b/0x1e0 [ 984.392642][ T44] process_one_work+0xd57/0x1390 [ 984.392812][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 984.392979][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.393156][ T44] ? assign_work+0x152/0x380 [ 984.393323][ T44] worker_thread+0x4d6/0xd40 [ 984.393495][ T44] ? process_one_work+0x1390/0x1390 [ 984.393674][ T44] kthread+0x355/0x5b0 [ 984.393819][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 984.393986][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.394160][ T44] ? rcu_is_watching+0x15/0xd0 [ 984.394338][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 984.394507][ T44] ret_from_fork+0x1d4/0x270 [ 984.394688][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 984.394856][ T44] ret_from_fork_asm+0x11/0x20 [ 984.395030][ T44] [ 984.395186][ T44] INFO: task kworker/2:0:28 is blocked on a mutex likely owned by task ip:5448. [ 984.395443][ T44] INFO: task ip:5448 blocked for more than 368 seconds. [ 984.395640][ T44] Not tainted 6.18.0-rc6-virtme #1 [ 984.395798][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 984.396037][ T44] task:ip state:D stack:25592 pid:5448 tgid:5448 ppid:1 task_flags:0x400100 flags:0x00080003 [ 984.396357][ T44] Call Trace: [ 984.396498][ T44] [ 984.396618][ T44] __schedule+0x88d/0x1b90 [ 984.396789][ T44] ? io_schedule_timeout+0x130/0x130 [ 984.396960][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.397133][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.397297][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.397471][ T44] schedule+0xd4/0x260 [ 984.397620][ T44] schedule_preempt_disabled+0x18/0x30 [ 984.397786][ T44] __mutex_lock+0x9ae/0x1500 [ 984.397952][ T44] ? napi_enable+0x3b/0x80 [ 984.398131][ T44] ? virtqueue_add_inbuf_ctx+0x1850/0x1850 [ 984.398329][ T44] ? ww_mutex_lock+0x160/0x160 [ 984.398497][ T44] ? __asan_memset+0x27/0x50 [ 984.398683][ T44] ? sg_init_table+0x19/0x60 [ 984.398851][ T44] ? try_fill_recv+0x3ec/0x1750 [ 984.399023][ T44] ? napi_enable+0x3b/0x80 [ 984.399195][ T44] napi_enable+0x3b/0x80 [ 984.399335][ T44] __virtnet_rx_resume+0x156/0x290 [ 984.399499][ T44] ? queue_delayed_work_on+0x91/0x100 [ 984.399677][ T44] virtnet_rx_resume_all+0xe7/0x1a0 [ 984.399846][ T44] virtnet_xdp_set+0xef7/0x1aa0 [ 984.400021][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0 [ 984.400188][ T44] dev_xdp_install+0x4ba/0x8e0 [ 984.400358][ T44] ? netif_skb_check_for_xdp+0x600/0x600 [ 984.400527][ T44] dev_xdp_attach+0x50d/0x1330 [ 984.400710][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0 [ 984.400878][ T44] ? mutex_is_locked+0x1c/0x50 [ 984.401046][ T44] ? rtnl_is_locked+0x15/0x20 [ 984.401222][ T44] ? dev_change_xdp_fd+0x9f/0x240 [ 984.401390][ T44] do_setlink.isra.0+0x1c2d/0x2880 [ 984.401576][ T44] ? rtnl_newlink_create+0x900/0x900 [ 984.401741][ T44] ? rcu_lockdep_current_cpu_online+0x3e/0x1b0 [ 984.401938][ T44] ? rcu_read_lock_any_held+0x41/0xa0 [ 984.402112][ T44] ? validate_chain+0x287/0x5f0 [ 984.402280][ T44] ? rcu_read_lock_any_held+0x6b/0xa0 [ 984.402452][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 984.402635][ T44] ? __lock_acquire+0x34c/0x740 [ 984.402806][ T44] ? trace_lock_acquire+0x88/0xd0 [ 984.402970][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 984.403142][ T44] ? lock_acquire+0x31/0x80 [ 984.403309][ T44] ? rtnl_newlink+0x5df/0xb20 [ 984.403472][ T44] ? rcu_is_watching+0x15/0xd0 [ 984.403656][ T44] ? rcu_is_watching+0x15/0xd0 [ 984.403822][ T44] ? trace_contention_end+0xd6/0x140 [ 984.403988][ T44] ? rtnl_newlink+0x5df/0xb20 [ 984.404158][ T44] ? __mutex_lock+0x32e/0x1500 [ 984.404332][ T44] ? ww_mutex_lock+0x160/0x160 [ 984.404496][ T44] ? nla_validate_int_range+0x5b0/0x5b0 [ 984.404677][ T44] ? __rtnl_newlink+0x3fa/0xa40 [ 984.404849][ T44] rtnl_newlink+0x637/0xb20 [ 984.405023][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 984.405194][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.405359][ T44] ? find_held_lock+0x2b/0x80 [ 984.405526][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 984.405707][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.405874][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 984.406043][ T44] rtnetlink_rcv_msg+0x6fe/0xb90 [ 984.406221][ T44] ? rtnl_port_fill+0x940/0x940 [ 984.406391][ T44] ? __lock_acquire+0x34c/0x740 [ 984.406574][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.406740][ T44] ? find_held_lock+0x2b/0x80 [ 984.406911][ T44] netlink_rcv_skb+0x123/0x380 [ 984.407079][ T44] ? rtnl_port_fill+0x940/0x940 [ 984.407254][ T44] ? netlink_ack+0xcc0/0xcc0 [ 984.407425][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 984.407612][ T44] netlink_unicast+0x4a3/0x770 [ 984.407781][ T44] ? netlink_attachskb+0x810/0x810 [ 984.407950][ T44] ? __lock_acquire+0x34c/0x740 [ 984.408123][ T44] netlink_sendmsg+0x735/0xc60 [ 984.408291][ T44] ? netlink_unicast+0x770/0x770 [ 984.408462][ T44] ? __might_fault+0x97/0x140 [ 984.408644][ T44] ____sys_sendmsg+0x419/0x850 [ 984.408816][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 984.408988][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 984.409187][ T44] ? move_addr_to_kernel+0x40/0x40 [ 984.409355][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 984.409521][ T44] ? validate_chain+0x287/0x5f0 [ 984.409704][ T44] ___sys_sendmsg+0xfd/0x180 [ 984.409870][ T44] ? __call_rcu_common.constprop.0+0xa5/0x680 [ 984.410064][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 984.410258][ T44] __sys_sendmsg+0x124/0x1c0 [ 984.410425][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 984.410605][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 984.410772][ T44] ? __call_rcu_common.constprop.0+0x2fa/0x680 [ 984.410969][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 984.411144][ T44] ? rcu_is_watching+0x15/0xd0 [ 984.411313][ T44] do_syscall_64+0xbb/0xfd0 [ 984.411486][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 984.411694][ T44] RIP: 0033:0x7f8e982a3c5e [ 984.411867][ T44] RSP: 002b:00007ffd0931a9e0 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 984.412098][ T44] RAX: ffffffffffffffda RBX: 0000000000000004 RCX: 00007f8e982a3c5e [ 984.412318][ T44] RDX: 0000000000000000 RSI: 00007ffd0931aaa0 RDI: 0000000000000003 [ 984.412561][ T44] RBP: 00007ffd0931a9f0 R08: 0000000000000000 R09: 0000000000000000 [ 984.412782][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffd0931b160 [ 984.413004][ T44] R13: 00000000692729cf R14: 0000000000000000 R15: 0000000000499600 [ 984.413241][ T44] [ 984.413378][ T44] INFO: task ip:5448 is blocked on a mutex likely owned by task kworker/1:0:23. [ 984.413638][ T44] task:kworker/1:0 state:D stack:28200 pid:23 tgid:23 ppid:2 task_flags:0x4208160 flags:0x00080000 [ 984.413948][ T44] Workqueue: events refill_work [ 984.414122][ T44] Call Trace: [ 984.414259][ T44] [ 984.414369][ T44] __schedule+0x88d/0x1b90 [ 984.414555][ T44] ? io_schedule_timeout+0x130/0x130 [ 984.414722][ T44] ? usleep_range_state+0xba/0x1b0 [ 984.414893][ T44] ? find_held_lock+0x2b/0x80 [ 984.415065][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.415239][ T44] ? usleep_range_state+0xba/0x1b0 [ 984.415406][ T44] schedule+0xd4/0x260 [ 984.415562][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0 [ 984.415758][ T44] ? schedule_timeout_idle+0xe0/0xe0 [ 984.415930][ T44] ? hrtimer_cb_get_time+0x90/0x90 [ 984.416104][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 984.416271][ T44] ? ktime_get+0x15e/0x220 [ 984.416438][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 984.416615][ T44] ? ktime_get+0xa9/0x220 [ 984.416754][ T44] usleep_range_state+0x133/0x1b0 [ 984.416924][ T44] ? schedule_hrtimeout+0x20/0x20 [ 984.417096][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 984.417269][ T44] napi_disable_locked+0x379/0x5f0 [ 984.417434][ T44] ? _mutex_trylock_nest_lock+0x150/0x150 [ 984.417612][ T44] ? netdev_bind_sb_channel_queue+0x470/0x470 [ 984.417809][ T44] napi_disable+0x43/0x80 [ 984.417948][ T44] refill_work+0x116/0x210 [ 984.418123][ T44] process_one_work+0xd57/0x1390 [ 984.418296][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 984.418467][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.418647][ T44] ? assign_work+0x152/0x380 [ 984.418817][ T44] worker_thread+0x4d6/0xd40 [ 984.418988][ T44] ? process_one_work+0x1390/0x1390 [ 984.419161][ T44] kthread+0x355/0x5b0 [ 984.419300][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 984.419466][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.419649][ T44] ? rcu_is_watching+0x15/0xd0 [ 984.419818][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 984.420046][ T44] ret_from_fork+0x1d4/0x270 [ 984.420218][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 984.420389][ T44] ret_from_fork_asm+0x11/0x20 [ 984.420577][ T44] [ 984.420778][ T44] INFO: task ip:5512 blocked for more than 245 seconds. [ 984.420965][ T44] Not tainted 6.18.0-rc6-virtme #1 [ 984.421138][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 984.421425][ T44] task:ip state:D stack:25744 pid:5512 tgid:5512 ppid:5511 task_flags:0x400100 flags:0x00080001 [ 984.421741][ T44] Call Trace: [ 984.421877][ T44] [ 984.421987][ T44] __schedule+0x88d/0x1b90 [ 984.422163][ T44] ? io_schedule_timeout+0x130/0x130 [ 984.422336][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.422504][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.422741][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.422910][ T44] schedule+0xd4/0x260 [ 984.423050][ T44] schedule_preempt_disabled+0x18/0x30 [ 984.423219][ T44] __mutex_lock+0x9ae/0x1500 [ 984.423390][ T44] ? rtnetlink_rcv_msg+0x2ab/0xb90 [ 984.423626][ T44] ? write_profile+0xf0/0xf0 [ 984.423796][ T44] ? ww_mutex_lock+0x160/0x160 [ 984.423969][ T44] ? find_held_lock+0x2b/0x80 [ 984.424137][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.424362][ T44] ? rtnetlink_rcv_msg+0x2ab/0xb90 [ 984.424528][ T44] rtnetlink_rcv_msg+0x2ab/0xb90 [ 984.424710][ T44] ? rtnl_port_fill+0x940/0x940 [ 984.424880][ T44] ? __lock_acquire+0x34c/0x740 [ 984.425050][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.425221][ T44] ? find_held_lock+0x2b/0x80 [ 984.425391][ T44] netlink_rcv_skb+0x123/0x380 [ 984.425573][ T44] ? rtnl_port_fill+0x940/0x940 [ 984.425799][ T44] ? netlink_ack+0xcc0/0xcc0 [ 984.425970][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 984.426151][ T44] netlink_unicast+0x4a3/0x770 [ 984.426320][ T44] ? netlink_attachskb+0x810/0x810 [ 984.426560][ T44] ? __lock_acquire+0x34c/0x740 [ 984.426728][ T44] netlink_sendmsg+0x735/0xc60 [ 984.426896][ T44] ? netlink_unicast+0x770/0x770 [ 984.427064][ T44] ? __might_fault+0x97/0x140 [ 984.427296][ T44] ____sys_sendmsg+0x419/0x850 [ 984.427463][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 984.427648][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 984.427843][ T44] ? move_addr_to_kernel+0x40/0x40 [ 984.428065][ T44] ? rcu_lockdep_current_cpu_online+0x3e/0x1b0 [ 984.428269][ T44] ___sys_sendmsg+0xfd/0x180 [ 984.428435][ T44] ? validate_chain+0x287/0x5f0 [ 984.428616][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 984.428787][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.428957][ T44] ? __might_fault+0x97/0x140 [ 984.429134][ T44] ? _copy_to_user+0x4b/0x70 [ 984.429362][ T44] __sys_sendmsg+0x124/0x1c0 [ 984.429547][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 984.429718][ T44] ? rcu_is_watching+0x15/0xd0 [ 984.429887][ T44] do_syscall_64+0xbb/0xfd0 [ 984.430116][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 984.430310][ T44] RIP: 0033:0x7fd3c982bc5e [ 984.430487][ T44] RSP: 002b:00007ffc316bd530 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 984.430785][ T44] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fd3c982bc5e [ 984.431006][ T44] RDX: 0000000000000000 RSI: 00007ffc316bd5f0 RDI: 0000000000000004 [ 984.431234][ T44] RBP: 00007ffc316bd540 R08: 0000000000000000 R09: 0000000000000000 [ 984.431515][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffc316be6bf [ 984.431753][ T44] R13: 0000000069272a9e R14: 000000000000000d R15: 00007ffc316bd6a0 [ 984.431981][ T44] [ 984.432185][ T44] INFO: task ip:5512 is blocked on a mutex likely owned by task ip:5448. [ 984.432400][ T44] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings [ 984.432662][ T44] [ 984.432662][ T44] Showing all locks held in the system: [ 984.432879][ T44] 3 locks held by kworker/u16:0/12: [ 984.433039][ T44] #0: ff1100000913cd48 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 984.433324][ T44] #1: ffa00000000c7d30 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 984.433672][ T44] #2: ffffffff98a92a28 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 984.433977][ T44] 3 locks held by kworker/1:0/23: [ 984.434144][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 984.434420][ T44] #1: ffa00000001a7d30 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 984.434742][ T44] #2: ff11000008a5aca0 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 984.434992][ T44] 3 locks held by kworker/2:0/28: [ 984.435212][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 984.435488][ T44] #1: ffa00000001ffd30 ((work_completion)(&pool->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 984.435836][ T44] #2: ffffffff98a92a28 (rtnl_mutex){+.+.}-{4:4}, at: xp_release_deferred+0x1b/0x1e0 [ 984.436092][ T44] 1 lock held by khungtaskd/44: [ 984.436252][ T44] #0: ffffffff98378fc0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x2b/0x1db [ 984.436573][ T44] 2 locks held by ip/5448: [ 984.436732][ T44] #0: ffffffff98a92a28 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x5df/0xb20 [ 984.437193][ T44] #1: ff11000008a5aca0 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80 [ 984.437501][ T44] 1 lock held by ip/5512: [ 984.437647][ T44] #0: ffffffff98a92a28 (rtnl_mutex){+.+.}-{4:4}, at: rtnetlink_rcv_msg+0x2ab/0xb90 [ 984.437894][ T44] [ 984.438002][ T44] ============================================= [ 984.438002][ T44]