[ 861.529486][ T44] INFO: task kworker/u16:0:12 blocked for more than 122 seconds. [ 861.530052][ T44] Not tainted 6.18.0-rc7-virtme #1 [ 861.530244][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 861.530984][ T44] task:kworker/u16:0 state:D stack:26880 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 861.531441][ T44] Workqueue: ipv6_addrconf addrconf_verify_work [ 861.531695][ T44] Call Trace: [ 861.531839][ T44] [ 861.531949][ T44] __schedule+0x88d/0x1b90 [ 861.532188][ T44] ? io_schedule_timeout+0x130/0x130 [ 861.532380][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.532584][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.532778][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.532968][ T44] schedule+0xd4/0x260 [ 861.533114][ T44] schedule_preempt_disabled+0x18/0x30 [ 861.533346][ T44] __mutex_lock+0x9ae/0x1500 [ 861.533542][ T44] ? addrconf_verify_work+0x12/0x30 [ 861.533731][ T44] ? ww_mutex_lock+0x160/0x160 [ 861.533915][ T44] ? process_one_work+0xd16/0x1390 [ 861.534107][ T44] ? trace_lock_acquire+0x88/0xd0 [ 861.534285][ T44] ? trace_lock_acquire+0x88/0xd0 [ 861.534477][ T44] ? addrconf_verify_work+0x12/0x30 [ 861.534667][ T44] addrconf_verify_work+0x12/0x30 [ 861.534848][ T44] process_one_work+0xd57/0x1390 [ 861.535042][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 861.535225][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.535411][ T44] ? assign_work+0x152/0x380 [ 861.535603][ T44] worker_thread+0x4d6/0xd40 [ 861.535792][ T44] ? process_one_work+0x1390/0x1390 [ 861.535983][ T44] kthread+0x355/0x5b0 [ 861.536127][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.536305][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.536494][ T44] ? rcu_is_watching+0x15/0xd0 [ 861.536674][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.536862][ T44] ret_from_fork+0x1d4/0x270 [ 861.537044][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.537226][ T44] ret_from_fork_asm+0x11/0x20 [ 861.537436][ T44] [ 861.537610][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:5732. [ 861.537926][ T44] INFO: task ip:5732 blocked for more than 122 seconds. [ 861.538140][ T44] Not tainted 6.18.0-rc7-virtme #1 [ 861.538308][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 861.538608][ T44] task:ip state:D stack:25592 pid:5732 tgid:5732 ppid:1 task_flags:0x400100 flags:0x00080003 [ 861.539006][ T44] Call Trace: [ 861.539143][ T44] [ 861.539235][ T44] __schedule+0x88d/0x1b90 [ 861.539421][ T44] ? io_schedule_timeout+0x130/0x130 [ 861.539614][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.539796][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.539979][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.540167][ T44] schedule+0xd4/0x260 [ 861.540302][ T44] schedule_preempt_disabled+0x18/0x30 [ 861.540490][ T44] __mutex_lock+0x9ae/0x1500 [ 861.540666][ T44] ? napi_enable+0x3b/0x80 [ 861.540846][ T44] ? virtqueue_add_inbuf_ctx+0x1850/0x1850 [ 861.541075][ T44] ? ww_mutex_lock+0x160/0x160 [ 861.541253][ T44] ? __asan_memset+0x27/0x50 [ 861.541446][ T44] ? sg_init_table+0x19/0x60 [ 861.541626][ T44] ? try_fill_recv+0x3ec/0x1750 [ 861.541812][ T44] ? napi_enable+0x3b/0x80 [ 861.541988][ T44] napi_enable+0x3b/0x80 [ 861.542130][ T44] __virtnet_rx_resume+0x156/0x290 [ 861.542308][ T44] ? queue_delayed_work_on+0x91/0x100 [ 861.542497][ T44] virtnet_rx_resume_all+0xe7/0x1a0 [ 861.542684][ T44] virtnet_xdp_set+0xef7/0x1aa0 [ 861.542872][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0 [ 861.543053][ T44] dev_xdp_install+0x4ba/0x8e0 [ 861.543235][ T44] ? netif_skb_check_for_xdp+0x600/0x600 [ 861.543422][ T44] dev_xdp_attach+0x50d/0x1320 [ 861.543619][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0 [ 861.543800][ T44] ? mutex_is_locked+0x1c/0x50 [ 861.543985][ T44] ? rtnl_is_locked+0x15/0x20 [ 861.544166][ T44] ? dev_change_xdp_fd+0x9f/0x240 [ 861.544377][ T44] do_setlink.isra.0+0x1c2d/0x2880 [ 861.544573][ T44] ? rtnl_newlink_create+0x900/0x900 [ 861.544753][ T44] ? rcu_lockdep_current_cpu_online+0x3e/0x1b0 [ 861.545012][ T44] ? rcu_read_lock_any_held+0x41/0xa0 [ 861.545199][ T44] ? validate_chain+0x287/0x5f0 [ 861.545380][ T44] ? rcu_read_lock_any_held+0x6b/0xa0 [ 861.545564][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 861.545744][ T44] ? __lock_acquire+0x34c/0x740 [ 861.545930][ T44] ? trace_lock_acquire+0x88/0xd0 [ 861.546127][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 861.546304][ T44] ? lock_acquire+0x31/0x80 [ 861.546489][ T44] ? rtnl_newlink+0x5df/0xb20 [ 861.546662][ T44] ? rcu_is_watching+0x15/0xd0 [ 861.546859][ T44] ? rcu_is_watching+0x15/0xd0 [ 861.547044][ T44] ? trace_contention_end+0xd6/0x140 [ 861.547224][ T44] ? rtnl_newlink+0x5df/0xb20 [ 861.547399][ T44] ? __mutex_lock+0x32e/0x1500 [ 861.547594][ T44] ? ww_mutex_lock+0x160/0x160 [ 861.547769][ T44] ? nla_validate_int_range+0x5b0/0x5b0 [ 861.547951][ T44] ? __rtnl_newlink+0x3fa/0xa40 [ 861.548146][ T44] rtnl_newlink+0x637/0xb20 [ 861.548330][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 861.548525][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.548704][ T44] ? find_held_lock+0x2b/0x80 [ 861.548881][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 861.549066][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.549246][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 861.549435][ T44] rtnetlink_rcv_msg+0x6fe/0xb90 [ 861.549622][ T44] ? rtnl_port_fill+0x940/0x940 [ 861.549799][ T44] ? __lock_acquire+0x34c/0x740 [ 861.549982][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.550161][ T44] ? find_held_lock+0x2b/0x80 [ 861.550340][ T44] netlink_rcv_skb+0x123/0x380 [ 861.550529][ T44] ? rtnl_port_fill+0x940/0x940 [ 861.550711][ T44] ? netlink_ack+0xcc0/0xcc0 [ 861.550896][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 861.551090][ T44] netlink_unicast+0x4a3/0x770 [ 861.551270][ T44] ? netlink_attachskb+0x810/0x810 [ 861.551453][ T44] ? __lock_acquire+0x34c/0x740 [ 861.551631][ T44] netlink_sendmsg+0x735/0xc60 [ 861.551811][ T44] ? netlink_unicast+0x770/0x770 [ 861.551989][ T44] ? __might_fault+0x97/0x140 [ 861.552173][ T44] ____sys_sendmsg+0x419/0x850 [ 861.552348][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 861.552537][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 861.552754][ T44] ? move_addr_to_kernel+0x40/0x40 [ 861.552933][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 861.553108][ T44] ? validate_chain+0x287/0x5f0 [ 861.553279][ T44] ___sys_sendmsg+0xfd/0x180 [ 861.553452][ T44] ? __call_rcu_common.constprop.0+0xa5/0x680 [ 861.553665][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 861.553858][ T44] __sys_sendmsg+0x124/0x1c0 [ 861.554034][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 861.554201][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 861.554368][ T44] ? __call_rcu_common.constprop.0+0x2fa/0x680 [ 861.554595][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 861.554766][ T44] ? rcu_is_watching+0x15/0xd0 [ 861.554944][ T44] do_syscall_64+0xbb/0xfd0 [ 861.555120][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 861.555341][ T44] RIP: 0033:0x7fadc30efc5e [ 861.555540][ T44] RSP: 002b:00007fffefe81250 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 861.555815][ T44] RAX: ffffffffffffffda RBX: 0000000000000004 RCX: 00007fadc30efc5e [ 861.556090][ T44] RDX: 0000000000000000 RSI: 00007fffefe81310 RDI: 0000000000000003 [ 861.556362][ T44] RBP: 00007fffefe81260 R08: 0000000000000000 R09: 0000000000000000 [ 861.556639][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fffefe819d0 [ 861.556905][ T44] R13: 00000000692f83d7 R14: 0000000000000000 R15: 0000000000499600 [ 861.557191][ T44] [ 861.557330][ T44] INFO: task ip:5732 is blocked on a mutex likely owned by task kworker/0:0:9. [ 861.557642][ T44] task:kworker/0:0 state:R stack:28200 pid:9 tgid:9 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 861.558035][ T44] Workqueue: events refill_work [ 861.558218][ T44] Call Trace: [ 861.558353][ T44] [ 861.558459][ T44] __schedule+0x88d/0x1b90 [ 861.558649][ T44] ? io_schedule_timeout+0x130/0x130 [ 861.558834][ T44] ? usleep_range_state+0xba/0x1b0 [ 861.559012][ T44] ? find_held_lock+0x2b/0x80 [ 861.559197][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.559382][ T44] ? usleep_range_state+0xba/0x1b0 [ 861.559568][ T44] schedule+0xd4/0x260 [ 861.559703][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0 [ 861.559926][ T44] ? schedule_timeout_idle+0xe0/0xe0 [ 861.560115][ T44] ? hrtimer_cb_get_time+0x90/0x90 [ 861.560297][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 861.560483][ T44] ? ktime_get+0x15e/0x220 [ 861.560659][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 861.560834][ T44] ? ktime_get+0xa9/0x220 [ 861.560970][ T44] usleep_range_state+0x133/0x1b0 [ 861.561152][ T44] ? schedule_hrtimeout+0x20/0x20 [ 861.561338][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 861.561535][ T44] napi_disable_locked+0x379/0x5f0 [ 861.561715][ T44] ? _mutex_trylock_nest_lock+0x150/0x150 [ 861.561896][ T44] ? netdev_bind_sb_channel_queue+0x470/0x470 [ 861.562128][ T44] napi_disable+0x43/0x80 [ 861.562264][ T44] refill_work+0x116/0x210 [ 861.562455][ T44] process_one_work+0xd57/0x1390 [ 861.562648][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 861.562825][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 861.563008][ T44] ? assign_work+0x152/0x380 [ 861.563196][ T44] worker_thread+0x4d6/0xd40 [ 861.563384][ T44] ? process_one_work+0x1390/0x1390 [ 861.563572][ T44] kthread+0x355/0x5b0 [ 861.563709][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.563891][ T44] ? __lock_release.isra.0+0x59/0x170 [ 861.564076][ T44] ? rcu_is_watching+0x15/0xd0 [ 861.564256][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.564444][ T44] ret_from_fork+0x1d4/0x270 [ 861.564626][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 861.564805][ T44] ret_from_fork_asm+0x11/0x20 [ 861.564996][ T44] [ 861.565146][ T44] [ 861.565146][ T44] Showing all locks held in the system: [ 861.565411][ T44] 3 locks held by kworker/0:0/9: [ 861.565596][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 861.565954][ T44] #1: ffa0000000097d30 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 861.566352][ T44] #2: ff110000087cac98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 861.566674][ T44] 3 locks held by kworker/u16:0/12: [ 861.566846][ T44] #0: ff110000091ecd48 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 861.567198][ T44] #1: ffa00000000c7d30 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 861.567638][ T44] #2: ffffffff8b6925e8 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 861.567954][ T44] 1 lock held by khungtaskd/44: [ 861.568130][ T44] #0: ffffffff8af78fc0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x2b/0x1db [ 861.568453][ T44] 3 locks held by kworker/2:2/69: [ 861.568626][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 861.568980][ T44] #1: ffa00000004a7d30 ((work_completion)(&pool->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 861.569337][ T44] #2: ffffffff8b6925e8 (rtnl_mutex){+.+.}-{4:4}, at: xp_release_deferred+0x1b/0x1e0 [ 861.569665][ T44] 2 locks held by ip/5732: [ 861.569839][ T44] #0: ffffffff8b6925e8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x5df/0xb20 [ 861.570150][ T44] #1: ff110000087cac98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80 [ 861.570470][ T44] 1 lock held by ip/5796: [ 861.570599][ T44] #0: ffffffff8b6925e8 (rtnl_mutex){+.+.}-{4:4}, at: rtnetlink_rcv_msg+0x2ab/0xb90 [ 861.570907][ T44] [ 861.570997][ T44] ============================================= [ 861.570997][ T44] [ 984.409465][ T44] INFO: task kworker/u16:0:12 blocked for more than 245 seconds. [ 984.409820][ T44] Not tainted 6.18.0-rc7-virtme #1 [ 984.409956][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 984.410189][ T44] task:kworker/u16:0 state:D stack:26880 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 984.410512][ T44] Workqueue: ipv6_addrconf addrconf_verify_work [ 984.410692][ T44] Call Trace: [ 984.410797][ T44] [ 984.410869][ T44] __schedule+0x88d/0x1b90 [ 984.411011][ T44] ? io_schedule_timeout+0x130/0x130 [ 984.411147][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.411278][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.411411][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.411549][ T44] schedule+0xd4/0x260 [ 984.411643][ T44] schedule_preempt_disabled+0x18/0x30 [ 984.411783][ T44] __mutex_lock+0x9ae/0x1500 [ 984.411909][ T44] ? addrconf_verify_work+0x12/0x30 [ 984.412041][ T44] ? ww_mutex_lock+0x160/0x160 [ 984.412173][ T44] ? process_one_work+0xd16/0x1390 [ 984.412299][ T44] ? trace_lock_acquire+0x88/0xd0 [ 984.412433][ T44] ? trace_lock_acquire+0x88/0xd0 [ 984.412557][ T44] ? addrconf_verify_work+0x12/0x30 [ 984.412693][ T44] addrconf_verify_work+0x12/0x30 [ 984.412811][ T44] process_one_work+0xd57/0x1390 [ 984.412948][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 984.413067][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.413192][ T44] ? assign_work+0x152/0x380 [ 984.413311][ T44] worker_thread+0x4d6/0xd40 [ 984.413438][ T44] ? process_one_work+0x1390/0x1390 [ 984.413558][ T44] kthread+0x355/0x5b0 [ 984.413646][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 984.413765][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.413883][ T44] ? rcu_is_watching+0x15/0xd0 [ 984.413998][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 984.414117][ T44] ret_from_fork+0x1d4/0x270 [ 984.414239][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 984.414355][ T44] ret_from_fork_asm+0x11/0x20 [ 984.414490][ T44] [ 984.414606][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:5732. [ 984.414818][ T44] INFO: task kworker/2:2:69 blocked for more than 122 seconds. [ 984.414982][ T44] Not tainted 6.18.0-rc7-virtme #1 [ 984.415089][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 984.415283][ T44] task:kworker/2:2 state:D stack:28240 pid:69 tgid:69 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 984.415550][ T44] Workqueue: events xp_release_deferred [ 984.415670][ T44] Call Trace: [ 984.415771][ T44] [ 984.415830][ T44] __schedule+0x88d/0x1b90 [ 984.415951][ T44] ? io_schedule_timeout+0x130/0x130 [ 984.416070][ T44] ? find_held_lock+0x2b/0x80 [ 984.416190][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.416307][ T44] schedule+0xd4/0x260 [ 984.416394][ T44] schedule_preempt_disabled+0x18/0x30 [ 984.416514][ T44] __mutex_lock+0x9ae/0x1500 [ 984.416630][ T44] ? xp_release_deferred+0x1b/0x1e0 [ 984.416751][ T44] ? ww_mutex_lock+0x160/0x160 [ 984.416866][ T44] ? __lock_acquire+0x34c/0x740 [ 984.416986][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.417311][ T44] ? process_one_work+0xd16/0x1390 [ 984.417436][ T44] ? xp_release_deferred+0x1b/0x1e0 [ 984.417552][ T44] xp_release_deferred+0x1b/0x1e0 [ 984.417673][ T44] process_one_work+0xd57/0x1390 [ 984.417796][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 984.417913][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.418034][ T44] ? assign_work+0x152/0x380 [ 984.418150][ T44] worker_thread+0x4d6/0xd40 [ 984.418271][ T44] ? process_one_work+0x1390/0x1390 [ 984.418386][ T44] ? __kthread_parkme+0xb3/0x200 [ 984.418511][ T44] ? process_one_work+0x1390/0x1390 [ 984.418625][ T44] kthread+0x355/0x5b0 [ 984.418720][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 984.418834][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.418955][ T44] ? rcu_is_watching+0x15/0xd0 [ 984.419072][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 984.419187][ T44] ret_from_fork+0x1d4/0x270 [ 984.419301][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 984.419417][ T44] ret_from_fork_asm+0x11/0x20 [ 984.419545][ T44] [ 984.419635][ T44] INFO: task kworker/2:2:69 is blocked on a mutex likely owned by task ip:5732. [ 984.419839][ T44] INFO: task ip:5732 blocked for more than 245 seconds. [ 984.419973][ T44] Not tainted 6.18.0-rc7-virtme #1 [ 984.420082][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 984.420269][ T44] task:ip state:D stack:25592 pid:5732 tgid:5732 ppid:1 task_flags:0x400100 flags:0x00080003 [ 984.420532][ T44] Call Trace: [ 984.420621][ T44] [ 984.420686][ T44] __schedule+0x88d/0x1b90 [ 984.420805][ T44] ? io_schedule_timeout+0x130/0x130 [ 984.420922][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.421038][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.421154][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.421273][ T44] schedule+0xd4/0x260 [ 984.421361][ T44] schedule_preempt_disabled+0x18/0x30 [ 984.421484][ T44] __mutex_lock+0x9ae/0x1500 [ 984.421600][ T44] ? napi_enable+0x3b/0x80 [ 984.421723][ T44] ? virtqueue_add_inbuf_ctx+0x1850/0x1850 [ 984.421870][ T44] ? ww_mutex_lock+0x160/0x160 [ 984.421993][ T44] ? __asan_memset+0x27/0x50 [ 984.422109][ T44] ? sg_init_table+0x19/0x60 [ 984.422226][ T44] ? try_fill_recv+0x3ec/0x1750 [ 984.422350][ T44] ? napi_enable+0x3b/0x80 [ 984.422469][ T44] napi_enable+0x3b/0x80 [ 984.422558][ T44] __virtnet_rx_resume+0x156/0x290 [ 984.422675][ T44] ? queue_delayed_work_on+0x91/0x100 [ 984.422792][ T44] virtnet_rx_resume_all+0xe7/0x1a0 [ 984.422916][ T44] virtnet_xdp_set+0xef7/0x1aa0 [ 984.423036][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0 [ 984.423155][ T44] dev_xdp_install+0x4ba/0x8e0 [ 984.423273][ T44] ? netif_skb_check_for_xdp+0x600/0x600 [ 984.423392][ T44] dev_xdp_attach+0x50d/0x1320 [ 984.423519][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0 [ 984.423635][ T44] ? mutex_is_locked+0x1c/0x50 [ 984.423758][ T44] ? rtnl_is_locked+0x15/0x20 [ 984.423873][ T44] ? dev_change_xdp_fd+0x9f/0x240 [ 984.423990][ T44] do_setlink.isra.0+0x1c2d/0x2880 [ 984.424112][ T44] ? rtnl_newlink_create+0x900/0x900 [ 984.424234][ T44] ? rcu_lockdep_current_cpu_online+0x3e/0x1b0 [ 984.424378][ T44] ? rcu_read_lock_any_held+0x41/0xa0 [ 984.424499][ T44] ? validate_chain+0x287/0x5f0 [ 984.424613][ T44] ? rcu_read_lock_any_held+0x6b/0xa0 [ 984.424731][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 984.424854][ T44] ? __lock_acquire+0x34c/0x740 [ 984.424975][ T44] ? trace_lock_acquire+0x88/0xd0 [ 984.425089][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 984.425205][ T44] ? lock_acquire+0x31/0x80 [ 984.425320][ T44] ? rtnl_newlink+0x5df/0xb20 [ 984.425440][ T44] ? rcu_is_watching+0x15/0xd0 [ 984.425556][ T44] ? rcu_is_watching+0x15/0xd0 [ 984.425675][ T44] ? trace_contention_end+0xd6/0x140 [ 984.425793][ T44] ? rtnl_newlink+0x5df/0xb20 [ 984.425907][ T44] ? __mutex_lock+0x32e/0x1500 [ 984.426025][ T44] ? ww_mutex_lock+0x160/0x160 [ 984.426139][ T44] ? nla_validate_int_range+0x5b0/0x5b0 [ 984.426258][ T44] ? __rtnl_newlink+0x3fa/0xa40 [ 984.426377][ T44] rtnl_newlink+0x637/0xb20 [ 984.426500][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 984.426619][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.426742][ T44] ? find_held_lock+0x2b/0x80 [ 984.426856][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 984.426971][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.427089][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 984.427205][ T44] rtnetlink_rcv_msg+0x6fe/0xb90 [ 984.427321][ T44] ? rtnl_port_fill+0x940/0x940 [ 984.427441][ T44] ? __lock_acquire+0x34c/0x740 [ 984.427561][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.427685][ T44] ? find_held_lock+0x2b/0x80 [ 984.427803][ T44] netlink_rcv_skb+0x123/0x380 [ 984.427921][ T44] ? rtnl_port_fill+0x940/0x940 [ 984.428036][ T44] ? netlink_ack+0xcc0/0xcc0 [ 984.428155][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 984.428273][ T44] netlink_unicast+0x4a3/0x770 [ 984.428389][ T44] ? netlink_attachskb+0x810/0x810 [ 984.428514][ T44] ? __lock_acquire+0x34c/0x740 [ 984.428635][ T44] netlink_sendmsg+0x735/0xc60 [ 984.428756][ T44] ? netlink_unicast+0x770/0x770 [ 984.428873][ T44] ? __might_fault+0x97/0x140 [ 984.428991][ T44] ____sys_sendmsg+0x419/0x850 [ 984.429108][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 984.429222][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 984.429366][ T44] ? move_addr_to_kernel+0x40/0x40 [ 984.429493][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 984.429607][ T44] ? validate_chain+0x287/0x5f0 [ 984.429730][ T44] ___sys_sendmsg+0xfd/0x180 [ 984.429844][ T44] ? __call_rcu_common.constprop.0+0xa5/0x680 [ 984.429987][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 984.430115][ T44] __sys_sendmsg+0x124/0x1c0 [ 984.430232][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 984.430349][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 984.430468][ T44] ? __call_rcu_common.constprop.0+0x2fa/0x680 [ 984.430617][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 984.430737][ T44] ? rcu_is_watching+0x15/0xd0 [ 984.430853][ T44] do_syscall_64+0xbb/0xfd0 [ 984.430971][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 984.431115][ T44] RIP: 0033:0x7fadc30efc5e [ 984.431243][ T44] RSP: 002b:00007fffefe81250 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 984.431421][ T44] RAX: ffffffffffffffda RBX: 0000000000000004 RCX: 00007fadc30efc5e [ 984.431606][ T44] RDX: 0000000000000000 RSI: 00007fffefe81310 RDI: 0000000000000003 [ 984.431790][ T44] RBP: 00007fffefe81260 R08: 0000000000000000 R09: 0000000000000000 [ 984.431967][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fffefe819d0 [ 984.432141][ T44] R13: 00000000692f83d7 R14: 0000000000000000 R15: 0000000000499600 [ 984.432320][ T44] [ 984.432409][ T44] INFO: task ip:5732 is blocked on a mutex likely owned by task kworker/0:0:9. [ 984.432610][ T44] task:kworker/0:0 state:D stack:28200 pid:9 tgid:9 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 984.432873][ T44] Workqueue: events refill_work [ 984.432998][ T44] Call Trace: [ 984.433086][ T44] [ 984.433147][ T44] __schedule+0x88d/0x1b90 [ 984.433268][ T44] ? io_schedule_timeout+0x130/0x130 [ 984.433385][ T44] ? usleep_range_state+0xba/0x1b0 [ 984.433507][ T44] ? find_held_lock+0x2b/0x80 [ 984.433626][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.433748][ T44] ? usleep_range_state+0xba/0x1b0 [ 984.433862][ T44] schedule+0xd4/0x260 [ 984.433949][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0 [ 984.434092][ T44] ? schedule_timeout_idle+0xe0/0xe0 [ 984.434209][ T44] ? hrtimer_cb_get_time+0x90/0x90 [ 984.434327][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 984.434454][ T44] ? ktime_get+0x15e/0x220 [ 984.434573][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 984.434695][ T44] ? ktime_get+0xa9/0x220 [ 984.434783][ T44] usleep_range_state+0x133/0x1b0 [ 984.434899][ T44] ? schedule_hrtimeout+0x20/0x20 [ 984.435016][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 984.435133][ T44] napi_disable_locked+0x379/0x5f0 [ 984.435252][ T44] ? _mutex_trylock_nest_lock+0x150/0x150 [ 984.435367][ T44] ? netdev_bind_sb_channel_queue+0x470/0x470 [ 984.435519][ T44] napi_disable+0x43/0x80 [ 984.435612][ T44] refill_work+0x116/0x210 [ 984.435732][ T44] process_one_work+0xd57/0x1390 [ 984.435857][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 984.435974][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.436094][ T44] ? assign_work+0x152/0x380 [ 984.436212][ T44] worker_thread+0x4d6/0xd40 [ 984.436331][ T44] ? process_one_work+0x1390/0x1390 [ 984.436454][ T44] kthread+0x355/0x5b0 [ 984.436543][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 984.436658][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.436778][ T44] ? rcu_is_watching+0x15/0xd0 [ 984.436899][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 984.437019][ T44] ret_from_fork+0x1d4/0x270 [ 984.437135][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 984.437250][ T44] ret_from_fork_asm+0x11/0x20 [ 984.437448][ T44] [ 984.437545][ T44] INFO: task ip:5796 blocked for more than 122 seconds. [ 984.437684][ T44] Not tainted 6.18.0-rc7-virtme #1 [ 984.437791][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 984.437986][ T44] task:ip state:D stack:25744 pid:5796 tgid:5796 ppid:5795 task_flags:0x400100 flags:0x00080001 [ 984.438242][ T44] Call Trace: [ 984.438385][ T44] [ 984.438450][ T44] __schedule+0x88d/0x1b90 [ 984.438566][ T44] ? io_schedule_timeout+0x130/0x130 [ 984.438688][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.438808][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.438923][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.439039][ T44] schedule+0xd4/0x260 [ 984.439127][ T44] schedule_preempt_disabled+0x18/0x30 [ 984.439243][ T44] __mutex_lock+0x9ae/0x1500 [ 984.439418][ T44] ? rtnetlink_rcv_msg+0x2ab/0xb90 [ 984.439539][ T44] ? write_profile+0xf0/0xf0 [ 984.439670][ T44] ? ww_mutex_lock+0x160/0x160 [ 984.439788][ T44] ? find_held_lock+0x2b/0x80 [ 984.439904][ T44] ? __lock_release.isra.0+0x59/0x170 [ 984.440021][ T44] ? rtnetlink_rcv_msg+0x2ab/0xb90 [ 984.440137][ T44] rtnetlink_rcv_msg+0x2ab/0xb90 [ 984.440256][ T44] ? rtnl_port_fill+0x940/0x940 [ 984.440434][ T44] ? __lock_acquire+0x34c/0x740 [ 984.440555][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.440676][ T44] ? find_held_lock+0x2b/0x80 [ 984.440793][ T44] netlink_rcv_skb+0x123/0x380 [ 984.440962][ T44] ? rtnl_port_fill+0x940/0x940 [ 984.441081][ T44] ? netlink_ack+0xcc0/0xcc0 [ 984.441200][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 984.441318][ T44] netlink_unicast+0x4a3/0x770 [ 984.441498][ T44] ? netlink_attachskb+0x810/0x810 [ 984.441616][ T44] ? __lock_acquire+0x34c/0x740 [ 984.441736][ T44] netlink_sendmsg+0x735/0xc60 [ 984.441853][ T44] ? netlink_unicast+0x770/0x770 [ 984.442026][ T44] ? __might_fault+0x97/0x140 [ 984.442142][ T44] ____sys_sendmsg+0x419/0x850 [ 984.442257][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 984.442371][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 984.442520][ T44] ? move_addr_to_kernel+0x40/0x40 [ 984.442641][ T44] ? rcu_lockdep_current_cpu_online+0x3e/0x1b0 [ 984.442791][ T44] ___sys_sendmsg+0xfd/0x180 [ 984.442905][ T44] ? validate_chain+0x287/0x5f0 [ 984.443077][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 984.443197][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 984.443314][ T44] ? __might_fault+0x97/0x140 [ 984.443441][ T44] ? _copy_to_user+0x4b/0x70 [ 984.443566][ T44] __sys_sendmsg+0x124/0x1c0 [ 984.443688][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 984.443808][ T44] ? rcu_is_watching+0x15/0xd0 [ 984.443924][ T44] do_syscall_64+0xbb/0xfd0 [ 984.444104][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 984.444246][ T44] RIP: 0033:0x7fd1bfe32c5e [ 984.444365][ T44] RSP: 002b:00007ffec1216580 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 984.444609][ T44] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fd1bfe32c5e [ 984.444796][ T44] RDX: 0000000000000000 RSI: 00007ffec1216640 RDI: 0000000000000004 [ 984.444967][ T44] RBP: 00007ffec1216590 R08: 0000000000000000 R09: 0000000000000000 [ 984.445194][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffec12186bf [ 984.445367][ T44] R13: 00000000692f84a7 R14: 000000000000000d R15: 00007ffec12166f0 [ 984.445609][ T44] [ 984.445704][ T44] INFO: task ip:5796 is blocked on a mutex likely owned by task ip:5732. [ 984.445869][ T44] [ 984.445869][ T44] Showing all locks held in the system: [ 984.446039][ T44] 3 locks held by kworker/0:0/9: [ 984.446159][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 984.446387][ T44] #1: ffa0000000097d30 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 984.446703][ T44] #2: ff110000087cac98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 984.446901][ T44] 3 locks held by kworker/u16:0/12: [ 984.447011][ T44] #0: ff110000091ecd48 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 984.447290][ T44] #1: ffa00000000c7d30 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 984.447622][ T44] #2: ffffffff8b6925e8 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 984.447824][ T44] 1 lock held by khungtaskd/44: [ 984.447937][ T44] #0: ffffffff8af78fc0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x2b/0x1db [ 984.448139][ T44] 3 locks held by kworker/2:2/69: [ 984.448248][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 984.448537][ T44] #1: ffa00000004a7d30 ((work_completion)(&pool->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 984.448780][ T44] #2: ffffffff8b6925e8 (rtnl_mutex){+.+.}-{4:4}, at: xp_release_deferred+0x1b/0x1e0 [ 984.448984][ T44] 2 locks held by ip/5732: [ 984.449147][ T44] #0: ffffffff8b6925e8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x5df/0xb20 [ 984.449344][ T44] #1: ff110000087cac98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80 [ 984.449600][ T44] 1 lock held by ip/5796: [ 984.449693][ T44] #0: ffffffff8b6925e8 (rtnl_mutex){+.+.}-{4:4}, at: rtnetlink_rcv_msg+0x2ab/0xb90 [ 984.449895][ T44] [ 984.449952][ T44] ============================================= [ 984.449952][ T44] [ 1107.289462][ T44] INFO: task kworker/u16:0:12 blocked for more than 368 seconds. [ 1107.289803][ T44] Not tainted 6.18.0-rc7-virtme #1 [ 1107.289949][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1107.290212][ T44] task:kworker/u16:0 state:D stack:26880 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 1107.290547][ T44] Workqueue: ipv6_addrconf addrconf_verify_work [ 1107.290719][ T44] Call Trace: [ 1107.290822][ T44] [ 1107.290895][ T44] __schedule+0x88d/0x1b90 [ 1107.291041][ T44] ? io_schedule_timeout+0x130/0x130 [ 1107.291183][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 1107.291319][ T44] ? __lock_release.isra.0+0x59/0x170 [ 1107.291461][ T44] ? __lock_release.isra.0+0x59/0x170 [ 1107.291587][ T44] schedule+0xd4/0x260 [ 1107.291684][ T44] schedule_preempt_disabled+0x18/0x30 [ 1107.291818][ T44] __mutex_lock+0x9ae/0x1500 [ 1107.291950][ T44] ? addrconf_verify_work+0x12/0x30 [ 1107.292083][ T44] ? ww_mutex_lock+0x160/0x160 [ 1107.292217][ T44] ? process_one_work+0xd16/0x1390 [ 1107.292347][ T44] ? trace_lock_acquire+0x88/0xd0 [ 1107.292485][ T44] ? trace_lock_acquire+0x88/0xd0 [ 1107.292608][ T44] ? addrconf_verify_work+0x12/0x30 [ 1107.292732][ T44] addrconf_verify_work+0x12/0x30 [ 1107.292857][ T44] process_one_work+0xd57/0x1390 [ 1107.292996][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 1107.293119][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 1107.293244][ T44] ? assign_work+0x152/0x380 [ 1107.293369][ T44] worker_thread+0x4d6/0xd40 [ 1107.293497][ T44] ? process_one_work+0x1390/0x1390 [ 1107.293613][ T44] kthread+0x355/0x5b0 [ 1107.293704][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 1107.293827][ T44] ? __lock_release.isra.0+0x59/0x170 [ 1107.293944][ T44] ? rcu_is_watching+0x15/0xd0 [ 1107.294066][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 1107.294182][ T44] ret_from_fork+0x1d4/0x270 [ 1107.294297][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 1107.294413][ T44] ret_from_fork_asm+0x11/0x20 [ 1107.294545][ T44] [ 1107.294666][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:5732. [ 1107.294877][ T44] INFO: task kworker/2:2:69 blocked for more than 245 seconds. [ 1107.295043][ T44] Not tainted 6.18.0-rc7-virtme #1 [ 1107.295151][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1107.295363][ T44] task:kworker/2:2 state:D stack:28240 pid:69 tgid:69 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 1107.295633][ T44] Workqueue: events xp_release_deferred [ 1107.295750][ T44] Call Trace: [ 1107.295835][ T44] [ 1107.295894][ T44] __schedule+0x88d/0x1b90 [ 1107.296021][ T44] ? io_schedule_timeout+0x130/0x130 [ 1107.296139][ T44] ? find_held_lock+0x2b/0x80 [ 1107.296254][ T44] ? __lock_release.isra.0+0x59/0x170 [ 1107.296370][ T44] schedule+0xd4/0x260 [ 1107.296474][ T44] schedule_preempt_disabled+0x18/0x30 [ 1107.296589][ T44] __mutex_lock+0x9ae/0x1500 [ 1107.296704][ T44] ? xp_release_deferred+0x1b/0x1e0 [ 1107.296821][ T44] ? ww_mutex_lock+0x160/0x160 [ 1107.296937][ T44] ? __lock_acquire+0x34c/0x740 [ 1107.297060][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 1107.297175][ T44] ? process_one_work+0xd16/0x1390 [ 1107.297312][ T44] ? xp_release_deferred+0x1b/0x1e0 [ 1107.297433][ T44] xp_release_deferred+0x1b/0x1e0 [ 1107.297549][ T44] process_one_work+0xd57/0x1390 [ 1107.297669][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 1107.297785][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 1107.297904][ T44] ? assign_work+0x152/0x380 [ 1107.298024][ T44] worker_thread+0x4d6/0xd40 [ 1107.298143][ T44] ? process_one_work+0x1390/0x1390 [ 1107.298263][ T44] ? __kthread_parkme+0xb3/0x200 [ 1107.298383][ T44] ? process_one_work+0x1390/0x1390 [ 1107.298507][ T44] kthread+0x355/0x5b0 [ 1107.298595][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 1107.298712][ T44] ? __lock_release.isra.0+0x59/0x170 [ 1107.298827][ T44] ? rcu_is_watching+0x15/0xd0 [ 1107.298944][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 1107.299064][ T44] ret_from_fork+0x1d4/0x270 [ 1107.299179][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 1107.299293][ T44] ret_from_fork_asm+0x11/0x20 [ 1107.299415][ T44] [ 1107.299520][ T44] INFO: task kworker/2:2:69 is blocked on a mutex likely owned by task ip:5732. [ 1107.299719][ T44] INFO: task ip:5732 blocked for more than 368 seconds. [ 1107.299857][ T44] Not tainted 6.18.0-rc7-virtme #1 [ 1107.299974][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1107.300169][ T44] task:ip state:D stack:25592 pid:5732 tgid:5732 ppid:1 task_flags:0x400100 flags:0x00080003 [ 1107.300433][ T44] Call Trace: [ 1107.300519][ T44] [ 1107.300580][ T44] __schedule+0x88d/0x1b90 [ 1107.300699][ T44] ? io_schedule_timeout+0x130/0x130 [ 1107.300819][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 1107.300936][ T44] ? __lock_release.isra.0+0x59/0x170 [ 1107.301054][ T44] ? __lock_release.isra.0+0x59/0x170 [ 1107.301172][ T44] schedule+0xd4/0x260 [ 1107.301261][ T44] schedule_preempt_disabled+0x18/0x30 [ 1107.301376][ T44] __mutex_lock+0x9ae/0x1500 [ 1107.301505][ T44] ? napi_enable+0x3b/0x80 [ 1107.301629][ T44] ? virtqueue_add_inbuf_ctx+0x1850/0x1850 [ 1107.301777][ T44] ? ww_mutex_lock+0x160/0x160 [ 1107.301900][ T44] ? __asan_memset+0x27/0x50 [ 1107.302029][ T44] ? sg_init_table+0x19/0x60 [ 1107.302147][ T44] ? try_fill_recv+0x3ec/0x1750 [ 1107.302268][ T44] ? napi_enable+0x3b/0x80 [ 1107.302386][ T44] napi_enable+0x3b/0x80 [ 1107.302482][ T44] __virtnet_rx_resume+0x156/0x290 [ 1107.302599][ T44] ? queue_delayed_work_on+0x91/0x100 [ 1107.302719][ T44] virtnet_rx_resume_all+0xe7/0x1a0 [ 1107.302837][ T44] virtnet_xdp_set+0xef7/0x1aa0 [ 1107.302962][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0 [ 1107.303079][ T44] dev_xdp_install+0x4ba/0x8e0 [ 1107.303197][ T44] ? netif_skb_check_for_xdp+0x600/0x600 [ 1107.303325][ T44] dev_xdp_attach+0x50d/0x1320 [ 1107.303451][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0 [ 1107.303571][ T44] ? mutex_is_locked+0x1c/0x50 [ 1107.303688][ T44] ? rtnl_is_locked+0x15/0x20 [ 1107.303805][ T44] ? dev_change_xdp_fd+0x9f/0x240 [ 1107.303924][ T44] do_setlink.isra.0+0x1c2d/0x2880 [ 1107.304046][ T44] ? rtnl_newlink_create+0x900/0x900 [ 1107.304166][ T44] ? rcu_lockdep_current_cpu_online+0x3e/0x1b0 [ 1107.304311][ T44] ? rcu_read_lock_any_held+0x41/0xa0 [ 1107.304438][ T44] ? validate_chain+0x287/0x5f0 [ 1107.304556][ T44] ? rcu_read_lock_any_held+0x6b/0xa0 [ 1107.304675][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 1107.304794][ T44] ? __lock_acquire+0x34c/0x740 [ 1107.304914][ T44] ? trace_lock_acquire+0x88/0xd0 [ 1107.305037][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 1107.305154][ T44] ? lock_acquire+0x31/0x80 [ 1107.305270][ T44] ? rtnl_newlink+0x5df/0xb20 [ 1107.305385][ T44] ? rcu_is_watching+0x15/0xd0 [ 1107.305509][ T44] ? rcu_is_watching+0x15/0xd0 [ 1107.305623][ T44] ? trace_contention_end+0xd6/0x140 [ 1107.305739][ T44] ? rtnl_newlink+0x5df/0xb20 [ 1107.305862][ T44] ? __mutex_lock+0x32e/0x1500 [ 1107.305986][ T44] ? ww_mutex_lock+0x160/0x160 [ 1107.306102][ T44] ? nla_validate_int_range+0x5b0/0x5b0 [ 1107.306222][ T44] ? __rtnl_newlink+0x3fa/0xa40 [ 1107.306341][ T44] rtnl_newlink+0x637/0xb20 [ 1107.306467][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 1107.306587][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 1107.306701][ T44] ? find_held_lock+0x2b/0x80 [ 1107.306817][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 1107.306938][ T44] ? __lock_release.isra.0+0x59/0x170 [ 1107.307061][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 1107.307180][ T44] rtnetlink_rcv_msg+0x6fe/0xb90 [ 1107.307300][ T44] ? rtnl_port_fill+0x940/0x940 [ 1107.307416][ T44] ? __lock_acquire+0x34c/0x740 [ 1107.307543][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 1107.307660][ T44] ? find_held_lock+0x2b/0x80 [ 1107.307778][ T44] netlink_rcv_skb+0x123/0x380 [ 1107.307894][ T44] ? rtnl_port_fill+0x940/0x940 [ 1107.308015][ T44] ? netlink_ack+0xcc0/0xcc0 [ 1107.308134][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 1107.308253][ T44] netlink_unicast+0x4a3/0x770 [ 1107.308370][ T44] ? netlink_attachskb+0x810/0x810 [ 1107.308492][ T44] ? __lock_acquire+0x34c/0x740 [ 1107.308611][ T44] netlink_sendmsg+0x735/0xc60 [ 1107.308733][ T44] ? netlink_unicast+0x770/0x770 [ 1107.308852][ T44] ? __might_fault+0x97/0x140 [ 1107.308975][ T44] ____sys_sendmsg+0x419/0x850 [ 1107.309091][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 1107.309205][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 1107.309354][ T44] ? move_addr_to_kernel+0x40/0x40 [ 1107.309477][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 1107.309594][ T44] ? validate_chain+0x287/0x5f0 [ 1107.309710][ T44] ___sys_sendmsg+0xfd/0x180 [ 1107.309824][ T44] ? __call_rcu_common.constprop.0+0xa5/0x680 [ 1107.309972][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 1107.310102][ T44] __sys_sendmsg+0x124/0x1c0 [ 1107.310219][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 1107.310333][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 1107.310458][ T44] ? __call_rcu_common.constprop.0+0x2fa/0x680 [ 1107.310605][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 1107.310722][ T44] ? rcu_is_watching+0x15/0xd0 [ 1107.310841][ T44] do_syscall_64+0xbb/0xfd0 [ 1107.310963][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1107.311107][ T44] RIP: 0033:0x7fadc30efc5e [ 1107.311230][ T44] RSP: 002b:00007fffefe81250 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 1107.311410][ T44] RAX: ffffffffffffffda RBX: 0000000000000004 RCX: 00007fadc30efc5e [ 1107.311590][ T44] RDX: 0000000000000000 RSI: 00007fffefe81310 RDI: 0000000000000003 [ 1107.311763][ T44] RBP: 00007fffefe81260 R08: 0000000000000000 R09: 0000000000000000 [ 1107.311938][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fffefe819d0 [ 1107.312126][ T44] R13: 00000000692f83d7 R14: 0000000000000000 R15: 0000000000499600 [ 1107.312309][ T44] [ 1107.312398][ T44] INFO: task ip:5732 is blocked on a mutex likely owned by task kworker/0:0:9. [ 1107.312600][ T44] task:kworker/0:0 state:D stack:28200 pid:9 tgid:9 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 1107.312859][ T44] Workqueue: events refill_work [ 1107.312983][ T44] Call Trace: [ 1107.313073][ T44] [ 1107.313136][ T44] __schedule+0x88d/0x1b90 [ 1107.313256][ T44] ? __lock_acquire+0x34c/0x740 [ 1107.313374][ T44] ? io_schedule_timeout+0x130/0x130 [ 1107.313497][ T44] ? usleep_range_state+0xba/0x1b0 [ 1107.313620][ T44] ? find_held_lock+0x2b/0x80 [ 1107.313744][ T44] ? __lock_release.isra.0+0x59/0x170 [ 1107.313867][ T44] ? usleep_range_state+0xba/0x1b0 [ 1107.313986][ T44] schedule+0xd4/0x260 [ 1107.314075][ T44] ? schedule_hrtimeout_range_clock+0x1da/0x2f0 [ 1107.314221][ T44] ? schedule_timeout_idle+0xe0/0xe0 [ 1107.314337][ T44] ? hrtimer_cb_get_time+0x90/0x90 [ 1107.314464][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 1107.314580][ T44] ? ktime_get+0x15e/0x220 [ 1107.314696][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 1107.314811][ T44] ? ktime_get+0xa9/0x220 [ 1107.314899][ T44] ? usleep_range_state+0x133/0x1b0 [ 1107.315018][ T44] ? schedule_hrtimeout+0x20/0x20 [ 1107.315133][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 1107.315251][ T44] ? napi_disable_locked+0x379/0x5f0 [ 1107.315366][ T44] ? _mutex_trylock_nest_lock+0x150/0x150 [ 1107.315494][ T44] ? netdev_bind_sb_channel_queue+0x470/0x470 [ 1107.315640][ T44] ? napi_disable+0x43/0x80 [ 1107.315755][ T44] ? refill_work+0x116/0x210 [ 1107.315874][ T44] ? process_one_work+0xd57/0x1390 [ 1107.315994][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 1107.316109][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 1107.316229][ T44] ? assign_work+0x152/0x380 [ 1107.316355][ T44] ? worker_thread+0x4d6/0xd40 [ 1107.316482][ T44] ? process_one_work+0x1390/0x1390 [ 1107.316599][ T44] ? kthread+0x355/0x5b0 [ 1107.316688][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 1107.316807][ T44] ? __lock_release.isra.0+0x59/0x170 [ 1107.316925][ T44] ? rcu_is_watching+0x15/0xd0 [ 1107.317044][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 1107.317166][ T44] ? ret_from_fork+0x1d4/0x270 [ 1107.317286][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 1107.317467][ T44] ? ret_from_fork_asm+0x11/0x20 [ 1107.317590][ T44] [ 1107.317687][ T44] INFO: task ip:5796 blocked for more than 245 seconds. [ 1107.317821][ T44] Not tainted 6.18.0-rc7-virtme #1 [ 1107.317931][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1107.318124][ T44] task:ip state:D stack:25744 pid:5796 tgid:5796 ppid:5795 task_flags:0x400100 flags:0x00080001 [ 1107.318441][ T44] Call Trace: [ 1107.318527][ T44] [ 1107.318587][ T44] __schedule+0x88d/0x1b90 [ 1107.318710][ T44] ? io_schedule_timeout+0x130/0x130 [ 1107.318834][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 1107.318959][ T44] ? __lock_release.isra.0+0x59/0x170 [ 1107.319073][ T44] ? __lock_release.isra.0+0x59/0x170 [ 1107.319190][ T44] schedule+0xd4/0x260 [ 1107.319278][ T44] schedule_preempt_disabled+0x18/0x30 [ 1107.319460][ T44] __mutex_lock+0x9ae/0x1500 [ 1107.319576][ T44] ? rtnetlink_rcv_msg+0x2ab/0xb90 [ 1107.319694][ T44] ? write_profile+0xf0/0xf0 [ 1107.319811][ T44] ? ww_mutex_lock+0x160/0x160 [ 1107.319931][ T44] ? find_held_lock+0x2b/0x80 [ 1107.320050][ T44] ? __lock_release.isra.0+0x59/0x170 [ 1107.320168][ T44] ? rtnetlink_rcv_msg+0x2ab/0xb90 [ 1107.320284][ T44] rtnetlink_rcv_msg+0x2ab/0xb90 [ 1107.320467][ T44] ? rtnl_port_fill+0x940/0x940 [ 1107.320583][ T44] ? __lock_acquire+0x34c/0x740 [ 1107.320701][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 1107.320821][ T44] ? find_held_lock+0x2b/0x80 [ 1107.320999][ T44] netlink_rcv_skb+0x123/0x380 [ 1107.321116][ T44] ? rtnl_port_fill+0x940/0x940 [ 1107.321236][ T44] ? netlink_ack+0xcc0/0xcc0 [ 1107.321360][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 1107.321542][ T44] netlink_unicast+0x4a3/0x770 [ 1107.321660][ T44] ? netlink_attachskb+0x810/0x810 [ 1107.321778][ T44] ? __lock_acquire+0x34c/0x740 [ 1107.321897][ T44] netlink_sendmsg+0x735/0xc60 [ 1107.322072][ T44] ? netlink_unicast+0x770/0x770 [ 1107.322189][ T44] ? __might_fault+0x97/0x140 [ 1107.322305][ T44] ____sys_sendmsg+0x419/0x850 [ 1107.322422][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 1107.322604][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 1107.322748][ T44] ? move_addr_to_kernel+0x40/0x40 [ 1107.322869][ T44] ? rcu_lockdep_current_cpu_online+0x3e/0x1b0 [ 1107.323075][ T44] ___sys_sendmsg+0xfd/0x180 [ 1107.323192][ T44] ? validate_chain+0x287/0x5f0 [ 1107.323306][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 1107.323436][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 1107.323606][ T44] ? __might_fault+0x97/0x140 [ 1107.323729][ T44] ? _copy_to_user+0x4b/0x70 [ 1107.323848][ T44] __sys_sendmsg+0x124/0x1c0 [ 1107.323968][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 1107.324146][ T44] ? rcu_is_watching+0x15/0xd0 [ 1107.324264][ T44] do_syscall_64+0xbb/0xfd0 [ 1107.324384][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1107.324532][ T44] RIP: 0033:0x7fd1bfe32c5e [ 1107.324715][ T44] RSP: 002b:00007ffec1216580 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 1107.324891][ T44] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fd1bfe32c5e [ 1107.325072][ T44] RDX: 0000000000000000 RSI: 00007ffec1216640 RDI: 0000000000000004 [ 1107.325304][ T44] RBP: 00007ffec1216590 R08: 0000000000000000 R09: 0000000000000000 [ 1107.325481][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffec12186bf [ 1107.325656][ T44] R13: 00000000692f84a7 R14: 000000000000000d R15: 00007ffec12166f0 [ 1107.325890][ T44] [ 1107.325996][ T44] INFO: task ip:5796 is blocked on a mutex likely owned by task ip:5732. [ 1107.326164][ T44] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings [ 1107.326410][ T44] [ 1107.326410][ T44] Showing all locks held in the system: [ 1107.326590][ T44] 3 locks held by kworker/0:0/9: [ 1107.326708][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 1107.326991][ T44] #1: ffa0000000097d30 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 1107.327298][ T44] #2: ff110000087cac98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 1107.327504][ T44] 3 locks held by kworker/u16:0/12: [ 1107.327615][ T44] #0: ff110000091ecd48 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 1107.327893][ T44] #1: ffa00000000c7d30 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 1107.328175][ T44] #2: ffffffff8b6925e8 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 1107.328382][ T44] 1 lock held by khungtaskd/44: [ 1107.328498][ T44] #0: ffffffff8af78fc0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x2b/0x1db [ 1107.328701][ T44] 3 locks held by kworker/2:2/69: [ 1107.328866][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 1107.329096][ T44] #1: ffa00000004a7d30 ((work_completion)(&pool->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 1107.329378][ T44] #2: ffffffff8b6925e8 (rtnl_mutex){+.+.}-{4:4}, at: xp_release_deferred+0x1b/0x1e0 [ 1107.329589][ T44] 2 locks held by ip/5732: [ 1107.329701][ T44] #0: ffffffff8b6925e8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x5df/0xb20 [ 1107.329957][ T44] #1: ff110000087cac98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80 [ 1107.330164][ T44] 1 lock held by ip/5796: [ 1107.330247][ T44] #0: ffffffff8b6925e8 (rtnl_mutex){+.+.}-{4:4}, at: rtnetlink_rcv_msg+0x2ab/0xb90 [ 1107.330454][ T44] [ 1107.330515][ T44] ============================================= [ 1107.330515][ T44]