[ 369.983552][ T44] INFO: task ip:977 blocked for more than 122 seconds. [ 369.984009][ T44] Not tainted 6.18.0-rc7-virtme #1 [ 369.984227][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 369.984572][ T44] task:ip state:D stack:25592 pid:977 tgid:977 ppid:1 task_flags:0x400100 flags:0x00080003 [ 369.984950][ T44] Call Trace: [ 369.985103][ T44] [ 369.985250][ T44] __schedule+0x88d/0x1b90 [ 369.985468][ T44] ? io_schedule_timeout+0x130/0x130 [ 369.985671][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 369.985884][ T44] ? __lock_release.isra.0+0x59/0x170 [ 369.986068][ T44] ? __lock_release.isra.0+0x59/0x170 [ 369.986279][ T44] schedule+0xd4/0x260 [ 369.986423][ T44] schedule_preempt_disabled+0x18/0x30 [ 369.986631][ T44] __mutex_lock+0x9ae/0x1500 [ 369.986799][ T44] ? napi_enable+0x3b/0x80 [ 369.986997][ T44] ? virtqueue_add_inbuf_ctx+0x1850/0x1850 [ 369.987225][ T44] ? ww_mutex_lock+0x160/0x160 [ 369.987394][ T44] ? __asan_memset+0x27/0x50 [ 369.987594][ T44] ? sg_init_table+0x19/0x60 [ 369.987762][ T44] ? try_fill_recv+0x3ec/0x1750 [ 369.987955][ T44] ? napi_enable+0x3b/0x80 [ 369.988120][ T44] napi_enable+0x3b/0x80 [ 369.988289][ T44] __virtnet_rx_resume+0x156/0x290 [ 369.988452][ T44] ? queue_delayed_work_on+0x91/0x100 [ 369.988655][ T44] virtnet_rx_resume_all+0xe7/0x1a0 [ 369.988828][ T44] virtnet_xdp_set+0xef7/0x1aa0 [ 369.989026][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0 [ 369.989199][ T44] dev_xdp_install+0x4ba/0x8e0 [ 369.989389][ T44] ? netif_skb_check_for_xdp+0x600/0x600 [ 369.989837][ T44] dev_xdp_attach+0x50d/0x1320 [ 369.990012][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0 [ 369.990215][ T44] ? mutex_is_locked+0x1c/0x50 [ 369.990382][ T44] ? rtnl_is_locked+0x15/0x20 [ 369.990576][ T44] ? dev_change_xdp_fd+0x9f/0x240 [ 369.990742][ T44] do_setlink.isra.0+0x1c2d/0x2880 [ 369.990934][ T44] ? rtnl_newlink_create+0x900/0x900 [ 369.991099][ T44] ? rcu_lockdep_current_cpu_online+0x3e/0x1b0 [ 369.991326][ T44] ? rcu_read_lock_any_held+0x41/0xa0 [ 369.991493][ T44] ? validate_chain+0x287/0x5f0 [ 369.991690][ T44] ? rcu_read_lock_any_held+0x6b/0xa0 [ 369.991856][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 369.992047][ T44] ? __lock_acquire+0x34c/0x740 [ 369.992224][ T44] ? trace_lock_acquire+0x88/0xd0 [ 369.992412][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 369.992604][ T44] ? lock_acquire+0x31/0x80 [ 369.992770][ T44] ? rtnl_newlink+0x5df/0xb20 [ 369.992958][ T44] ? rcu_is_watching+0x15/0xd0 [ 369.993123][ T44] ? rcu_is_watching+0x15/0xd0 [ 369.993312][ T44] ? trace_contention_end+0xd6/0x140 [ 369.993477][ T44] ? rtnl_newlink+0x5df/0xb20 [ 369.993667][ T44] ? __mutex_lock+0x32e/0x1500 [ 369.993836][ T44] ? ww_mutex_lock+0x160/0x160 [ 369.994025][ T44] ? nla_validate_int_range+0x5b0/0x5b0 [ 369.994202][ T44] ? __rtnl_newlink+0x3fa/0xa40 [ 369.994398][ T44] rtnl_newlink+0x637/0xb20 [ 369.994597][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 369.994774][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 369.994965][ T44] ? find_held_lock+0x2b/0x80 [ 369.995131][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 369.995329][ T44] ? __lock_release.isra.0+0x59/0x170 [ 369.995500][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 369.995696][ T44] rtnetlink_rcv_msg+0x6fe/0xb90 [ 369.995916][ T44] ? rtnl_port_fill+0x940/0x940 [ 369.996082][ T44] ? __lock_acquire+0x34c/0x740 [ 369.996278][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 369.996444][ T44] ? find_held_lock+0x2b/0x80 [ 369.996640][ T44] netlink_rcv_skb+0x123/0x380 [ 369.996808][ T44] ? rtnl_port_fill+0x940/0x940 [ 369.997002][ T44] ? netlink_ack+0xcc0/0xcc0 [ 369.997176][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 369.997378][ T44] netlink_unicast+0x4a3/0x770 [ 369.997571][ T44] ? netlink_attachskb+0x810/0x810 [ 369.997737][ T44] ? __lock_acquire+0x34c/0x740 [ 369.997931][ T44] netlink_sendmsg+0x735/0xc60 [ 369.998098][ T44] ? netlink_unicast+0x770/0x770 [ 369.998293][ T44] ? __might_fault+0x97/0x140 [ 369.998461][ T44] ____sys_sendmsg+0x419/0x850 [ 369.998663][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 369.998828][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 369.999042][ T44] ? move_addr_to_kernel+0x40/0x40 [ 369.999211][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 369.999398][ T44] ? validate_chain+0x287/0x5f0 [ 369.999593][ T44] ___sys_sendmsg+0xfd/0x180 [ 369.999758][ T44] ? __call_rcu_common.constprop.0+0xa5/0x680 [ 369.999982][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 370.000159][ T44] __sys_sendmsg+0x124/0x1c0 [ 370.000350][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 370.000545][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 370.000708][ T44] ? __call_rcu_common.constprop.0+0x2fa/0x680 [ 370.000925][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 370.001091][ T44] ? rcu_is_watching+0x15/0xd0 [ 370.001290][ T44] do_syscall_64+0xbb/0xfd0 [ 370.001457][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 370.001678][ T44] RIP: 0033:0x7f4d27ecec5e [ 370.001852][ T44] RSP: 002b:00007ffc557866d0 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 370.002106][ T44] RAX: ffffffffffffffda RBX: 0000000000000004 RCX: 00007f4d27ecec5e [ 370.002355][ T44] RDX: 0000000000000000 RSI: 00007ffc55786790 RDI: 0000000000000003 [ 370.002612][ T44] RBP: 00007ffc557866e0 R08: 0000000000000000 R09: 0000000000000000 [ 370.002860][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffc55786e50 [ 370.003106][ T44] R13: 00000000692f0ea5 R14: 0000000000000000 R15: 0000000000499600 [ 370.003361][ T44] [ 370.003533][ T44] INFO: task ip:977 is blocked on a mutex likely owned by task kworker/2:2:64. [ 370.003802][ T44] task:kworker/2:2 state:D stack:28904 pid:64 tgid:64 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 370.004131][ T44] Workqueue: events refill_work [ 370.004306][ T44] Call Trace: [ 370.004462][ T44] [ 370.004598][ T44] __schedule+0x88d/0x1b90 [ 370.004770][ T44] ? io_schedule_timeout+0x130/0x130 [ 370.004967][ T44] ? usleep_range_state+0xba/0x1b0 [ 370.005131][ T44] ? find_held_lock+0x2b/0x80 [ 370.005325][ T44] ? __lock_release.isra.0+0x59/0x170 [ 370.005491][ T44] ? usleep_range_state+0xba/0x1b0 [ 370.005683][ T44] schedule+0xd4/0x260 [ 370.005819][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0 [ 370.006037][ T44] ? schedule_timeout_idle+0xe0/0xe0 [ 370.006214][ T44] ? hrtimer_cb_get_time+0x90/0x90 [ 370.006405][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 370.006596][ T44] ? ktime_get+0x15e/0x220 [ 370.006759][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 370.006944][ T44] ? ktime_get+0xa9/0x220 [ 370.007082][ T44] usleep_range_state+0x133/0x1b0 [ 370.007280][ T44] ? schedule_hrtimeout+0x20/0x20 [ 370.007450][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 370.007647][ T44] napi_disable_locked+0x379/0x5f0 [ 370.007811][ T44] ? _mutex_trylock_nest_lock+0x150/0x150 [ 370.007999][ T44] ? netdev_bind_sb_channel_queue+0x470/0x470 [ 370.008223][ T44] napi_disable+0x43/0x80 [ 370.008359][ T44] refill_work+0x116/0x210 [ 370.008561][ T44] process_one_work+0xd57/0x1390 [ 370.008734][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 370.008925][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 370.009091][ T44] ? assign_work+0x152/0x380 [ 370.009285][ T44] worker_thread+0x4d6/0xd40 [ 370.009452][ T44] ? process_one_work+0x1390/0x1390 [ 370.009645][ T44] ? __kthread_parkme+0xb3/0x200 [ 370.009813][ T44] ? process_one_work+0x1390/0x1390 [ 370.010007][ T44] kthread+0x355/0x5b0 [ 370.010145][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 370.010339][ T44] ? __lock_release.isra.0+0x59/0x170 [ 370.010530][ T44] ? rcu_is_watching+0x15/0xd0 [ 370.010695][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 370.010882][ T44] ret_from_fork+0x1d4/0x270 [ 370.011046][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 370.011239][ T44] ret_from_fork_asm+0x11/0x20 [ 370.011416][ T44] [ 370.011601][ T44] [ 370.011601][ T44] Showing all locks held in the system: [ 370.011837][ T44] 3 locks held by kworker/u16:0/12: [ 370.011996][ T44] #0: ff11000008b0cd48 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 370.012307][ T44] #1: ffa00000000c7d30 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 370.012729][ T44] #2: ffffffffbc6925e8 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 370.013000][ T44] 1 lock held by khungtaskd/44: [ 370.013158][ T44] #0: ffffffffbbf78fc0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x2b/0x1db [ 370.013438][ T44] 3 locks held by kworker/2:2/64: [ 370.013627][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 370.013924][ T44] #1: ffa0000000457d30 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 370.014252][ T44] #2: ff110000084dac98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 370.014534][ T44] 3 locks held by kworker/3:1/71: [ 370.014692][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 370.014993][ T44] #1: ffa00000004c7d30 ((work_completion)(&pool->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 370.015295][ T44] #2: ffffffffbc6925e8 (rtnl_mutex){+.+.}-{4:4}, at: xp_release_deferred+0x1b/0x1e0 [ 370.015572][ T44] 2 locks held by ip/977: [ 370.015703][ T44] #0: ffffffffbc6925e8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x5df/0xb20 [ 370.015980][ T44] #1: ff110000084dac98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80 [ 370.016255][ T44] 1 lock held by ip/1041: [ 370.016386][ T44] #0: ffffffffbc6925e8 (rtnl_mutex){+.+.}-{4:4}, at: rtnetlink_rcv_msg+0x2ab/0xb90 [ 370.016669][ T44] [ 370.016773][ T44] ============================================= [ 370.016773][ T44] [ 492.863532][ T44] INFO: task kworker/u16:0:12 blocked for more than 122 seconds. [ 492.863964][ T44] Not tainted 6.18.0-rc7-virtme #1 [ 492.864187][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 492.864487][ T44] task:kworker/u16:0 state:D stack:28040 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 492.864901][ T44] Workqueue: ipv6_addrconf addrconf_verify_work [ 492.865149][ T44] Call Trace: [ 492.865302][ T44] [ 492.865442][ T44] __schedule+0x88d/0x1b90 [ 492.865665][ T44] ? io_schedule_timeout+0x130/0x130 [ 492.865851][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.866057][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.866275][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.866465][ T44] schedule+0xd4/0x260 [ 492.866666][ T44] schedule_preempt_disabled+0x18/0x30 [ 492.866849][ T44] __mutex_lock+0x9ae/0x1500 [ 492.867041][ T44] ? addrconf_verify_work+0x12/0x30 [ 492.867219][ T44] ? ww_mutex_lock+0x160/0x160 [ 492.867416][ T44] ? process_one_work+0xd16/0x1390 [ 492.867622][ T44] ? trace_lock_acquire+0x88/0xd0 [ 492.867788][ T44] ? trace_lock_acquire+0x88/0xd0 [ 492.867980][ T44] ? addrconf_verify_work+0x12/0x30 [ 492.868143][ T44] addrconf_verify_work+0x12/0x30 [ 492.868331][ T44] process_one_work+0xd57/0x1390 [ 492.868502][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 492.868697][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.868885][ T44] ? assign_work+0x152/0x380 [ 492.869062][ T44] worker_thread+0x4d6/0xd40 [ 492.869262][ T44] ? process_one_work+0x1390/0x1390 [ 492.869428][ T44] kthread+0x355/0x5b0 [ 492.869597][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.869765][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.869956][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.870122][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.870325][ T44] ret_from_fork+0x1d4/0x270 [ 492.870492][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.870691][ T44] ret_from_fork_asm+0x11/0x20 [ 492.870865][ T44] [ 492.871047][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:977. [ 492.871330][ T44] INFO: task kworker/3:1:71 blocked for more than 122 seconds. [ 492.871569][ T44] Not tainted 6.18.0-rc7-virtme #1 [ 492.871732][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 492.871992][ T44] task:kworker/3:1 state:D stack:28904 pid:71 tgid:71 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 492.872319][ T44] Workqueue: events xp_release_deferred [ 492.872487][ T44] Call Trace: [ 492.872649][ T44] [ 492.872757][ T44] __schedule+0x88d/0x1b90 [ 492.872955][ T44] ? io_schedule_timeout+0x130/0x130 [ 492.873123][ T44] ? find_held_lock+0x2b/0x80 [ 492.873319][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.873501][ T44] schedule+0xd4/0x260 [ 492.873667][ T44] schedule_preempt_disabled+0x18/0x30 [ 492.873856][ T44] __mutex_lock+0x9ae/0x1500 [ 492.874022][ T44] ? xp_release_deferred+0x1b/0x1e0 [ 492.874224][ T44] ? ww_mutex_lock+0x160/0x160 [ 492.874389][ T44] ? __lock_acquire+0x34c/0x740 [ 492.874586][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.874750][ T44] ? process_one_work+0xd16/0x1390 [ 492.874942][ T44] ? xp_release_deferred+0x1b/0x1e0 [ 492.875106][ T44] xp_release_deferred+0x1b/0x1e0 [ 492.875300][ T44] process_one_work+0xd57/0x1390 [ 492.875474][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 492.875669][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.875837][ T44] ? assign_work+0x152/0x380 [ 492.876029][ T44] worker_thread+0x4d6/0xd40 [ 492.876203][ T44] ? process_one_work+0x1390/0x1390 [ 492.876391][ T44] ? __kthread_parkme+0xb3/0x200 [ 492.876587][ T44] ? process_one_work+0x1390/0x1390 [ 492.876772][ T44] kthread+0x355/0x5b0 [ 492.876933][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.877120][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.877292][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.877480][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.877672][ T44] ret_from_fork+0x1d4/0x270 [ 492.877836][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.878025][ T44] ret_from_fork_asm+0x11/0x20 [ 492.878206][ T44] [ 492.878367][ T44] INFO: task kworker/3:1:71 is blocked on a mutex likely owned by task ip:977. [ 492.878638][ T44] INFO: task ip:977 blocked for more than 245 seconds. [ 492.878820][ T44] Not tainted 6.18.0-rc7-virtme #1 [ 492.879000][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 492.879265][ T44] task:ip state:D stack:25592 pid:977 tgid:977 ppid:1 task_flags:0x400100 flags:0x00080003 [ 492.879598][ T44] Call Trace: [ 492.879731][ T44] [ 492.879860][ T44] __schedule+0x88d/0x1b90 [ 492.880027][ T44] ? io_schedule_timeout+0x130/0x130 [ 492.880224][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.880392][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.880592][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.880758][ T44] schedule+0xd4/0x260 [ 492.880920][ T44] schedule_preempt_disabled+0x18/0x30 [ 492.881082][ T44] __mutex_lock+0x9ae/0x1500 [ 492.881273][ T44] ? napi_enable+0x3b/0x80 [ 492.881440][ T44] ? virtqueue_add_inbuf_ctx+0x1850/0x1850 [ 492.881666][ T44] ? ww_mutex_lock+0x160/0x160 [ 492.881831][ T44] ? __asan_memset+0x27/0x50 [ 492.882026][ T44] ? sg_init_table+0x19/0x60 [ 492.882198][ T44] ? try_fill_recv+0x3ec/0x1750 [ 492.882389][ T44] ? napi_enable+0x3b/0x80 [ 492.882583][ T44] napi_enable+0x3b/0x80 [ 492.882721][ T44] __virtnet_rx_resume+0x156/0x290 [ 492.882908][ T44] ? queue_delayed_work_on+0x91/0x100 [ 492.883075][ T44] virtnet_rx_resume_all+0xe7/0x1a0 [ 492.883273][ T44] virtnet_xdp_set+0xef7/0x1aa0 [ 492.883445][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0 [ 492.883638][ T44] dev_xdp_install+0x4ba/0x8e0 [ 492.883805][ T44] ? netif_skb_check_for_xdp+0x600/0x600 [ 492.883997][ T44] dev_xdp_attach+0x50d/0x1320 [ 492.884165][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0 [ 492.884360][ T44] ? mutex_is_locked+0x1c/0x50 [ 492.884563][ T44] ? rtnl_is_locked+0x15/0x20 [ 492.884729][ T44] ? dev_change_xdp_fd+0x9f/0x240 [ 492.884921][ T44] do_setlink.isra.0+0x1c2d/0x2880 [ 492.885090][ T44] ? rtnl_newlink_create+0x900/0x900 [ 492.885288][ T44] ? rcu_lockdep_current_cpu_online+0x3e/0x1b0 [ 492.885516][ T44] ? rcu_read_lock_any_held+0x41/0xa0 [ 492.885679][ T44] ? validate_chain+0x287/0x5f0 [ 492.885873][ T44] ? rcu_read_lock_any_held+0x6b/0xa0 [ 492.886037][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 492.886235][ T44] ? __lock_acquire+0x34c/0x740 [ 492.886406][ T44] ? trace_lock_acquire+0x88/0xd0 [ 492.886599][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 492.886764][ T44] ? lock_acquire+0x31/0x80 [ 492.886949][ T44] ? rtnl_newlink+0x5df/0xb20 [ 492.887111][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.887311][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.887478][ T44] ? trace_contention_end+0xd6/0x140 [ 492.887671][ T44] ? rtnl_newlink+0x5df/0xb20 [ 492.887836][ T44] ? __mutex_lock+0x32e/0x1500 [ 492.888026][ T44] ? ww_mutex_lock+0x160/0x160 [ 492.888195][ T44] ? nla_validate_int_range+0x5b0/0x5b0 [ 492.888384][ T44] ? __rtnl_newlink+0x3fa/0xa40 [ 492.888587][ T44] rtnl_newlink+0x637/0xb20 [ 492.888754][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 492.888946][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.889110][ T44] ? find_held_lock+0x2b/0x80 [ 492.889306][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 492.889470][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.889664][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 492.889828][ T44] rtnetlink_rcv_msg+0x6fe/0xb90 [ 492.890024][ T44] ? rtnl_port_fill+0x940/0x940 [ 492.890194][ T44] ? __lock_acquire+0x34c/0x740 [ 492.890387][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.890579][ T44] ? find_held_lock+0x2b/0x80 [ 492.890744][ T44] netlink_rcv_skb+0x123/0x380 [ 492.890934][ T44] ? rtnl_port_fill+0x940/0x940 [ 492.891099][ T44] ? netlink_ack+0xcc0/0xcc0 [ 492.891300][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 492.891471][ T44] netlink_unicast+0x4a3/0x770 [ 492.891668][ T44] ? netlink_attachskb+0x810/0x810 [ 492.891835][ T44] ? __lock_acquire+0x34c/0x740 [ 492.892026][ T44] netlink_sendmsg+0x735/0xc60 [ 492.892197][ T44] ? netlink_unicast+0x770/0x770 [ 492.892386][ T44] ? __might_fault+0x97/0x140 [ 492.892584][ T44] ____sys_sendmsg+0x419/0x850 [ 492.892753][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 492.892946][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 492.893159][ T44] ? move_addr_to_kernel+0x40/0x40 [ 492.893328][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 492.893531][ T44] ? validate_chain+0x287/0x5f0 [ 492.893698][ T44] ___sys_sendmsg+0xfd/0x180 [ 492.893890][ T44] ? __call_rcu_common.constprop.0+0xa5/0x680 [ 492.894111][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 492.894290][ T44] __sys_sendmsg+0x124/0x1c0 [ 492.894475][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 492.894662][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 492.894824][ T44] ? __call_rcu_common.constprop.0+0x2fa/0x680 [ 492.895040][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 492.895210][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.895404][ T44] do_syscall_64+0xbb/0xfd0 [ 492.895598][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 492.895814][ T44] RIP: 0033:0x7f4d27ecec5e [ 492.895984][ T44] RSP: 002b:00007ffc557866d0 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 492.896237][ T44] RAX: ffffffffffffffda RBX: 0000000000000004 RCX: 00007f4d27ecec5e [ 492.896477][ T44] RDX: 0000000000000000 RSI: 00007ffc55786790 RDI: 0000000000000003 [ 492.896726][ T44] RBP: 00007ffc557866e0 R08: 0000000000000000 R09: 0000000000000000 [ 492.896970][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffc55786e50 [ 492.897219][ T44] R13: 00000000692f0ea5 R14: 0000000000000000 R15: 0000000000499600 [ 492.897469][ T44] [ 492.897631][ T44] INFO: task ip:977 is blocked on a mutex likely owned by task kworker/2:2:64. [ 492.897898][ T44] task:kworker/2:2 state:D stack:28904 pid:64 tgid:64 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 492.898236][ T44] Workqueue: events refill_work [ 492.898402][ T44] Call Trace: [ 492.898564][ T44] [ 492.898672][ T44] __schedule+0x88d/0x1b90 [ 492.898866][ T44] ? io_schedule_timeout+0x130/0x130 [ 492.899037][ T44] ? usleep_range_state+0xba/0x1b0 [ 492.899236][ T44] ? find_held_lock+0x2b/0x80 [ 492.899404][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.899599][ T44] ? usleep_range_state+0xba/0x1b0 [ 492.899762][ T44] schedule+0xd4/0x260 [ 492.899921][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0 [ 492.900137][ T44] ? schedule_timeout_idle+0xe0/0xe0 [ 492.900313][ T44] ? hrtimer_cb_get_time+0x90/0x90 [ 492.900516][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 492.900681][ T44] ? ktime_get+0x15e/0x220 [ 492.900869][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 492.901032][ T44] ? ktime_get+0xa9/0x220 [ 492.901197][ T44] usleep_range_state+0x133/0x1b0 [ 492.901365][ T44] ? schedule_hrtimeout+0x20/0x20 [ 492.901565][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 492.901734][ T44] napi_disable_locked+0x379/0x5f0 [ 492.901923][ T44] ? _mutex_trylock_nest_lock+0x150/0x150 [ 492.902086][ T44] ? netdev_bind_sb_channel_queue+0x470/0x470 [ 492.902313][ T44] napi_disable+0x43/0x80 [ 492.902450][ T44] refill_work+0x116/0x210 [ 492.902647][ T44] process_one_work+0xd57/0x1390 [ 492.902820][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 492.903011][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.903185][ T44] ? assign_work+0x152/0x380 [ 492.903373][ T44] worker_thread+0x4d6/0xd40 [ 492.903568][ T44] ? process_one_work+0x1390/0x1390 [ 492.903733][ T44] ? __kthread_parkme+0xb3/0x200 [ 492.904016][ T44] ? process_one_work+0x1390/0x1390 [ 492.904193][ T44] kthread+0x355/0x5b0 [ 492.904354][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.904546][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.904711][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.904959][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.905124][ T44] ret_from_fork+0x1d4/0x270 [ 492.905315][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.905480][ T44] ret_from_fork_asm+0x11/0x20 [ 492.905685][ T44] [ 492.905828][ T44] INFO: task ip:1041 blocked for more than 122 seconds. [ 492.906033][ T44] Not tainted 6.18.0-rc7-virtme #1 [ 492.906196][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 492.906520][ T44] task:ip state:D stack:25744 pid:1041 tgid:1041 ppid:1040 task_flags:0x400100 flags:0x00080001 [ 492.906898][ T44] Call Trace: [ 492.907028][ T44] [ 492.907160][ T44] __schedule+0x88d/0x1b90 [ 492.907336][ T44] ? io_schedule_timeout+0x130/0x130 [ 492.907537][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.907781][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.907943][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.908130][ T44] schedule+0xd4/0x260 [ 492.908277][ T44] schedule_preempt_disabled+0x18/0x30 [ 492.908527][ T44] __mutex_lock+0x9ae/0x1500 [ 492.908708][ T44] ? rtnetlink_rcv_msg+0x2ab/0xb90 [ 492.908872][ T44] ? write_profile+0xf0/0xf0 [ 492.909064][ T44] ? ww_mutex_lock+0x160/0x160 [ 492.909239][ T44] ? find_held_lock+0x2b/0x80 [ 492.909484][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.909688][ T44] ? rtnetlink_rcv_msg+0x2ab/0xb90 [ 492.909851][ T44] rtnetlink_rcv_msg+0x2ab/0xb90 [ 492.910091][ T44] ? rtnl_port_fill+0x940/0x940 [ 492.910283][ T44] ? __lock_acquire+0x34c/0x740 [ 492.910451][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.910645][ T44] ? find_held_lock+0x2b/0x80 [ 492.910810][ T44] netlink_rcv_skb+0x123/0x380 [ 492.911056][ T44] ? rtnl_port_fill+0x940/0x940 [ 492.911235][ T44] ? netlink_ack+0xcc0/0xcc0 [ 492.911430][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 492.911685][ T44] netlink_unicast+0x4a3/0x770 [ 492.911852][ T44] ? netlink_attachskb+0x810/0x810 [ 492.912041][ T44] ? __lock_acquire+0x34c/0x740 [ 492.912213][ T44] netlink_sendmsg+0x735/0xc60 [ 492.912451][ T44] ? netlink_unicast+0x770/0x770 [ 492.912647][ T44] ? __might_fault+0x97/0x140 [ 492.912812][ T44] ____sys_sendmsg+0x419/0x850 [ 492.913002][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 492.913164][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 492.913439][ T44] ? move_addr_to_kernel+0x40/0x40 [ 492.913632][ T44] ? rcu_lockdep_current_cpu_online+0x3e/0x1b0 [ 492.913848][ T44] ___sys_sendmsg+0xfd/0x180 [ 492.914090][ T44] ? validate_chain+0x287/0x5f0 [ 492.914265][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 492.914472][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.914658][ T44] ? __might_fault+0x97/0x140 [ 492.914906][ T44] ? _copy_to_user+0x4b/0x70 [ 492.915072][ T44] __sys_sendmsg+0x124/0x1c0 [ 492.915266][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 492.915433][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.915692][ T44] do_syscall_64+0xbb/0xfd0 [ 492.915859][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 492.916072][ T44] RIP: 0033:0x7f0812501c5e [ 492.916246][ T44] RSP: 002b:00007fffde73daa0 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 492.916555][ T44] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f0812501c5e [ 492.916796][ T44] RDX: 0000000000000000 RSI: 00007fffde73db60 RDI: 0000000000000004 [ 492.917101][ T44] RBP: 00007fffde73dab0 R08: 0000000000000000 R09: 0000000000000000 [ 492.917344][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fffde73f6bd [ 492.917589][ T44] R13: 00000000692f0f75 R14: 000000000000000d R15: 00007fffde73dc10 [ 492.917898][ T44] [ 492.918035][ T44] INFO: task ip:1041 is blocked on a mutex likely owned by task ip:977. [ 492.918292][ T44] [ 492.918292][ T44] Showing all locks held in the system: [ 492.918671][ T44] 3 locks held by kworker/u16:0/12: [ 492.918858][ T44] #0: ff11000008b0cd48 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 492.919153][ T44] #1: ffa00000000c7d30 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 492.919524][ T44] #2: ffffffffbc6925e8 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 492.919791][ T44] 1 lock held by khungtaskd/44: [ 492.919948][ T44] #0: ffffffffbbf78fc0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x2b/0x1db [ 492.920275][ T44] 3 locks held by kworker/2:2/64: [ 492.920457][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 492.920752][ T44] #1: ffa0000000457d30 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 492.921127][ T44] #2: ff110000084dac98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 492.921398][ T44] 3 locks held by kworker/3:1/71: [ 492.921735][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 492.922029][ T44] #1: ffa00000004c7d30 ((work_completion)(&pool->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 492.922329][ T44] #2: ffffffffbc6925e8 (rtnl_mutex){+.+.}-{4:4}, at: xp_release_deferred+0x1b/0x1e0 [ 492.922603][ T44] 2 locks held by ip/977: [ 492.922737][ T44] #0: ffffffffbc6925e8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x5df/0xb20 [ 492.923010][ T44] #1: ff110000084dac98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80 [ 492.923289][ T44] 1 lock held by ip/1041: [ 492.923418][ T44] #0: ffffffffbc6925e8 (rtnl_mutex){+.+.}-{4:4}, at: rtnetlink_rcv_msg+0x2ab/0xb90 [ 492.923747][ T44] [ 492.923850][ T44] ============================================= [ 492.923850][ T44] [ 615.743532][ T44] INFO: task kworker/u16:0:12 blocked for more than 245 seconds. [ 615.743958][ T44] Not tainted 6.18.0-rc7-virtme #1 [ 615.744180][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 615.744481][ T44] task:kworker/u16:0 state:D stack:28040 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 615.744900][ T44] Workqueue: ipv6_addrconf addrconf_verify_work [ 615.745150][ T44] Call Trace: [ 615.745308][ T44] [ 615.745456][ T44] __schedule+0x88d/0x1b90 [ 615.745684][ T44] ? io_schedule_timeout+0x130/0x130 [ 615.745897][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.746071][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.746278][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.746448][ T44] schedule+0xd4/0x260 [ 615.746620][ T44] schedule_preempt_disabled+0x18/0x30 [ 615.746787][ T44] __mutex_lock+0x9ae/0x1500 [ 615.746982][ T44] ? addrconf_verify_work+0x12/0x30 [ 615.747150][ T44] ? ww_mutex_lock+0x160/0x160 [ 615.747352][ T44] ? process_one_work+0xd16/0x1390 [ 615.747556][ T44] ? trace_lock_acquire+0x88/0xd0 [ 615.747721][ T44] ? trace_lock_acquire+0x88/0xd0 [ 615.747916][ T44] ? addrconf_verify_work+0x12/0x30 [ 615.748078][ T44] addrconf_verify_work+0x12/0x30 [ 615.748273][ T44] process_one_work+0xd57/0x1390 [ 615.748443][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 615.748637][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.748809][ T44] ? assign_work+0x152/0x380 [ 615.749001][ T44] worker_thread+0x4d6/0xd40 [ 615.749178][ T44] ? process_one_work+0x1390/0x1390 [ 615.749364][ T44] kthread+0x355/0x5b0 [ 615.749502][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.749693][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.749879][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.750044][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.750247][ T44] ret_from_fork+0x1d4/0x270 [ 615.750413][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.750607][ T44] ret_from_fork_asm+0x11/0x20 [ 615.750779][ T44] [ 615.750960][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:977. [ 615.751247][ T44] INFO: task kworker/3:1:71 blocked for more than 245 seconds. [ 615.751480][ T44] Not tainted 6.18.0-rc7-virtme #1 [ 615.751661][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 615.751915][ T44] task:kworker/3:1 state:D stack:28904 pid:71 tgid:71 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 615.752251][ T44] Workqueue: events xp_release_deferred [ 615.752416][ T44] Call Trace: [ 615.752577][ T44] [ 615.752685][ T44] __schedule+0x88d/0x1b90 [ 615.752885][ T44] ? io_schedule_timeout+0x130/0x130 [ 615.753053][ T44] ? find_held_lock+0x2b/0x80 [ 615.753252][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.753420][ T44] schedule+0xd4/0x260 [ 615.753586][ T44] schedule_preempt_disabled+0x18/0x30 [ 615.753750][ T44] __mutex_lock+0x9ae/0x1500 [ 615.753938][ T44] ? xp_release_deferred+0x1b/0x1e0 [ 615.754112][ T44] ? ww_mutex_lock+0x160/0x160 [ 615.754310][ T44] ? __lock_acquire+0x34c/0x740 [ 615.754478][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.754671][ T44] ? process_one_work+0xd16/0x1390 [ 615.754841][ T44] ? xp_release_deferred+0x1b/0x1e0 [ 615.755029][ T44] xp_release_deferred+0x1b/0x1e0 [ 615.755204][ T44] process_one_work+0xd57/0x1390 [ 615.755404][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 615.755595][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.755762][ T44] ? assign_work+0x152/0x380 [ 615.755953][ T44] worker_thread+0x4d6/0xd40 [ 615.756121][ T44] ? process_one_work+0x1390/0x1390 [ 615.756313][ T44] ? __kthread_parkme+0xb3/0x200 [ 615.756479][ T44] ? process_one_work+0x1390/0x1390 [ 615.756692][ T44] kthread+0x355/0x5b0 [ 615.756828][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.757019][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.757193][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.757381][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.757572][ T44] ret_from_fork+0x1d4/0x270 [ 615.757736][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.757923][ T44] ret_from_fork_asm+0x11/0x20 [ 615.758098][ T44] [ 615.758269][ T44] INFO: task kworker/3:1:71 is blocked on a mutex likely owned by task ip:977. [ 615.758548][ T44] INFO: task ip:977 blocked for more than 368 seconds. [ 615.758730][ T44] Not tainted 6.18.0-rc7-virtme #1 [ 615.758909][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 615.759169][ T44] task:ip state:D stack:25592 pid:977 tgid:977 ppid:1 task_flags:0x400100 flags:0x00080003 [ 615.759499][ T44] Call Trace: [ 615.759644][ T44] [ 615.759776][ T44] __schedule+0x88d/0x1b90 [ 615.759943][ T44] ? io_schedule_timeout+0x130/0x130 [ 615.760134][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.760306][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.760498][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.760676][ T44] schedule+0xd4/0x260 [ 615.760839][ T44] schedule_preempt_disabled+0x18/0x30 [ 615.761002][ T44] __mutex_lock+0x9ae/0x1500 [ 615.761200][ T44] ? napi_enable+0x3b/0x80 [ 615.761371][ T44] ? virtqueue_add_inbuf_ctx+0x1850/0x1850 [ 615.761598][ T44] ? ww_mutex_lock+0x160/0x160 [ 615.761769][ T44] ? __asan_memset+0x27/0x50 [ 615.761961][ T44] ? sg_init_table+0x19/0x60 [ 615.762128][ T44] ? try_fill_recv+0x3ec/0x1750 [ 615.762326][ T44] ? napi_enable+0x3b/0x80 [ 615.762492][ T44] napi_enable+0x3b/0x80 [ 615.762660][ T44] __virtnet_rx_resume+0x156/0x290 [ 615.762824][ T44] ? queue_delayed_work_on+0x91/0x100 [ 615.763014][ T44] virtnet_rx_resume_all+0xe7/0x1a0 [ 615.763193][ T44] virtnet_xdp_set+0xef7/0x1aa0 [ 615.763385][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0 [ 615.763573][ T44] dev_xdp_install+0x4ba/0x8e0 [ 615.763741][ T44] ? netif_skb_check_for_xdp+0x600/0x600 [ 615.763936][ T44] dev_xdp_attach+0x50d/0x1320 [ 615.764104][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0 [ 615.764302][ T44] ? mutex_is_locked+0x1c/0x50 [ 615.764477][ T44] ? rtnl_is_locked+0x15/0x20 [ 615.764672][ T44] ? dev_change_xdp_fd+0x9f/0x240 [ 615.764840][ T44] do_setlink.isra.0+0x1c2d/0x2880 [ 615.765036][ T44] ? rtnl_newlink_create+0x900/0x900 [ 615.765204][ T44] ? rcu_lockdep_current_cpu_online+0x3e/0x1b0 [ 615.765425][ T44] ? rcu_read_lock_any_held+0x41/0xa0 [ 615.765617][ T44] ? validate_chain+0x287/0x5f0 [ 615.765790][ T44] ? rcu_read_lock_any_held+0x6b/0xa0 [ 615.765980][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 615.766146][ T44] ? __lock_acquire+0x34c/0x740 [ 615.766345][ T44] ? trace_lock_acquire+0x88/0xd0 [ 615.766536][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 615.766701][ T44] ? lock_acquire+0x31/0x80 [ 615.766885][ T44] ? rtnl_newlink+0x5df/0xb20 [ 615.767053][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.767250][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.767417][ T44] ? trace_contention_end+0xd6/0x140 [ 615.767610][ T44] ? rtnl_newlink+0x5df/0xb20 [ 615.767778][ T44] ? __mutex_lock+0x32e/0x1500 [ 615.767974][ T44] ? ww_mutex_lock+0x160/0x160 [ 615.768140][ T44] ? nla_validate_int_range+0x5b0/0x5b0 [ 615.768335][ T44] ? __rtnl_newlink+0x3fa/0xa40 [ 615.768534][ T44] rtnl_newlink+0x637/0xb20 [ 615.768704][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 615.768899][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.769064][ T44] ? find_held_lock+0x2b/0x80 [ 615.769256][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 615.769423][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.769619][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 615.769786][ T44] rtnetlink_rcv_msg+0x6fe/0xb90 [ 615.769986][ T44] ? rtnl_port_fill+0x940/0x940 [ 615.770147][ T44] ? __lock_acquire+0x34c/0x740 [ 615.770347][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.770538][ T44] ? find_held_lock+0x2b/0x80 [ 615.770708][ T44] netlink_rcv_skb+0x123/0x380 [ 615.770902][ T44] ? rtnl_port_fill+0x940/0x940 [ 615.771069][ T44] ? netlink_ack+0xcc0/0xcc0 [ 615.771276][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 615.771452][ T44] netlink_unicast+0x4a3/0x770 [ 615.771647][ T44] ? netlink_attachskb+0x810/0x810 [ 615.771813][ T44] ? __lock_acquire+0x34c/0x740 [ 615.772006][ T44] netlink_sendmsg+0x735/0xc60 [ 615.772178][ T44] ? netlink_unicast+0x770/0x770 [ 615.772367][ T44] ? __might_fault+0x97/0x140 [ 615.772564][ T44] ____sys_sendmsg+0x419/0x850 [ 615.772736][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 615.772925][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 615.773140][ T44] ? move_addr_to_kernel+0x40/0x40 [ 615.773313][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 615.773514][ T44] ? validate_chain+0x287/0x5f0 [ 615.773681][ T44] ___sys_sendmsg+0xfd/0x180 [ 615.773869][ T44] ? __call_rcu_common.constprop.0+0xa5/0x680 [ 615.774087][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 615.774273][ T44] __sys_sendmsg+0x124/0x1c0 [ 615.774464][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 615.774655][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 615.774819][ T44] ? __call_rcu_common.constprop.0+0x2fa/0x680 [ 615.775037][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 615.775204][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.775399][ T44] do_syscall_64+0xbb/0xfd0 [ 615.775594][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 615.775809][ T44] RIP: 0033:0x7f4d27ecec5e [ 615.775982][ T44] RSP: 002b:00007ffc557866d0 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 615.776239][ T44] RAX: ffffffffffffffda RBX: 0000000000000004 RCX: 00007f4d27ecec5e [ 615.776481][ T44] RDX: 0000000000000000 RSI: 00007ffc55786790 RDI: 0000000000000003 [ 615.776734][ T44] RBP: 00007ffc557866e0 R08: 0000000000000000 R09: 0000000000000000 [ 615.776975][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffc55786e50 [ 615.777223][ T44] R13: 00000000692f0ea5 R14: 0000000000000000 R15: 0000000000499600 [ 615.777472][ T44] [ 615.777634][ T44] INFO: task ip:977 is blocked on a mutex likely owned by task kworker/2:2:64. [ 615.777898][ T44] task:kworker/2:2 state:D stack:28904 pid:64 tgid:64 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 615.778231][ T44] Workqueue: events refill_work [ 615.778395][ T44] Call Trace: [ 615.778557][ T44] [ 615.778665][ T44] __schedule+0x88d/0x1b90 [ 615.778859][ T44] ? io_schedule_timeout+0x130/0x130 [ 615.779029][ T44] ? usleep_range_state+0xba/0x1b0 [ 615.779226][ T44] ? find_held_lock+0x2b/0x80 [ 615.779392][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.779588][ T44] ? usleep_range_state+0xba/0x1b0 [ 615.779751][ T44] schedule+0xd4/0x260 [ 615.779912][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0 [ 615.780128][ T44] ? schedule_timeout_idle+0xe0/0xe0 [ 615.780297][ T44] ? hrtimer_cb_get_time+0x90/0x90 [ 615.780486][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 615.780676][ T44] ? ktime_get+0x15e/0x220 [ 615.780840][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 615.781025][ T44] ? ktime_get+0xa9/0x220 [ 615.781171][ T44] usleep_range_state+0x133/0x1b0 [ 615.781359][ T44] ? schedule_hrtimeout+0x20/0x20 [ 615.781558][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 615.781724][ T44] napi_disable_locked+0x379/0x5f0 [ 615.781913][ T44] ? _mutex_trylock_nest_lock+0x150/0x150 [ 615.782078][ T44] ? netdev_bind_sb_channel_queue+0x470/0x470 [ 615.782308][ T44] napi_disable+0x43/0x80 [ 615.782445][ T44] refill_work+0x116/0x210 [ 615.782642][ T44] process_one_work+0xd57/0x1390 [ 615.782818][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 615.783006][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.783180][ T44] ? assign_work+0x152/0x380 [ 615.783368][ T44] worker_thread+0x4d6/0xd40 [ 615.783563][ T44] ? process_one_work+0x1390/0x1390 [ 615.783729][ T44] ? __kthread_parkme+0xb3/0x200 [ 615.783981][ T44] ? process_one_work+0x1390/0x1390 [ 615.784149][ T44] kthread+0x355/0x5b0 [ 615.784315][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.784480][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.784733][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.784899][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.785086][ T44] ret_from_fork+0x1d4/0x270 [ 615.785258][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.785495][ T44] ret_from_fork_asm+0x11/0x20 [ 615.785695][ T44] [ 615.785838][ T44] INFO: task ip:1041 blocked for more than 245 seconds. [ 615.786046][ T44] Not tainted 6.18.0-rc7-virtme #1 [ 615.786204][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 615.786531][ T44] task:ip state:D stack:25744 pid:1041 tgid:1041 ppid:1040 task_flags:0x400100 flags:0x00080001 [ 615.786912][ T44] Call Trace: [ 615.787045][ T44] [ 615.787185][ T44] __schedule+0x88d/0x1b90 [ 615.787355][ T44] ? io_schedule_timeout+0x130/0x130 [ 615.787561][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.787805][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.787970][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.788171][ T44] schedule+0xd4/0x260 [ 615.788309][ T44] schedule_preempt_disabled+0x18/0x30 [ 615.788560][ T44] __mutex_lock+0x9ae/0x1500 [ 615.788743][ T44] ? rtnetlink_rcv_msg+0x2ab/0xb90 [ 615.788908][ T44] ? write_profile+0xf0/0xf0 [ 615.789100][ T44] ? ww_mutex_lock+0x160/0x160 [ 615.789277][ T44] ? find_held_lock+0x2b/0x80 [ 615.789537][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.789705][ T44] ? rtnetlink_rcv_msg+0x2ab/0xb90 [ 615.789898][ T44] rtnetlink_rcv_msg+0x2ab/0xb90 [ 615.790062][ T44] ? rtnl_port_fill+0x940/0x940 [ 615.790313][ T44] ? __lock_acquire+0x34c/0x740 [ 615.790477][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.790666][ T44] ? find_held_lock+0x2b/0x80 [ 615.790830][ T44] netlink_rcv_skb+0x123/0x380 [ 615.791075][ T44] ? rtnl_port_fill+0x940/0x940 [ 615.791251][ T44] ? netlink_ack+0xcc0/0xcc0 [ 615.791441][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 615.791688][ T44] netlink_unicast+0x4a3/0x770 [ 615.791853][ T44] ? netlink_attachskb+0x810/0x810 [ 615.792042][ T44] ? __lock_acquire+0x34c/0x740 [ 615.792209][ T44] netlink_sendmsg+0x735/0xc60 [ 615.792447][ T44] ? netlink_unicast+0x770/0x770 [ 615.792642][ T44] ? __might_fault+0x97/0x140 [ 615.792806][ T44] ____sys_sendmsg+0x419/0x850 [ 615.792990][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 615.793152][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 615.793428][ T44] ? move_addr_to_kernel+0x40/0x40 [ 615.793627][ T44] ? rcu_lockdep_current_cpu_online+0x3e/0x1b0 [ 615.793840][ T44] ___sys_sendmsg+0xfd/0x180 [ 615.794081][ T44] ? validate_chain+0x287/0x5f0 [ 615.794252][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 615.794445][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.794635][ T44] ? __might_fault+0x97/0x140 [ 615.794883][ T44] ? _copy_to_user+0x4b/0x70 [ 615.795051][ T44] __sys_sendmsg+0x124/0x1c0 [ 615.795246][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 615.795413][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.795611][ T44] do_syscall_64+0xbb/0xfd0 [ 615.795777][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 615.795989][ T44] RIP: 0033:0x7f0812501c5e [ 615.796158][ T44] RSP: 002b:00007fffde73daa0 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 615.796465][ T44] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f0812501c5e [ 615.796708][ T44] RDX: 0000000000000000 RSI: 00007fffde73db60 RDI: 0000000000000004 [ 615.797008][ T44] RBP: 00007fffde73dab0 R08: 0000000000000000 R09: 0000000000000000 [ 615.797256][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fffde73f6bd [ 615.797493][ T44] R13: 00000000692f0f75 R14: 000000000000000d R15: 00007fffde73dc10 [ 615.797798][ T44] [ 615.797939][ T44] INFO: task ip:1041 is blocked on a mutex likely owned by task ip:977. [ 615.798188][ T44] [ 615.798188][ T44] Showing all locks held in the system: [ 615.798479][ T44] 3 locks held by kworker/u16:0/12: [ 615.798751][ T44] #0: ff11000008b0cd48 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 615.799043][ T44] #1: ffa00000000c7d30 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 615.799395][ T44] #2: ffffffffbc6925e8 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 615.799670][ T44] 1 lock held by khungtaskd/44: [ 615.799826][ T44] #0: ffffffffbbf78fc0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x2b/0x1db [ 615.800140][ T44] 3 locks held by kworker/2:2/64: [ 615.800334][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 615.800638][ T44] #1: ffa0000000457d30 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 615.801011][ T44] #2: ff110000084dac98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 615.801279][ T44] 3 locks held by kworker/3:1/71: [ 615.801439][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 615.801793][ T44] #1: ffa00000004c7d30 ((work_completion)(&pool->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 615.802131][ T44] #2: ffffffffbc6925e8 (rtnl_mutex){+.+.}-{4:4}, at: xp_release_deferred+0x1b/0x1e0 [ 615.802397][ T44] 2 locks held by ip/977: [ 615.802558][ T44] #0: ffffffffbc6925e8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x5df/0xb20 [ 615.802880][ T44] #1: ff110000084dac98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80 [ 615.803149][ T44] 1 lock held by ip/1041: [ 615.803286][ T44] #0: ffffffffbc6925e8 (rtnl_mutex){+.+.}-{4:4}, at: rtnetlink_rcv_msg+0x2ab/0xb90 [ 615.803618][ T44] [ 615.803724][ T44] ============================================= [ 615.803724][ T44]